Federated Deep Reinforcement Learning for Traffic Monitoring in SDN-Based IoT Networks
- 6 August 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 7 (4) , 1048-1065
Abstract
This paper proposes a novel traffic monitoring framework, namely, DeepMonitor, for SDN-based IoT networks to provide fine-grained traffic analysis capability for different IoT traffic types at the network edges. Specifically, we first develop an intelligent flow rule match-field control system, called DeepMonitor agent, for SDN-based IoT edge nodes, taking different granularity-level requirements and their maximum flow-table capacity into consideration. We then formulate the control optimization problem for each edge node employing the Markov decision process (MDP). Next, we develop a double deep ${Q}$ -network (DDQN) algorithm to quickly achieve the optimal flow rule match-field policy. Moreover, we propose a federated DDQN-based traffic monitoring mechanism to significantly improve the learning performance of the edge nodes. The results obtained through extensive emulations show that by applying the DeepMonitor, the flow-table overflow problem at the edge nodes can be completely bypassed. The average number of match-fields in a flow rule achieved by DeepMonitor is increased by approximately 37% (for medium and diverse granularity-level requirements) and 41.9% (for high granularity-level requirement) compared to that of an existing solution, i.e., FlowStat. Finally, by adopting DeepMonitor, the DDoS attack detection performance of an intrusion detection system can be enhanced by up to 22.83% compared with that of FlowStat.Keywords
Funding Information
- National Science and Technology Development Agency
- Thailand Science Research and Innovation (International Research Network Program IRN61W0006)
- The Coordinating Center for Thai Government Science and Technology Scholarship Students
- Khon Kaen University
- National Research Council of Thailand (International Research Network Program IRN61W0006)
This publication has 40 references indexed in Scilit:
- A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and ApplicationsIEEE Internet of Things Journal, 2017
- OpenMeasure: Adaptive flow measurement & inference with online learning in SDN2016
- Research challenges for traffic engineering in software defined networksIEEE Network, 2016
- Rules Placement Problem in OpenFlow Networks: A SurveyIEEE Communications Surveys & Tutorials, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Admission control with flow aggregation for QoS provisioning in software-defined network2014
- PayLess: A low cost network monitoring framework for Software Defined Networks2014
- Intelligent SDN based traffic (de)Aggregation and Measurement Paradigm (iSTAMP)2014
- A Survey of Software-Defined Networking: Past, Present, and Future of Programmable NetworksIEEE Communications Surveys & Tutorials, 2014
- Q-learningMachine Learning, 1992