Federated Reinforcement Learning for Energy-Efficient D2D-IoT Networks With AoI Awareness
Open Access
- 30 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Vehicular Technology
- Vol. 6, 2828-2841
Abstract
This paper proposes a federated reinforcement learning (FRL) framework for optimizing energy efficiency (EE) and Age of Information (AoI) in device-to-device (D2D) and Internet of Things (IoT) networks. The model leverages simultaneous wireless information and power transfer (SWIPT) with heterogeneous energy harvesting mechanisms-time switching (TS) for D2D users and power splitting (PS) for IoT devices. The objective is to maximize EE while satisfying constraints on data rate, AoI, power transmission, spectrum sharing, and time allocation. The resulting non-convex mixed-integer nonlinear programming problem is addressed using an FRL approach, where a software-defined network controller coordinates distributed agents to optimize resource allocation while preserving data privacy. Simulations demonstrate that the proposed framework achieves up to 25% higher EE and maintains AoI below critical thresholds compared to baseline methods, offering a scalable solution for energy-constrained, time-sensitive communication systems.Keywords
This publication has 31 references indexed in Scilit:
- A Comprehensive Systematic Survey of IoT Protocols: Implications for Data Quality and PerformanceIEEE Access, 2024
- FeDRL-D2D: Federated Deep Reinforcement Learning- Empowered Resource Allocation Scheme for Energy Efficiency Maximization in D2D-Assisted 6G NetworksIEEE Access, 2024
- Jointly Optimize Energy Harvest Time and Device Pairing for D2D Communications Underlaying Cellular NetworkWireless Personal Communications, 2024
- Energy Harvesting Enabled Adaptive Mode Selection for Cognitive Device-to-Device Communication in a Hybrid Wireless Network: A Stochastic Geometry PerspectiveWireless Personal Communications, 2023
- Throughput performance of a non‐linear energy‐harvesting cognitive radio‐enabled device‐to‐device networkInternational Journal of Communication Systems, 2022
- PS-QMix: A Parallel Learning Framework for Q-Mix Using Parameter Server2022
- Federated Learning Meets Blockchain in Edge Computing: Opportunities and ChallengesIEEE Internet of Things Journal, 2021
- Real-Time Energy Harvesting Aided Scheduling in UAV-Assisted D2D Networks Relying on Deep Reinforcement LearningIEEE Access, 2020
- Deep-Reinforcement-Learning-Based Energy-Efficient Resource Management for Social and Cognitive Internet of ThingsIEEE Internet of Things Journal, 2020
- Energy Efficient Resource Allocation Algorithm in Energy Harvesting-Based D2D Heterogeneous NetworksIEEE Internet of Things Journal, 2018