An Adaptive Deep Reinforcement Learning Routing Decision Algorithm-Based on ResNet-BiLSTM-ProbSparseAttention and Imitation Learning
- 1 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 26 (8) , 12777-12793
Abstract
Wireless Sensor Networks (WSNs) have become an indispensable part of the Internet of Things (IoT). How to balance energy consumption and data transmission to further extend the overall lifetime of WSNs remains a key issue for IoT applications deployed on WSN infrastructure. Different from traditional clustering routing algorithms, this paper proposes an adaptive intelligent routing decision algorithm based on deep reinforcement learning (DRL). The proposed model leverages ResNet to extract local spatial features from WSN topology diagram, while BiLSTM captures bidirectional sequence dependencies. These two models are used to address the problems of frequent WSN topology changes and large state spaces. Additionally, the ProbSparse Attention mechanism is adopted to prune large-scale action spaces and make routing decisions. To accelerate the convergence speed of reinforcement learning (RL), the Deep Q-Network (DQN) algorithm incorporates imitation learning (IL) from existing clustering algorithms to balance exploration and exploitation. Experimental evaluations demonstrate the superior performance of the proposed algorithm on network lifespan and energy efficiency. Furthermore, ablation experiments highlight the importance of each model and strategy component.Keywords
Funding Information
- National Natural Science Foundation of China (62061023)
- Gansu Provincial Department of Education: School Teacher Innovation Fund Project (2025A-053)
This publication has 39 references indexed in Scilit:
- Energy-efficient routing protocol for underwater wireless sensor networks using a hybrid metaheuristic algorithmEngineering Applications of Artificial Intelligence, 2024
- Cluster head selection strategy of WSN based on binary multi-objective adaptive fish migration optimization algorithmApplied Soft Computing, 2023
- Optimized leach protocol for energy management in wireless sensor networkMultimedia Tools and Applications, 2023
- Context-aware environment monitoring to support LPWAN-based battlefield applicationsComputer Communications, 2022
- Trust- and energy-aware cluster head selection in a UAV-based wireless sensor network using Fit-FCMThe Journal of Supercomputing, 2021
- Multi-agent deep reinforcement learning: a surveyArtificial Intelligence Review, 2021
- PSO-based sink placement and load-balanced anycast routing in multi-sink WSNs considering compressive sensing theoryEngineering Applications of Artificial Intelligence, 2021
- Energy efficient cluster based routing protocol for WSN using butterfly optimization algorithm and ant colony optimizationAd Hoc Networks, 2021
- Energy efficient load balancing approach for avoiding energy hole problem in WSN using Grey Wolf Optimizer with novel fitness functionApplied Soft Computing, 2019
- Q-learningMachine Learning, 1992