Abstract
Wireless Sensor Networks (WSNs) have become an indispensable part of the Internet of Things (IoT). How to balance energy consumption and data transmission to further extend the overall lifetime of WSNs remains a key issue for IoT applications deployed on WSN infrastructure. Different from traditional clustering routing algorithms, this paper proposes an adaptive intelligent routing decision algorithm based on deep reinforcement learning (DRL). The proposed model leverages ResNet to extract local spatial features from WSN topology diagram, while BiLSTM captures bidirectional sequence dependencies. These two models are used to address the problems of frequent WSN topology changes and large state spaces. Additionally, the ProbSparse Attention mechanism is adopted to prune large-scale action spaces and make routing decisions. To accelerate the convergence speed of reinforcement learning (RL), the Deep Q-Network (DQN) algorithm incorporates imitation learning (IL) from existing clustering algorithms to balance exploration and exploitation. Experimental evaluations demonstrate the superior performance of the proposed algorithm on network lifespan and energy efficiency. Furthermore, ablation experiments highlight the importance of each model and strategy component.
Funding Information
  • National Natural Science Foundation of China (62061023)
  • Gansu Provincial Department of Education: School Teacher Innovation Fund Project (2025A-053)

This publication has 39 references indexed in Scilit: