Trajectory Planning for UAV-Based Smart Farming Using Imitation-Based Triple Deep Q-Learning
Preprint
Abstract
Unmanned aerial vehicles (UAVs) have emerged as a promising auxiliary platform for smart agriculture, capable of simultaneously performing weed detection, recognition, and data collection from wireless sensors. However, trajectory planning for UAV-based smart agriculture is challenging due to the high uncertainty of the environment, partial observations, and limited battery capacity of UAVs. To address these issues, we formulate the trajectory planning problem as a Markov decision process (MDP) and leverage multi-agent reinforcement learning (MARL) to solve it. Furthermore, we propose a novel imitation-based triple deep Q-network (ITDQN) algorithm, which employs an elite imitation mechanism to reduce exploration costs and utilizes a mediator Q-network over a double deep Q-network (DDQN) to accelerate and stabilize training and improve performance. Experimental results in both simulated and real-world environments demonstrate the effectiveness of our solution. Moreover, our proposed ITDQN outperforms DDQN by 4.43\% in weed recognition rate and 6.94\% in data collection rate.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- A Shortest Distance Priority UAV Path Planning Algorithm for Precision AgricultureSensors, 2024
- Research on Path Planning of Agricultural UAV Based on Improved Deep Reinforcement LearningAgronomy, 2024
- Elastic step DQN: A novel multi-step algorithm to alleviate overestimation in Deep Q-NetworksNeurocomputing, 2023
- Agricultural UAV trajectory planning by incorporating multi-mechanism improved grey wolf optimization algorithmExpert Systems with Applications, 2023
- Coverage Path Planning Optimization of Heterogeneous UAVs Group for Precision AgricultureIEEE Access, 2023
- Survey for smart farming technologies: Challenges and issuesComputers and Electrical Engineering, 2021
- A Review of Applications and Communication Technologies for Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) Based Sustainable Smart FarmingSustainability, 2021
- Smart Farming in EuropeComputer Science Review, 2021
- Big Data in Smart Farming – A reviewAgricultural Systems, 2017
- An analysis of temporal-difference learning with function approximationIEEE Transactions on Automatic Control, 1997