Enhancing Drone Detection via Transformer Neural Network and Positive–Negative Momentum Optimizers
Open Access
- 26 June 2025
- journal article
- research article
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 9 (7) , 167
Abstract
The rapid development of unmanned aerial vehicles (UAVs) has had a significant impact on the growth of the economic, industrial, and social welfare of society. The possibility of reaching places that are difficult and dangerous for humans to access with minimal use of third-party resources increases the efficiency and quality of maintenance of construction structures, agriculture, and exploration, which are carried out with the help of drones with a predetermined trajectory. The widespread use of UAVs has caused problems with the control of the drones’ correctness following a given route, which leads to emergencies and accidents. Therefore, UAV monitoring with video cameras is of great importance. In this paper, we propose a Yolov12 architecture with positive–negative pulse-based optimization algorithms to solve the problem of drone detection on video data. Self-attention-based mechanisms in transformer neural networks (NNs) improved the quality of drone detection on video. The developed algorithms for training NN architectures improved the accuracy of drone detection by achieving the global extremum of the loss function in fewer epochs using positive–negative pulse-based optimization algorithms. The proposed approach improved object detection accuracy by 2.8 percentage points compared to known state-of-the-art analogs.Keywords
Funding Information
- Russian Science Foundation (24-71-10016, 24-71-00024)
This publication has 39 references indexed in Scilit:
- Enhanced Small Drone Detection Using Optimized YOLOv8 With Attention MechanismsIEEE Access, 2024
- A Survey on Scheduling Techniques in Computing and Network ConvergenceIEEE Communications Surveys & Tutorials, 2023
- YOLO-V3 based real-time drone detection algorithmMultimedia Tools and Applications, 2022
- Real World Object Detection Dataset for Quadcopter Unmanned Aerial Vehicle DetectionIEEE Access, 2020
- Optimization of Convolutional Neural Networks for Imbalanced Set ClassificationProcedia Computer Science, 2020
- RF-based drone detection and identification using deep learning approaches: An initiative towards a large open source drone databaseFuture Generation Computer Systems, 2019
- A Survey on Tensor Techniques and Applications in Machine LearningIEEE Access, 2019
- A review of definitions of fractional derivatives and other operatorsJournal of Computational Physics, 2019
- Drone remote sensing for forestry research and practicesJournal of Forestry Research, 2015
- Natural Gradient Descent for On-Line LearningPhysical Review Letters, 1998