Real-Time Detection of Ground Objects Based on Unmanned Aerial Vehicle Remote Sensing with Deep Learning: Application in Excavator Detection for Pipeline Safety
Open Access
- 3 January 2020
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 12 (1) , 182
Abstract
Unmanned aerial vehicle (UAV) remote sensing and deep learning provide a practical approach to object detection. However, most of the current approaches for processing UAV remote-sensing data cannot carry out object detection in real time for emergencies, such as firefighting. This study proposes a new approach for integrating UAV remote sensing and deep learning for the real-time detection of ground objects. Excavators, which usually threaten pipeline safety, are selected as the target object. A widely used deep-learning algorithm, namely You Only Look Once V3, is first used to train the excavator detection model on a workstation and then deployed on an embedded board that is carried by a UAV. The recall rate of the trained excavator detection model is 99.4%, demonstrating that the trained model has a very high accuracy. Then, the UAV for an excavator detection system (UAV-ED) is further constructed for operational application. UAV-ED is composed of a UAV Control Module, a UAV Module, and a Warning Module. A UAV experiment with different scenarios was conducted to evaluate the performance of the UAV-ED. The whole process from the UAV observation of an excavator to the Warning Module (350 km away from the testing area) receiving the detection results only lasted about 1.15 s. Thus, the UAV-ED system has good performance and would benefit the management of pipeline safety.Keywords
This publication has 45 references indexed in Scilit:
- DroNet: Learning to Fly by DrivingIEEE Robotics and Automation Letters, 2018
- Embedded Real-Time Object Detection for a UAV Warning System2017
- Deep Learning Approach for Car Detection in UAV ImageryRemote Sensing, 2017
- Object-Based Land-Cover Supervised Classification for Very-High-Resolution UAV Images Using Stacked Denoising AutoencodersIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017
- A Convolutional Neural Network Approach for Assisting Avalanche Search and Rescue Operations with UAV ImageryRemote Sensing, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Vehicle detection from high-resolution aerial images using spatial pyramid pooling-based deep convolutional neural networksMultimedia Tools and Applications, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Unmanned aerial systems for photogrammetry and remote sensing: A reviewISPRS Journal of Photogrammetry and Remote Sensing, 2014