Airborne Sense and Detect of Drones using LiDAR and adapted PointPillars DNN
Authors:
Preprint
Abstract
The safe operation of drone swarms beyond visual line of sight requires multiple safeguards to mitigate the risk of collision between drones flying in hyper localised scenarios. Cooperative navigation and flight coordination strategies that rely on pre-planned trajectories and require constant network connectivity are brittle to failure. Drone embedded sense and detect offers a comprehensive mode of separation between drones for deconfliction and collision avoidance. This paper presents the first airborne LiDAR based solution for drone-swarm detection and localisation using 3D deep learning. It adapts and embeds the PointPillars deep learning neural network on the drone. To collect training data of close-quarter multi drone operations and safety critical scenarios, a scenario Digital Twin is used to augment real datasets with high fidelity synthetic data. The method has been validated in real-world tests. The trained model achieves over 80% recall and 96% precision when tested on real datasets. By incorporating a detection-by-tracking algorithm the system can reliably monitor the separation distance of multiple drones in challenging environments.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Deep Learning for 3D Point Clouds: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2021
- A multi-sensorial approach for the protection of operational vehicles by detection and classification of small flying objects2020
- Augmented LiDAR Simulator for Autonomous DrivingIEEE Robotics and Automation Letters, 2020
- Deep learning-based strategies for the detection and tracking of drones using several camerasIPSJ Transactions on Computer Vision and Applications, 2019
- Automatic Generation of Synthetic LiDAR Point Clouds for 3-D Data AnalysisIEEE Transactions on Instrumentation and Measurement, 2019
- Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving ScenesInternational Journal of Computer Vision, 2018
- Detection of acoustic, electro-optical and RADAR signatures of small unmanned aerial vehicles2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Detecting Flying Objects Using a Single Moving CameraIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013