A Deep Neural Network Sensor for Visual Servoing in 3D Spaces
Open Access
Abstract
This paper describes a novel stereo vision sensor based on deep neural networks, that can be used to produce a feedback signal for visual servoing in unmanned aerial vehicles such as drones. Two deep convolutional neural networks attached to the stereo camera in the drone are trained to detect wind turbines in images and stereo triangulation is used to calculate the distance from a wind turbine to the drone. Our experimental results show that the sensor produces data accurate enough to be used for servoing, even in the presence of noise generated when the drone is not being completely stable. Our results also show that appropriate filtering of the signals is needed and that to produce correct results, it is very important to keep the wind turbine within the field of vision of both cameras, so that both deep neural networks could detect it.Keywords
This publication has 25 references indexed in Scilit:
- AutoRally: An Open Platform for Aggressive Autonomous DrivingIEEE Control Systems, 2019
- Focal Loss for Dense Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- DroNet: Learning to Fly by DrivingIEEE Robotics and Automation Letters, 2018
- Deep Neural Network for Autonomous UAV Navigation in Indoor Corridor EnvironmentsProcedia Computer Science, 2018
- IR stereo RealSense: Decreasing minimum range of navigational assistance for visually impaired individualsJournal of Ambient Intelligence and Smart Environments, 2017
- A Machine Learning Approach to Visual Perception of Forest Trails for Mobile RobotsIEEE Robotics and Automation Letters, 2015
- Transfer Learning for Visual Categorization: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2014
- Measuring Distance with Mobile Phones Using Single-Camera Stereo Vision2012
- Visual servo control. I. Basic approachesIEEE Robotics & Automation Magazine, 2006
- Original approach for the localisation of objects in imagesIEE Proceedings - Vision, Image, and Signal Processing, 1994