UAV human teleoperation using event-based and frame-based cameras
Open Access
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Teleoperation is a crucial aspect for human-robot interaction with unmanned aerial vehicles (UAV s) applications. Fast perception processing is required to ensure robustness, precision, and safety. Event cameras are neuromorphic sensors that provide low latency response, high dynamic range and low power consumption. Although classical image-based methods have been extensively used for human-robot interaction tasks, responsiveness is limited by their processing rates. This paper presents a human-robot teleoperation scheme for UAVs that exploits the advantages of both traditional and event cameras. The proposed scheme was tested in teleoperation missions where the pose of a multi rotor robot is controlled in real time using human gestures detected from events.Keywords
Funding Information
- European Research Council (788247)
- European Commission (H2020-2019-87147)
This publication has 23 references indexed in Scilit:
- Gesture recognition for human-robot collaboration: A reviewInternational Journal of Industrial Ergonomics, 2018
- ACE: An Efficient Asynchronous Corner Tracker for Event Cameras2018
- The AEROARMS Project: Aerial Robots with Advanced Manipulation Capabilities for Inspection and MaintenanceIEEE Robotics & Automation Magazine, 2018
- EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Cameras2018
- Event-Based Vision Meets Deep Learning on Steering Prediction for Self-Driving Cars2018
- Vertical landing for micro air vehicles using event‐based optical flowJournal of Field Robotics, 2017
- A Low Power, Fully Event-Based Gesture Recognition System2017
- Accurate Angular Velocity Estimation With an Event CameraIEEE Robotics and Automation Letters, 2017
- Direct face detection and video reconstruction from event cameras2016
- Event-based, 6-DOF pose tracking for high-speed maneuvers2014