Robust visual tracking with a freely-moving event camera
Authors:
- 1 September 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3769-3776
Abstract
Event cameras are a new technology that can enable low-latency, fast visual sensing in dynamic environments towards faster robotic vision as they respond only to changes in the scene and have a very high temporal resolution (<; 1μs). Moving targets produce dense spatio-temporal streams of events that do not suffer from information loss “between frames”, which can occur when traditional cameras are used to track fast-moving targets. Event-based tracking algorithms need to be able to follow the target position within the spatio-temporal data, while rejecting clutter events that occur as a robot moves in a typical office setting. We introduce a particle filter with the aim to be robust to temporal variation that occurs as the camera and the target move with different relative velocities, which can lead to a loss in visual information and missed detections. The proposed system provides a more persistent tracking compared to prior state-of-the-art, especially when the robot is actively following a target with its gaze. Experiments are performed on the iCub humanoid robot performing ball tracking and gaze following.Keywords
This publication has 12 references indexed in Scilit:
- EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real TimeIEEE Robotics and Automation Letters, 2016
- Event-driven ball detection and gaze fixation in clutter2016
- Combined frame- and event-based detection and tracking2016
- Asynchronous Event-Based Multikernel Algorithm for High-Speed Visual Features TrackingIEEE Transactions on Neural Networks and Learning Systems, 2014
- Event-based, 6-DOF pose tracking for high-speed maneuvers2014
- Event-based 3D SLAM with a depth-augmented dynamic vision sensor2014
- Simultaneous Mosaicing and Tracking with an Event Camera2014
- Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensorFrontiers in Neuroscience, 2013
- Event-based particle filtering for robot self-localization2012
- Asynchronous event‐based high speed vision for microparticle trackingJournal of Microscopy, 2011