luvHarris: A Practical Corner Detector for Event-Cameras
- 15 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (12) , 10087-10098
Abstract
There have been a number of corner detection methods proposed for event cameras in the last years, since event-driven computer vision has become more accessible. Current state-of-the-art have either unsatisfactory accuracy or real-time performance when considered for practical use, for example when a camera is randomly moved in an unconstrained environment. In this paper, we present yet another method to perform corner detection, dubbed look-up event-Harris (luvHarris), that employs the Harris algorithm for high accuracy but manages an improved event throughput. Our method has two major contributions, 1. a novel “threshold ordinal event-surface” that removes certain tuning parameters and is well suited for Harris operations, and 2. an implementation of the Harris algorithm such that the computational load per event is minimised and computational heavy convolutions are performed only ‘as-fast-as-possible’, i.e., only as computational resources are available. The result is a practical, real-time, and robust corner detector that runs more than $2.6\times$ the speed of current state-of-the-art; a necessity when using a high-resolution event-camera in real-time. We explain the considerations taken for the approach, compare the algorithm to current state-of-the-art in terms of computational performance and detection accuracy, and discuss the validity of the proposed approach for event cameras.
Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Asynchronous Spatial Image Convolutions for Event CamerasIEEE Robotics and Automation Letters, 2019
- Asynchronous Corner Detection and Tracking for Event Cameras in Real TimeIEEE Robotics and Automation Letters, 2018
- Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High-Speed ScenariosIEEE Robotics and Automation Letters, 2018
- Independent motion detection with event-driven cameras2017
- The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAMThe International Journal of Robotics Research, 2017
- Fast event-based Harris corner detection exploiting the advantages of event-driven cameras2016
- A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision SensorIEEE Journal of Solid-State Circuits, 2014
- An asynchronous time-based image sensor2008
- A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision SensorIEEE Journal of Solid-State Circuits, 2008
- A Combined Corner and Edge Detector1988