Neuromorphic Vision Data Coding: Classifying and Reviewing the Literature
Open Access
- 13 January 2025
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 14626-14657
Abstract
In recent years, visual sensors have been quickly improving towards mimicking the visual information acquisition process of human brain by responding to illumination changes as they occur in time rather than at fixed time intervals. In this context, the so-called neuromorphic vision sensors depart from the conventional frame-based image sensors by adopting a paradigm shift in the way visual information is acquired. This new way of visual information acquisition enables faster and asynchronous per-pixel responses/recordings driven by the scene dynamics with a very high dynamic range and low power consumption. However, the huge amount of data outputted by the emerging neuromorphic vision sensors critically demands highly efficient coding solutions in order applications may take full advantage of these new, attractive sensors’ capabilities. For this reason, considerable research efforts have been invested in recent years towards developing increasingly efficient neuromorphic vision data coding (NVDC) solutions. In this context, the main objective of this paper is to provide a comprehensive overview of NVDC solutions in the literature, guided by a novel classification taxonomy, which allows better organizing this emerging field. In this way, more solid conclusions can be drawn about the current NVDC status quo , thus allowing to better drive future research and standardization developments in this emerging technical area.Keywords
All Related Versions
Funding Information
- RayShaper SA, Valais, Switzerland, through the Project “Event Aware Sensor Compression;”
- Fundação para a Ciência e a Tecnologia (FCT), Portugal, through the Project “Deep Compression: Emerging Paradigm for Image Coding” (PTDC/EEI-COM/7775/2020)
This publication has 52 references indexed in Scilit:
- Progressive Spatio-temporal Alignment for Efficient Event-based Motion Estimation2023
- Entropy Coding-based Lossless Compression of Asynchronous Event Sequences2023
- Lossless Compression of Neuromorphic Vision Sensor Data Based on Point Cloud RepresentationIEEE Access, 2022
- hARMS: A Hardware Acceleration Architecture for Real-Time Event-Based Optical FlowIEEE Access, 2022
- 1000× Faster Camera and Machine Vision with Ordinary DevicesEngineering, 2022
- Lossless Compression of Data From Static and Mobile Dynamic Vision Sensors-Performance and Trade-OffsIEEE Access, 2020
- Spike Coding for Dynamic Vision Sensors2018
- A Low Power, Fully Event-Based Gesture Recognition System2017
- Spike Camera and Its Coding Methods2017
- Context-based, adaptive, lossless image codingIEEE Transactions on Communications, 1997