Real-time, high-speed video decompression using a frame- and event-based DAVIS sensor
Authors:
- 1 June 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02714302,p. 686-689
Abstract
Dynamic and active pixel vision sensors (DAVISs) are a new type of sensor that combine a frame-based intensity readout with an event-based temporal contrast readout. This paper demonstrates that these sensors inherently perform high-speed, video compression in each pixel by describing the first decompression algorithm for this data. The algorithm performs an online optimization of the event decoding in real time. Example scenes were recorded by the 240×180 pixel sensor at sub-Hz frame rates and successfully decompressed yielding an equivalent frame rate of 2kHz. A quantitative analysis of the compression quality resulted in an average pixel error of 0.5DN intensity resolution for non-saturating stimuli. The system exhibits an adaptive compression ratio which depends on the activity in a scene; for stationary scenes it can go up to 1862. The low data rate and power consumption of the proposed video compression system make it suitable for distributed sensor networks.Keywords
This publication has 9 references indexed in Scilit:
- Comparison of spike encoding schemes in asynchronous vision sensors: Modeling and design2014
- Real Time Compressive Sensing Video Reconstruction in HardwareIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2012
- Asynchronous event‐based high speed vision for microparticle trackingJournal of Microscopy, 2011
- Interacting maps for fast visual interpretation2011
- A 3.6 $\mu$s Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-SensorIEEE Journal of Solid-State Circuits, 2011
- A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDSIEEE Journal of Solid-State Circuits, 2010
- Activity-driven, event-based vision sensors2010
- A 128$\times$128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision SensorIEEE Journal of Solid-State Circuits, 2008
- Point-to-point connectivity between neuromorphic chips using address eventsIEEE Transactions on Circuits and Systems II: Express Briefs, 2000