Automated characterization techniques and testbeds for event-based cameras
Authors:
- 30 September 2022
- conference paper
- Published by SPIE-Intl Soc Optical Eng
- Vol. 12233, 64-86
Abstract
Event-based camera (EBC) technology shows promise for efficient capture of spatio-temporal information, producing a sparse data stream and enabling consideration of nontraditional data processing solutions (e.g., new algorithms, neuromorphic processors). Given the fundamental difference in camera architecture, the EBC response and noise behavior differ considerably compared to standard CCD/CMOS framing sensors. These differences necessitate development of new characterization techniques to quantify performance and assess if the EBC technology produces benefits relative to traditional imaging sensors. Here we present progress on development of basic sensor performance modeling and test capabilities for commercial-off-the-shelf visible EBCs. Laboratory characterization techniques include noise level as a function of static scene light level (termed background activity) and EBC temporal contrast response to dynamic signals. Initial environmental tests of the Prophesee PPS3MVCD event-based sensor found several addressable areas of concern but identified no showstoppers that would prevent use of this device in a high-reliability aerospace application. Two independent radiation tolerance test efforts, one for the PPS3MVCD and another for the iniVation DAVIS346 EBC (both based on 180 nm CMOS technology), indicate functional issues for total ionizing dose (TID) of greater than 30 krad(Si), and show background activity increasing with TID. However, no significant change in contrast response was observed. One DAVIS346 exhibited functional failure following final gamma radiation dose from 20 krad(Si) to 50 krad(Si), and the readout saturated during doses dominated by negative-polarity events (by a factor of 10 or greater). A second DAVIS346 locked-up during proton dose but recovered normal operation following a brief rest period and power cycling. DAVIS346 pixels include both change detection (DVS) and standard grayscale frames (APS) functionalities – driven by a single photodiode; results show a 70% increase in dark current and 23% increase in dark event noise after proton exposure to 20 krad(Si). As new versions of EBC technology are developed for infrared wavelengths, we anticipate these characterization techniques will be largely translatable to IR EBCs.Keywords
This publication has 17 references indexed in Scilit:
- IEEE Transactions on Electron Devices2023
- IEEE Transactions on Nuclear Science2023
- 5.10 A 1280×720 Back-Illuminated Stacked Temporal Contrast Event-Based Vision Sensor with 4.86µm Pixels, 1.066GEPS Readout, Programmable Event-Rate Controller and Compressive Data-Formatting Pipeline2020
- Radiation tests on the COTS image sensor from CMOSIS2019
- Characterization setup for event-based imagers applied to modulated light signal detectionApplied Optics, 2019
- A Sensitive Dynamic and Active Pixel Vision Sensor for Color or Neural Imaging ApplicationsIEEE Transactions on Biomedical Circuits and Systems, 2017
- Total Ionizing Dose Effects on a Radiation-Hardened CMOS Image Sensor Demonstrator for ITER Remote HandlingIEEE Transactions on Nuclear Science, 2017
- Event‐Based Neuromorphic Systems2014
- Sensitivity and uniformity of a 0.18µm CMOS temporal contrast pixel array2011
- A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDSIEEE Journal of Solid-State Circuits, 2010