Cross-Layer Noise Analysis in Smart Digital Pixel Sensors With Integrated Deep Neural Network
- 19 October 2020
- journal article
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
- Vol. 10 (4) , 444-457
Abstract
Digital pixel based image sensors with embedded deep neural network (DNN) allow many mission critical surveillance applications. However, image noise caused by variations and non-idealities in the sensor aggravates the quality of image and further degrades the performance of a DNN. We propose a digital pixel-DNN cross-layer simulation methodology for accurate training and evaluation of a DNN under image noise induced from sensors. In particular, this paper focuses on the image noise derived from device mismatches in digital pixel circuits with 3D integrated and pixel-parallel readout circuits, and studies the effect of the resulting image noise on the accuracy of a DNN. The simulation results show that the device mismatch in the digital pixel creates distinct noise structure on output image and should be accurately considered while training a DNN. We also present design space explorations using our cross-layer simulation.Keywords
Funding Information
- Defense Advanced Research Projects Agency (HR0011-17-2-0045)
This publication has 36 references indexed in Scilit:
- 3-D-Stacked 16-Mpixel Global Shutter CMOS Image Sensor Using Reliable In-Pixel Four Million Microbump Interconnections With 7.6- $\mu \text{m}$ PitchIEEE Transactions on Electron Devices, 2015
- A spiking neuromorphic design with resistive crossbar2015
- Person re-identification via region-of-interest based features2014
- Image Denoising Using New Adaptive Based Median FilterSignal & Image Processing : An International Journal, 2014
- A 65-nm 0.5-V 17-pJ/frame.pixel DPS CMOS image sensor for ultra-low-power SoCs achieving 40-dB dynamic range2014
- Towards Understanding Action Recognition2013
- Noise in a CMOS digital pixel sensorJournal of Semiconductors, 2011
- CMOS image sensorsIEEE Circuits and Devices Magazine, 2005
- A 10000 frames/s CMOS digital pixel sensorIEEE Journal of Solid-State Circuits, 2001
- 256×256 CMOS active pixel sensor camera-on-a-chipIEEE Journal of Solid-State Circuits, 1996