Depth Quality Improvement with a 607 MHz Time-Compressive Computational Pseudo-dToF CMOS Image Sensor
Open Access
Abstract
In this paper, we present a prototype pseudo-direct time-of-flight (ToF) CMOS image sensor, achieving high distance accuracy, precision, and robustness to multipath interference. An indirect ToF (iToF)-based image sensor, which enables high spatial resolution, is used to acquire temporal compressed signals in the charge domain. Whole received light waveforms, like those acquired with conventional direct ToF (dToF) image sensors, can be obtained after image reconstruction based on compressive sensing. Therefore, this method has the advantages of both dToF and iToF depth image sensors, such as high resolution, high accuracy, immunity to multipath interference, and the absence of motion artifacts. Additionally, two approaches to refine the depth resolution are explained: (1) the introduction of a sub-time window; and (2) oversampling in image reconstruction and quadratic fitting in the depth calculation. Experimental results show the separation of two reflections 40 cm apart under multipath interference conditions and a significant improvement in distance precision down to around 1 cm. Point cloud map videos demonstrate the improvements in depth resolution and accuracy. These results suggest that the proposed method could be a promising approach for virtually implementing dToF imaging suitable for challenging environments with multipath interference.Keywords
Funding Information
- JST, CREST (JPMJCR22C1, 17H06102, 18H05240)
- Grants-in-Aid for Scientific Research (S) (JPMJCR22C1, 17H06102, 18H05240)
This publication has 20 references indexed in Scilit:
- Review of constraints on vision‐based gesture recognition for human–computer interactionIET Computer Vision, 2017
- Recent advances in transient imaging: A computer graphics and vision perspectiveVisual Informatics, 2017
- Single-event transient imaging with an ultra-high-speed temporally compressive multi-aperture CMOS image sensorOptics Express, 2016
- 6.4 Single-shot 200Mfps 5×3-aperture compressive CMOS imager2015
- Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularizationOptics Letters, 2014
- Compressive sensing: From theory to applications, a surveyJournal of Communications and Networks, 2013
- An efficient augmented Lagrangian method with applications to total variation minimizationComputational Optimization and Applications, 2013
- Real-time sign language letter and word recognition from depth data2011
- Compressive Sensing [Lecture Notes]IEEE Signal Processing Magazine, 2007
- Design and characterization of a CMOS 3-D image sensor based on single photon avalanche diodesIEEE Journal of Solid-State Circuits, 2005