Micro 4D Imaging Sensor Using Snapshot Narrowband Imaging Method
Open Access
- 29 August 2023
- journal article
- research article
- Published by MDPI AG in Micromachines
- Vol. 14 (9) , 1689
Abstract
The spectral and depth (SAD) imaging method plays an important role in the field of computer vision. However, accurate depth estimation and spectral image capture from a single image without increasing the volume of the imaging sensor is still an unresolved problem. Our research finds that a snapshot narrow band imaging (SNBI) method can discern wavelength-dependent spectral aberration and simultaneously capture spectral-aberration defocused images for quantitative depth estimation. First, a micro 4D imaging (M4DI) sensor is proposed by integrating a mono-chromatic imaging sensor with a miniaturized narrow-band microarrayed spectral filter mosaic. The appearance and volume of the M4DI sensor are the same as the integrated mono-chromatic imaging sensor. A simple remapping algorithm was developed to separate the raw image into four narrow spectral band images. Then, a depth estimation algorithm is developed to generate 3D data with a dense depth map at every exposure of the M4DI sensor. Compared with existing SAD imaging method, the M4DI sensor has the advantages of simple implementation, low computational burden, and low cost. A proof-of-principle M4DI sensor was applied to sense the depth of objects and to track a tiny targets trajectory. The relative error in the three-dimensional positioning is less than 7% for objects within 1.1 to 2.8 m.Keywords
Funding Information
- Natural Science Foundation of Fujian (2020J02005, 2021J01293)
- General Program of Fujian Province Natural Science Foundation (2020J02005, 2021J01293)
This publication has 37 references indexed in Scilit:
- Compressive 4D spectro-volumetric imagingOptics Letters, 2016
- Passive depth estimation using chromatic aberration and a depth from defocus approachApplied Optics, 2013
- Review of spectral imaging technology in biomedical engineering: achievements and challengesJournal of Biomedical Optics, 2013
- Multispectral integral imaging acquisition and processing using a monochrome camera and a liquid crystal tunable filterOptics Express, 2012
- 3D imaging spectroscopy for measuring hyperspectral patterns on solid objectsACM Transactions on Graphics, 2012
- Defocus map estimation from a single imagePattern Recognition, 2011
- 3D and multispectral imaging for subcutaneous veins detectionOptics Express, 2009
- A Closed-Form Solution to Natural Image MattingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Nondestructive measurement of fruit and vegetable quality by means of NIR spectroscopy: A reviewPostharvest Biology and Technology, 2007
- High performance imaging using large camera arraysACM Transactions on Graphics, 2005