Tianxin Wang

The integration of a pixelated Fabry–Pérot filter array onto the image sensor enables on-chip snapshot multispectral imaging, significantly reducing the size and weight of conventional spectral imaging equipment. However, a traditional Fabry–Pérot cavity, based on metallic or dielectric layers, exhibits a narrow bandwidth, which restricts their utility in broader applications. In this work, we propose novel Fabry–Pérot filter structures that employ dielectric thin films for phase modulation, enabling single-peak filtering across a broad operational wavelength range from 400 nm to 1100 nm. The proposed structures are easy to fabricate and compatible with complementary metal-oxide-semiconductor (CMOS) image sensors. Moreover, the structures show low sensitivity to oblique incident angles of up to 30° with minimal wavelength shifts. This advanced Fabry–Pérot filter design provides a promising pathway for expanding the operational wavelength of snapshot spectral imaging systems, thereby potentially extending their application across numerous related fields.

Traditional facial recognition is realized by facial recognition algorithms based on 2D or 3D digital images and has been well developed and has found wide applications in areas related to identification verification. In this work, we propose a novel live face detection (LFD) method by utilizing snapshot spectral imaging technology, which takes advantage of the distinctive reflected spectra from human faces. By employing a computational spectral reconstruction algorithm based on Tikhonov regularization, a rapid and precise spectral reconstruction with a fidelity of over 99% for the color checkers and various types of “face” samples has been achieved. The flat face areas were extracted exactly from the “face” images with Dlib face detection and Euclidean distance selection algorithms. A large quantity of spectra were rapidly reconstructed from the selected areas and compiled into an extensive database. The convolutional neural network model trained on this database demonstrates an excellent capability for predicting different types of “faces” with an accuracy exceeding 98%, and, according to a series of evaluations, the system’s detection time consistently remained under one second, much faster than other spectral imaging LFD methods. Moreover, a pixel-level liveness detection test system is developed and a LFD experiment shows good agreement with theoretical results, which demonstrates the potential of our method to be applied in other recognition fields. The superior performance and compatibility of our method provide an alternative solution for accurate, highly integrated video LFD applications.

The remarkable light perception abilities of the mantis shrimp, which span a broad spectrum ranging from 300 nm to 720 nm and include the detection of polarized light, serve as the inspiration for our exploration. Drawing insights from the mantis shrimp’s unique visual system, we propose the design of a multifunctional imaging sensor capable of concurrently detecting spectrum and polarization across a wide waveband. This sensor is able to show spectral imaging capability through the utilization of a 16-channel multi-waveband Fabry–Pérot (FP) resonator filter array. The design incorporates a composite thin film structure comprising metal and dielectric layers as the reflector of the resonant cavity. The resulting metal–dielectric composite film FP resonator extends the operating bandwidth to cover both visible and infrared regions, specifically spanning a broader range from 450 nm to 900 nm. Furthermore, within this operational bandwidth, the metal–dielectric composite film FP resonator demonstrates an average peak transmittance exceeding 60%, representing a notable improvement over the metallic resonator. Additionally, aluminum-based metallic grating arrays are incorporated beneath the FP filter array to capture polarization information. This innovative approach enables the simultaneous acquisition of spectrum and polarization information using a single sensor device. The outcomes of this research hold promise for advancing the development of high-performance, multifunctional optical sensors, thereby unlocking new possibilities in the field of optical information acquisition.