In-Sensor Visible and Mid-Infrared Dual-Band Perception and Computing

Authors:

Abstract
Machine vision in complex environments requires hardware that can integrate multispectral sensing with real-time front-end information processing. Visible light (VIS) and mid-infrared (MIR) signals provide complementary scene information, yet existing photodetectors cannot directly support VIS–MIR dual-band image processing at the sensor front end because their outputs are difficult to make both spectrally distinguishable and computation-compatible. Here, we report an electrically tunable lateral back-to-back dual-heterojunction device based on multilayer graphene/tungsten diselenide/black phosphorus for VIS–MIR dual-band in-sensor computing. The device exhibits electrically defined photoresponse states with spectrally distinguishable and bipolar characteristics, enabling simultaneous pattern recognition and spectral-band identification directly at the sensor level with 100% accuracy across three letter classes. It further supports dual-band in-sensor convolution in MIR-suppression and MIR-enhancement modes, allowing task-oriented modulation of MIR information while extracting VIS features. In addition, the device enables effective sensor-level suppression of VIS glare superimposed on MIR targets, improving downstream recognition accuracy from 33 to 98%. This work provides a device-level route toward task-oriented VIS–MIR information processing and efficient multispectral machine vision in complex environments.
Funding Information
  • Agency for Science, Technology and Research (M23M2b0056)
  • Agency for Science, Technology and Research (R23I0IR041)
  • National Research Foundation Singapore (NRF2023-ITC004-001)
  • National Research Foundation Singapore (NRF-CRP29-2022-0003)
  • National Research Foundation Singapore (NRF-MSG-2023-0002)
  • Ministry of Education - Singapore (MOET32024-0001)
  • Graduate Program in Physics at UNIFAL-MG (62605055)
  • Graduate Program in Physics at UNIFAL-MG (62674027)

This publication has 38 references indexed in Scilit: