Abstract
This paper presents an event-driven, dual-mode cryogenic infrared vision sensor that features a two-step time-encoding (TE) analog-to-digital converter (ADC) and a high-speed frame difference (FD) for motion detection. To enable always-on scene-adaptive motion perception with power optimization, the vision sensor is reconfigurable, supporting two operation modes: 1) Precise Imaging (PIM) and 2) Motion Detection (MD). In PIM mode, a two-step TE ADC is proposed for small-pixel-pitch infrared focal plane arrays (IRFPAs). The coarse conversion utilizes pulse frequency modulation (PFM) with an area-efficient true single-phase clock (TSPC) counter. This PFM employs a non-periodic-reset architecture to enable multi-subframe fusion and fine conversion of time-to-first spike (TFS), thereby improving the signal-to-noise ratio (SNR) within a limited pixel area. In MD mode, a high-speed FD-based 1.5-bit event detection is implemented, using subframe coarse conversion without incurring additional memory cost or frame-rate loss. Compared with PIM mode, MD mode reduces power consumption by approximately 40% by deactivating fine conversion and partial output channels. A $1280\times 1024$ prototype with a 15- $\mu $ m pixel pitch was fabricated using a stacking process, in which the digital readout integrated circuit (DROIC) was implemented in a 0.18- $\mu $ m CMOS process and interconnected with the HgCdTe IRFPA via indium bumps. In PIM mode, the prototype achieves 83.2dB SNR with a power consumption of 115.4 mW at 30.5 frames per second (fps) (1.49 pJ $\cdot \mu $ m2/step). In MD mode, with an 8-bit coarse conversion for event detection, the sensor consumes 58.83 mW at 976.6 fps (3.5 fJ/pixel-event), achieving the best event FoM among reported event-driven infrared vision sensors.
Funding Information
  • National Key Research and Development Program of China (2021YFA0715503)
  • Key Project Tasks of National Natural Science Foundation of China (U25B2058)
  • National Natural Science Foundation of China (QYIS2022-1502-B)