Ultrasensitive infrared-to-visible artificial vision via self-evolving projection guided by single-pixel detection
Preprint
- 14 October 2026
- preprint
- Published by Springer Nature in Research Square
Abstract
Infrared detection and visualization are essential for augmenting human perception across diverse fields, ranging from night vision to industrial inspection and bio-imaging. Conventional infrared cameras are often hindered by high cost, bulky architecture, and complex fabrication requirements. Upconversion sensing systems offer a pixel-free and cost-effective alternative solution by upconverting low-energy infrared photons into visible-light signals. However, existing upconversion systems suffer from limitations such as high operating voltages, low quantum efficiency, and the need for intense excitation, which prevent their applications in photon-starved environments, particularly for imaging at the single- or sub-photon conditions. Here, we report Self-evolving Infrared-to-VIsible upconversion with Single-pixel detection (SIVIS) that enables real-time upconverted visualization with single-photon sensitivity under photon-starved conditions, by integrating self-evolving projection with single-pixel sensing. SIVIS iteratively optimizes illumination patterns with a digital micromirror device based on real-time feedback from a single-pixel infrared detector. This self-evolving process enables the autonomous reconstruction of the target’s geometric profile. Simultaneously, it projects a co-modulated visible beam onto the object itself or an adjacent screen, rendering the infrared target directly perceptible to the naked eye in real-time. SIVIS achieves sensing and projection without latency under an ultra-low infrared detection limit of ~ 0.11 photons per pixel per frame (sub-pW/cm 2 level) benefited from the high sensitivity. We demonstrate SIVIS in both transmissive and reflective configurations across static and dynamic scenarios. Furthermore, we also validate SIVIS to decrypt infrared-encoded anti-counterfeiting features and visualize vascular-like structures embedded within biological tissues, leveraging the in-depth imaging ability of SIVIS. This photon-feedback-driven artificial vision framework offers a scalable and adaptive solution for ultrasensitive infrared vision, opening promising avenues for night vision, biomedical imaging, and sensing under extreme low-light conditions.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- Near-infrared spatiotemporal color vision in humans enabled by upconversion contact lensesCell, 2025
- Multi‐Photon Super‐Linear Image Scanning Microscopy Using Upconversion NanoparticlesLaser & Photonics Reviews, 2024
- Enhanced Infrared Vision by Nonlinear Up‐Conversion in Nonlocal MetasurfacesAdvanced Materials, 2024
- Molecular engineering of AIE luminogens for NIR-II/IIb bioimaging and surgical navigation of lymph nodesMatter, 2022
- Transparent organic upconversion device targeting high- grade infrared visual imageNano Energy, 2021
- Mammalian Near-Infrared Image Vision through Injectable and Self-Powered Retinal NanoantennaeCell, 2019
- Near infrared spectroscopy: A mature analytical technique with new perspectives – A reviewAnalytica Chimica Acta, 2018
- Transparent Organic Upconversion Devices for Near‐Infrared SensingAdvanced Materials, 2014
- Hybrid Organic/Inorganic Optical Up‐Converter for Pixel‐Less Near‐Infrared ImagingAdvanced Materials, 2012
- Organic Infrared Upconversion DeviceAdvanced Materials, 2010