Real-time and universal network for volumetric imaging from microscale to macroscale at high resolution
Open Access
- 29 April 2025
- journal article
- research article
- Published by Springer Nature in Light: Science & Applications
- Vol. 14 (1) , 1-19
Abstract
Light-field imaging has wide applications in various domains, including microscale life science imaging, mesoscale neuroimaging, and macroscale fluid dynamics imaging. The development of deep learning-based reconstruction methods has greatly facilitated high-resolution light-field image processing, however, current deep learning-based light-field reconstruction methods have predominantly concentrated on the microscale. Considering the multiscale imaging capacity of light-field technique, a network that can work over variant scales of light-field image reconstruction will significantly benefit the development of volumetric imaging. Unfortunately, to our knowledge, no one has reported a universal high-resolution light-field image reconstruction algorithm that is compatible with microscale, mesoscale, and macroscale. To fill this gap, we present a real-time and universal network (RTU-Net) to reconstruct high-resolution light-field images at any scale. RTU-Net, as the first network that works over multiscale light-field image reconstruction, employs an adaptive loss function based on generative adversarial theory and consequently exhibits strong generalization capability. We comprehensively assessed the performance of RTU-Net through the reconstruction of multiscale light-field images, including microscale tubulin and mitochondrion dataset, mesoscale synthetic mouse neuro dataset, and macroscale light-field particle imaging velocimetry dataset. The results indicated that RTU-Net has achieved real-time and high-resolution light-field image reconstruction for volume sizes ranging from 300 μm × 300 μm × 12 μm to 25 mm × 25 mm × 25 mm, and demonstrated higher resolution when compared with recently reported light-field reconstruction networks. The high-resolution, strong robustness, high efficiency, and especially the general applicability of RTU-Net will significantly deepen our insight into high-resolution and volumetric imaging.Keywords
This publication has 35 references indexed in Scilit:
- High-resolution light-field particle imaging velocimetry with color-and-depth encoded illuminationOptics and Lasers in Engineering, 2023
- Single camera based dual-view light-field particle imaging velocimetry with isotropic resolutionOptics and Lasers in Engineering, 2023
- Improved CNN Based on Batch Normalization and Adam Optimizer2022
- Neural anatomy and optical microscopy (NAOMi) simulation for evaluating calcium imaging methodsJournal of Neuroscience Methods, 2021
- Iterative tomography with digital adaptive optics permits hour-long intravital observation of 3D subcellular dynamics at millisecond scaleCell, 2021
- Volumetric calibration enhancements for single-camera light-field PIVExperiments in Fluids, 2019
- Simultaneous all-optical manipulation and recording of neural circuit activity with cellular resolution in vivoNature Methods, 2014
- Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopyNature Methods, 2014
- Theory of cross-correlation analysis of PIV imagesFlow, Turbulence and Combustion, 1992
- Determining optical flowArtificial Intelligence, 1981