Self-supervised deep-learning two-photon microscopy
Authors:
- 14 December 2022
- journal article
- research article
- Published by Optica Publishing Group in Photonics Research
- Vol. 11 (1) , 1-11
Abstract
Artificial neural networks have shown great proficiency in transforming low-resolution microscopic images into high-resolution images. However, training data remains a challenge, as large-scale open-source databases of microscopic images are rare, particularly 3D data. Moreover, the long training times and the need for expensive computational resources have become a burden to the research community. We introduced a deep-learning-based self-supervised volumetric imaging approach, which we termed “Self-Vision.” The self-supervised approach requires no training data, apart from the input image itself. The lightweight network takes just minutes to train and has demonstrated resolution-enhancing power on par with or better than that of a number of recent microscopy-based models. Moreover, the high throughput power of the network enables large image inference with less postprocessing, facilitating a large field-of-view ( 2.45 mm × 2.45 mm ) using a home-built two-photon microscopy system. Self-Vision can recover images from fourfold undersampled inputs in the lateral and axial dimensions, dramatically reducing the acquisition time. Self-Vision facilitates the use of a deep neural network for 3D microscopy imaging, easing the demanding process of image acquisition and network training for current resolution-enhancing networks.Keywords
Funding Information
- National Natural Science Foundation of China (62105353, 81927803, 82071972, 91959121, 92159104)
- Natural Science Foundation of Guangdong Province (2019A1515011746, 2020B121201010, 2021A1515012022)
- Scientific Instrument Innovation Team of Chinese Academy of Sciences (GJJSTD20180002)
- Shenzhen Basic Research Program (RCJC20200714114433058, RCYX20210609104445093, ZDSY20130401165820357)
This publication has 26 references indexed in Scilit:
- Three-dimensional virtual refocusing of fluorescence microscopy images using deep learningNature Methods, 2019
- Kilohertz two-photon brain imaging in awake miceNature Methods, 2019
- Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing – a deep learning approachLight: Science & Applications, 2019
- Virtual histological staining of unlabelled tissue-autofluorescence images via deep learningNature Biomedical Engineering, 2019
- Deep learning enables cross-modality super-resolution in fluorescence microscopyNature Methods, 2018
- Content-aware image restoration: pushing the limits of fluorescence microscopyNature Methods, 2018
- Deep learning massively accelerates super-resolution localization microscopyNature Biotechnology, 2018
- Deep learning microscopyOptica, 2017
- Deep learningNature, 2015
- Two-Photon Laser Scanning Fluorescence MicroscopyScience, 1990