Self-supervised deep-learning two-photon microscopy

Authors:

Abstract
Artificial neural networks have shown great proficiency in transforming low-resolution microscopic images into high-resolution images. However, training data remains a challenge, as large-scale open-source databases of microscopic images are rare, particularly 3D data. Moreover, the long training times and the need for expensive computational resources have become a burden to the research community. We introduced a deep-learning-based self-supervised volumetric imaging approach, which we termed “Self-Vision.” The self-supervised approach requires no training data, apart from the input image itself. The lightweight network takes just minutes to train and has demonstrated resolution-enhancing power on par with or better than that of a number of recent microscopy-based models. Moreover, the high throughput power of the network enables large image inference with less postprocessing, facilitating a large field-of-view ( 2.45    mm × 2.45    mm ) using a home-built two-photon microscopy system. Self-Vision can recover images from fourfold undersampled inputs in the lateral and axial dimensions, dramatically reducing the acquisition time. Self-Vision facilitates the use of a deep neural network for 3D microscopy imaging, easing the demanding process of image acquisition and network training for current resolution-enhancing networks.
Funding Information
  • National Natural Science Foundation of China (62105353, 81927803, 82071972, 91959121, 92159104)
  • Natural Science Foundation of Guangdong Province (2019A1515011746, 2020B121201010, 2021A1515012022)
  • Scientific Instrument Innovation Team of Chinese Academy of Sciences (GJJSTD20180002)
  • Shenzhen Basic Research Program (RCJC20200714114433058, RCYX20210609104445093, ZDSY20130401165820357)

This publication has 26 references indexed in Scilit: