Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy
Authors:
Open Access
- 9 July 2023
- journal article
- research article
- Published by Wiley in Advanced Science
- Vol. 10 (27) , e2300947
Abstract
Fast and precise reconstruction algorithm is desired for for multifocal structured illumination microscopy (MSIM) to obtain the super‐resolution image. This work proposes a deep convolutional neural network (CNN) to learn a direct mapping from raw MSIM images to super‐resolution image, which takes advantage of the computational advances of deep learning to accelerate the reconstruction. The method is validated on diverse biological structures and in vivo imaging of zebrafish at a depth of 100 µm. The results show that high‐quality, super‐resolution images can be reconstructed in one‐third of the runtime consumed by conventional MSIM method, without compromising spatial resolution. Last but not least, a fourfold reduction in the number of raw images required for reconstruction is achieved by using the same network architecture, yet with different training data.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFF0502900, 2022YFF0712500)
- National Natural Science Foundation of China (61835009, 62127819, 62275165)
This publication has 41 references indexed in Scilit:
- A joint Richardson—Lucy deconvolution algorithm for the reconstruction of multifocal structured illumination microscopy dataMethods and Applications in Fluorescence, 2015
- Two-photon excitation improves multifocal structured illumination microscopy in thick scattering tissueProceedings of the National Academy of Sciences, 2014
- Instant super-resolution imaging in live cells and embryos via analog image processingNature Methods, 2013
- Fiji: an open-source platform for biological-image analysisNature Methods, 2012
- Resolution doubling in live, multicellular organisms via multifocal structured illumination microscopyNature Methods, 2012
- Structured illumination microscopy using unknown speckle patternsNature Photonics, 2012
- Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM)Nature Methods, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Surpassing the lateral resolution limit by a factor of two using structured illumination microscopyJournal of Microscopy, 2000
- Breaking the diffraction resolution limit by stimulated emission: stimulated-emission-depletion fluorescence microscopyOptics Letters, 1994