Deep learning-enhanced light-field imaging with continuous validation
Top Cited Papers
- 7 May 2021
- journal article
- research article
- Published by Springer Nature in Nature Methods
- Vol. 18 (5) , 557-563
Abstract
Visualizing dynamic processes over large, three-dimensional fields of view at high speed is essential for many applications in the life sciences. Light-field microscopy (LFM) has emerged as a tool for fast volumetric image acquisition, but its effective throughput and widespread use in biology has been hampered by a computationally demanding and artifact-prone image reconstruction process. Here, we present a framework for artificial intelligence–enhanced microscopy, integrating a hybrid light-field light-sheet microscope and deep learning–based volume reconstruction. In our approach, concomitantly acquired, high-resolution two-dimensional light-sheet images continuously serve as training data and validation for the convolutional neural network reconstructing the raw LFM data during extended volumetric time-lapse imaging experiments. Our network delivers high-quality three-dimensional reconstructions at video-rate throughput, which can be further refined based on the high-resolution light-sheet images. We demonstrate the capabilities of our approach by imaging medaka heart dynamics and zebrafish neural activity with volumetric imaging rates up to 100 Hz.Keywords
All Related Versions
This publication has 38 references indexed in Scilit:
- Efficient Bayesian-based multiview deconvolutionNature Methods, 2014
- MosaicIA: an ImageJ/Fiji plugin for spatial pattern and interaction analysisBMC Bioinformatics, 2013
- Rapid 3D light-sheet microscopy with a tunable lensOptics Express, 2013
- Instantaneous three-dimensional sensing using spatial light modulator illumination with extended depth of field imagingOptics Express, 2013
- Fiji: an open-source platform for biological-image analysisNature Methods, 2012
- Fast two-photon in vivo imaging with three-dimensional random-access scanning in large tissue volumesNature Methods, 2012
- Three-dimensional random access multiphoton microscopy for functional imaging of neuronal activityNature Neuroscience, 2008
- Transgenesis in fish: efficient selection of transgenic fish by co-injection with a fluorescent reporter constructNature Protocols, 2006
- Light field microscopyACM Transactions on Graphics, 2006
- Optical Sectioning Deep Inside Live Embryos by Selective Plane Illumination MicroscopyScience, 2004