High-throughput, high-resolution deep learning microscopy based on registration-free generative adversarial network
Authors:
Top Cited Papers
Open Access
- 4 February 2019
- journal article
- research article
- Published by Optica Publishing Group in Biomedical Optics Express
- Vol. 10 (3) , 1044-1063
Abstract
We combine a generative adversarial network (GAN) with light microscopy to achieve deep learning super-resolution under a large field of view (FOV). By appropriately adopting prior microscopy data in an adversarial training, the neural network can recover a high-resolution, accurate image of new specimen from its single low-resolution measurement. Its capacity has been broadly demonstrated via imaging various types of samples, such as USAF resolution target, human pathological slides, fluorescence-labelled fibroblast cells, and deep tissues in transgenic mouse brain, by both wide-field and light-sheet microscopes. The gigapixel, multi-color reconstruction of these samples verifies a successful GAN-based single image super-resolution procedure. We also propose an image degrading model to generate low resolution images for training, making our approach free from the complex image registration during training data set preparation. After a well-trained network has been created, this deep learning-based imaging approach is capable of recovering a large FOV (~95 mm2) enhanced resolution of ~1.7 μm at high speed (within 1 second), while not necessarily introducing any changes to the setup of existing microscopes.Keywords
Funding Information
- 1000 Youth Talents Plan of China
- National Key R&D Program of China (2017YFA0700500)
- National Natural Science Foundation of China (21874052)
- Research Program of Shenzhen (JCYJ20160429182424047)
This publication has 31 references indexed in Scilit:
- Wide-field, high-resolution Fourier ptychographic microscopyNature Photonics, 2013
- Increased space-bandwidth product in pixel super-resolved lensfree on-chip microscopyScientific Reports, 2013
- The ePetri dish, an on-chip cell imaging platform based on subpixel perspective sweeping microscopy (SPSM)Proceedings of the National Academy of Sciences, 2011
- Sub-pixel resolving optofluidic microscope for on-chip cell imagingLab on a Chip, 2010
- Reconstruction of Zebrafish Early Embryonic Development by Scanned Light Sheet MicroscopyScience, 2008
- Ultramicroscopy: 3D reconstruction of large microscopical specimensJournal of Biophotonics, 2008
- A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolutionEURASIP Journal on Advances in Signal Processing, 2006
- Nonlinear structured-illumination microscopy: Wide-field fluorescence imaging with theoretically unlimited resolutionProceedings of the National Academy of Sciences, 2005
- Surpassing the lateral resolution limit by a factor of two using structured illumination microscopyJournal of Microscopy, 2000
- Space–bandwidth product of optical signals and systemsJournal of the Optical Society of America A, 1996