Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers
- 28 July 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Quantum Electronics
- Vol. 29 (2: Optical) , 1-17
Abstract
Imaging through diffusive media is a challenging problem, where the existing solutions heavily rely on digital computers to reconstruct distorted images. We provide a detailed analysis of a computer-free, all-optical imaging method for seeing through random, unknown phase diffusers using diffractive neural networks, covering different deep learning-based training strategies. By analyzing various diffractive networks designed to image through random diffusers with different correlation lengths, a trade-off between the image reconstruction fidelity and distortion reduction capability of the diffractive network was observed. During its training, random diffusers with a range of correlation lengths were used to improve the diffractive network's generalization performance. Increasing the number of random diffusers used in each epoch reduced the overfitting of the diffractive network's imaging performance to known diffusers. We also demonstrated that the use of additional diffractive layers improved the generalization capability to see through new, random diffusers. Finally, we introduced deliberate misalignments in training to “vaccinate” the network against random layer-to-layer shifts that might arise due to the imperfect assembly of the diffractive networks. These analyses provide a comprehensive guide in designing diffractive networks to see through random diffusers, which might profoundly impact many fields, such as biomedical imaging, atmospheric physics, and autonomous driving.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Conjugate adaptive optics in widefield microscopy with an extended-source wavefront sensorOptica, 2015
- Transmission matrix of a scattering medium and its applications in biophotonicsOptics Express, 2015
- Relation between speckle decorrelation and optical phase conjugation (OPC)-based turbidity suppression through dynamic scattering media: a study on in vivo mouse skinBiomedical Optics Express, 2014
- High-speed scattering medium characterization with application to focusing light through turbid mediaOptics Express, 2012
- Image transmission through an opaque materialNature Communications, 2010
- Going deeper than microscopy: the optical imaging frontier in biologyNature Methods, 2010
- Measuring the Transmission Matrix in Optics: An Approach to the Study and Control of Light Propagation in Disordered MediaPhysical Review Letters, 2010
- Contrast restoration of weather degraded imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Memory Effects in Propagation of Optical Waves through Disordered MediaPhysical Review Letters, 1988
- Speckle Removal by a Slowly Moving Diffuser Associated with a Motionless DiffuserJournal of the Optical Society of America, 1971