Programming nonlinear propagation for efficient optical learning machines
Authors:
Top Cited Papers
Open Access
- 1 January 2024
- journal article
- research article
- Published by SPIE-Intl Soc Optical Eng in Advanced Photonics
- Vol. 6 (01) , 016002-11
Abstract
Machine-learning architectures have come to be dominated by artificial neural networks (ANNs). There are several reasons why this architecture is used so broadly. Initially, their similarity with biological neural networks1 provided strong motivation to explore ANNs. At the same time, the fact that ANNs are universal machines2 that are able to approximate any function breeds confidence that ANNs can carry out useful and difficult tasks. Perhaps most significantly, the fact that error backpropagation3 has proven very effective in training such networks catapulted their application to a wide variety of problems. Ever-larger networks4 have been adopted for tackling challenging tasks.5 Empirically, it has been found that larger networks tend to perform better given a sufficiently large database of training examples. This has led to a “bigger is better” mentality.6 However, the disadvantage of this mentality is the energy required to train and use very large networks. For instance, only training the language model GPT-3, which has 175 billion parameters, consumed 1.3 GWh of electricity, which is the energy required to fully charge 13,000 Tesla Model S cars.7 Optics can help overcome this downside, since light propagation through a nonabsorbing, nonscattering medium is a lossless linear operation.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- Transfer learning techniques for medical image analysis: A reviewBiocybernetics and Biomedical Engineering, 2022
- Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray imagesComputers in Biology and Medicine, 2021
- Efficient On-Chip Training of Optical Neural Networks Using Genetic AlgorithmACS Photonics, 2021
- Evaluating and analyzing the energy efficiency of CNN inference on high‐performance GPUConcurrency and Computation: Practice and Experience, 2020
- Design of task-specific optical systems using broadband diffractive neural networksLight: Science & Applications, 2019
- Recent advances in physical reservoir computing: A reviewNeural Networks, 2019
- Deep learning with coherent nanophotonic circuitsNature Photonics, 2017
- Parallel photonic information processing at gigabyte per second data rates using transient statesNature Communications, 2013
- Self-Adaptive Evolutionary Extreme Learning MachineNeural Processing Letters, 2012
- Extreme learning machine: Theory and applicationsNeurocomputing, 2006