Programming nonlinear propagation for efficient optical learning machines

Authors:

Top Cited Papers
Open Access
Abstract
Machine-learning architectures have come to be dominated by artificial neural networks (ANNs). There are several reasons why this architecture is used so broadly. Initially, their similarity with biological neural networks1 provided strong motivation to explore ANNs. At the same time, the fact that ANNs are universal machines2 that are able to approximate any function breeds confidence that ANNs can carry out useful and difficult tasks. Perhaps most significantly, the fact that error backpropagation3 has proven very effective in training such networks catapulted their application to a wide variety of problems. Ever-larger networks4 have been adopted for tackling challenging tasks.5 Empirically, it has been found that larger networks tend to perform better given a sufficiently large database of training examples. This has led to a “bigger is better” mentality.6 However, the disadvantage of this mentality is the energy required to train and use very large networks. For instance, only training the language model GPT-3, which has 175 billion parameters, consumed 1.3 GWh of electricity, which is the energy required to fully charge 13,000 Tesla Model S cars.7 Optics can help overcome this downside, since light propagation through a nonabsorbing, nonscattering medium is a lossless linear operation.

This publication has 45 references indexed in Scilit: