Hybrid training of optical neural networks
Preprint
Abstract
Optical neural networks are emerging as a promising type of machine learning hardware capable of energy-efficient, parallel computation. Today's optical neural networks are mainly developed to perform optical inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modelled may lead to the notorious reality gap between the digital simulator and the physical system. To address this challenge, we demonstrate hybrid training of optical neural networks where the weight matrix is trained with neuron activation functions computed optically via forward propagation through the network. We examine the efficacy of hybrid training with three different networks: an optical linear classifier, a hybrid opto-electronic network, and a complex-valued optical network. We perform a comparative study to in silico training, and our results show that hybrid training is robust against different kinds of static noise. Our platform-agnostic hybrid training scheme can be applied to a wide variety of optical neural networks, and this work paves the way towards advanced all-optical training in machine intelligence.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- An optical neural network using less than 1 photon per multiplicationNature Communications, 2022
- Competitive photonic neural networksNature Photonics, 2021
- Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unitNature Photonics, 2021
- Photonics for artificial intelligence and neuromorphic computingNature Photonics, 2021
- An optical neural chip for implementing complex-valued neural networkNature Communications, 2021
- 11 TOPS photonic convolutional accelerator for optical neural networksNature, 2021
- Parallel convolutional processing using an integrated photonic tensor coreNature, 2021
- Ultrafast machine vision with 2D material neural network image sensorsNature, 2020
- Efficient and self-adaptive in-situ learning in multilayer memristor neural networksNature Communications, 2018
- Deep learning with coherent nanophotonic circuitsNature Photonics, 2017