James Spall
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
James Spall has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
Alexander Lvovsky
University of Oxford
2 shared publications- Thomas Daniel Barrett
InstaDeep
1 shared publication Xianxin Guo
1 shared publication- Xianxin Guo
Department of Physics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 14 July 2022
- Published by Optica Publishing Group in Optica
- Vol. 9 (7) , 803-811
Hybrid training of optical neural networks
Optical neural networks are emerging as a promising type of machine learning hardware capable of energy-efficient, parallel computation. Today’s optical neural networks are mainly developed to perform optical inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modeled may lead to the notorious “reality gap” between the digital simulator and the physical system. To address this challenge, we demonstrate hybrid training of optical neural networks where the weight matrix is trained with neuron activation functions computed optically via forward propagation through the network. We examine the efficacy of hybrid training with three different networks: an optical linear classifier, a hybrid opto-electronic network, and a complex-valued optical network. We perform a study comparative to in silico training, and our results show that hybrid training is robust against different kinds of static noise. Our platform-agnostic hybrid training scheme can be applied to a wide variety of optical neural networks, and this work paves the way towards advanced all-optical training in machine intelligence.
- 14 July 2022
- Published by Optica Publishing Group in Optica
- Vol. 9 (7) , 803-811
Top Cited PapersOpen AccessHybrid training of optical neural networks
Optical neural networks are emerging as a promising type of machine learning hardware capable of energy-efficient, parallel computation. Today’s optical neural networks are mainly developed to perform optical inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modeled may lead to the notorious “reality gap” between the digital simulator and the physical system. To address this challenge, we demonstrate hybrid training of optical neural networks where the weight matrix is trained with neuron activation functions computed optically via forward propagation through the network. We examine the efficacy of hybrid training with three different networks: an optical linear classifier, a hybrid opto-electronic network, and a complex-valued optical network. We perform a study comparative to in silico training, and our results show that hybrid training is robust against different kinds of static noise. Our platform-agnostic hybrid training scheme can be applied to a wide variety of optical neural networks, and this work paves the way towards advanced all-optical training in machine intelligence.
- 12 October 2020
- Published by Optica Publishing Group in Optics Letters
- Vol. 45 (20) , 5752-5755
Fully reconfigurable coherent optical vector–matrix multiplication
Optics is a promising platform in which to help realize the next generation of fast, parallel, and energy-efficient computation. We demonstrate a reconfigurable free-space optical multiplier that is capable of over 3000 computations in parallel, using spatial light modulators with a pixel resolution of only 340 × 340 . This enables vector–matrix multiplication and parallel vector–vector multiplication with vector size of up to 56. Our design is, to the best of our knowledge, the first to simultaneously support optical implementation of reconfigurable, large-sized, and real-valued linear algebraic operations. Such an optical multiplier can serve as a building block of special-purpose optical processors such as optical neural networks and optical Ising machines.
- 12 October 2020
- Published by Optica Publishing Group in Optics Letters
- Vol. 45 (20) , 5752-5755
Fully reconfigurable coherent optical vector–matrix multiplication
Optics is a promising platform in which to help realize the next generation of fast, parallel, and energy-efficient computation. We demonstrate a reconfigurable free-space optical multiplier that is capable of over 3000 computations in parallel, using spatial light modulators with a pixel resolution of only 340 × 340 . This enables vector–matrix multiplication and parallel vector–vector multiplication with vector size of up to 56. Our design is, to the best of our knowledge, the first to simultaneously support optical implementation of reconfigurable, large-sized, and real-valued linear algebraic operations. Such an optical multiplier can serve as a building block of special-purpose optical processors such as optical neural networks and optical Ising machines.