Optical coherent dot-product chip for sophisticated deep learning regression
Top Cited Papers
Open Access
- 1 November 2021
- journal article
- research article
- Published by Springer Nature in Light: Science & Applications
- Vol. 10 (1) , 1-12
Abstract
Optical implementations of neural networks (ONNs) herald the next-generation high-speed and energy-efficient deep learning computing by harnessing the technical advantages of large bandwidth and high parallelism of optics. However, due to the problems of the incomplete numerical domain, limited hardware scale, or inadequate numerical accuracy, the majority of existing ONNs were studied for basic classification tasks. Given that regression is a fundamental form of deep learning and accounts for a large part of current artificial intelligence applications, it is necessary to master deep learning regression for further development and deployment of ONNs. Here, we demonstrate a silicon-based optical coherent dot-product chip (OCDC) capable of completing deep learning regression tasks. The OCDC adopts optical fields to carry out operations in the complete real-value domain instead of in only the positive domain. Via reusing, a single chip conducts matrix multiplications and convolutions in neural networks of any complexity. Also, hardware deviations are compensated via in-situ backpropagation control provided the simplicity of chip architecture. Therefore, the OCDC meets the requirements for sophisticated regression tasks and we successfully demonstrate a representative neural network, the AUTOMAP (a cutting-edge neural network model for image reconstruction). The quality of reconstructed images by the OCDC and a 32-bit digital computer is comparable. To the best of our knowledge, there is no precedent of performing such state-of-the-art regression tasks on ONN chips. It is anticipated that the OCDC can promote the novel accomplishment of ONNs in modern AI applications including autonomous driving, natural language processing, and scientific study.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61822508)
This publication has 40 references indexed in Scilit:
- Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural NetworkIEEE Transactions on Medical Imaging, 2017
- The chips are down for Moore’s lawNature, 2016
- MGH–USC Human Connectome Project datasets with ultra-high b-value diffusion MRINeuroImage, 2016
- Single-chip microprocessor that communicates directly using lightNature, 2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Deep learningNature, 2015
- Broadband nanoelectromechanical phase shifting of light on a chipApplied Physics Letters, 2014
- Sparse MRI: The application of compressed sensing for rapid MR imagingMagnetic Resonance in Medicine, 2007
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- The Inverse Discrete Radon Transform with Applications to Tomographic Imaging Using Projection Data1981