Symmetric silicon microring resonator optical crossbar array for accelerated inference and training in deep learning
Authors:
Rui Tang,
Shuhei Ohno,
Ken Tanizawa,
Kazuhiro Ikeda,
Makoto Okano,
Kasidit Toprasertpong,
Shinichi Takagi,
Mitsuru Takenaka
Abstract:
Photonic integrated circuits are emerging as a promising platform for accelerating matrix multiplications in deep learning, leveraging the inherent parallel nature of light. Although various schemes have been proposed and demonstrated to realize such photonic matrix accelerators, the in-situ training of artificial neural networks using photonic accelerators remains challenging due to the difficult…
▽ More
Photonic integrated circuits are emerging as a promising platform for accelerating matrix multiplications in deep learning, leveraging the inherent parallel nature of light. Although various schemes have been proposed and demonstrated to realize such photonic matrix accelerators, the in-situ training of artificial neural networks using photonic accelerators remains challenging due to the difficulty of direct on-chip backpropagation on a photonic chip. In this work, we propose a silicon microring resonator (MRR) optical crossbar array with a symmetric structure that allows for simple on-chip backpropagation, potentially enabling the acceleration of both the inference and training phases of deep learning. We demonstrate a $4 \times 4$ circuit on a Si-on-insulator (SOI) platform and use it to perform inference tasks of a simple neural network for classifying Iris flowers, achieving a classification accuracy of 93.3%. Subsequently, we train the neural network using simulated on-chip backpropagation and achieve an accuracy of 91.1% in the same inference task after training. Furthermore, we simulate a convolutional neural network (CNN) for handwritten digit recognition, using a $9 \times 9$ MRR crossbar array to perform the convolution operations. This work contributes to the realization of compact and energy-efficient photonic accelerators for deep learning.
△ Less
Submitted 1 June, 2024; v1 submitted 29 January, 2024;
originally announced January 2024.
Si microring resonator crossbar array for on-chip inference and training of optical neural network
Authors:
Shuhei Ohno,
Kasidit Toprasertpong,
Shinichi Takagi,
Mitsuru Takenaka
Abstract:
Deep learning is one of the most advancing technologies in various fields. Facing the limits of the current electronics platform, optical neural networks (ONNs) based on Si programmable photonic integrated circuits (PICs) have attracted considerable attention as a novel deep learning scheme with optical-domain matrix-vector multiplication (MVM). However, most of the proposed Si programmable PICs f…
▽ More
Deep learning is one of the most advancing technologies in various fields. Facing the limits of the current electronics platform, optical neural networks (ONNs) based on Si programmable photonic integrated circuits (PICs) have attracted considerable attention as a novel deep learning scheme with optical-domain matrix-vector multiplication (MVM). However, most of the proposed Si programmable PICs for ONNs have several drawbacks such as low scalability, high power consumption, and lack of frameworks for training. To address these issues, we have proposed a microring resonator (MRR) crossbar array as a Si programmable PIC for an ONN. In this article, we present a prototype of a fully integrated 4 ${\rm \times}$ 4 MRR crossbar array and demonstrated a simple MVM and classification task. Moreover, we propose on-chip backpropagation using the transpose matrix operation of the MRR crossbar array, enabling the on-chip training of the ONN. The proposed ONN scheme can establish a scalable, power-efficient deep learning accelerator for applications in both inference and training tasks.
△ Less
Submitted 28 June, 2021; v1 submitted 7 June, 2021;
originally announced June 2021.
