论文标题

光学神经网络的混合培训

Hybrid training of optical neural networks

论文作者

Spall, James, Guo, Xianxin, Lvovsky, A. I.

论文摘要

光学神经网络正在成为一种有前途的机器学习硬件,能够进行节能,并行计算。当今的光学神经网络主要是为了在数字模拟器的硅培训中进行光学推断而开发的。但是,无法准确建模的各种物理缺陷可能会导致数字模拟器和物理系统之间臭名昭著的现实差距。为了应对这一挑战,我们演示了对光学神经网络的混合训练,其中重量矩阵通过通过网络通过正向传播计算的神经元激活功能训练。我们检查了三个不同网络的混合训练的功效:光学线性分类器,混合光电网络和复杂值的光学网络的功效。我们在硅训练中进行了比较研究,我们的结果表明,混合训练对不同种类的静态噪声是可靠的。我们的平台不足的混合动力培训方案可以应用于各种光学神经网络,这项工作为机器智能中的高级全光训练铺平了道路。

Optical neural networks are emerging as a promising type of machine learning hardware capable of energy-efficient, parallel computation. Today's optical neural networks are mainly developed to perform optical inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modelled may lead to the notorious reality gap between the digital simulator and the physical system. To address this challenge, we demonstrate hybrid training of optical neural networks where the weight matrix is trained with neuron activation functions computed optically via forward propagation through the network. We examine the efficacy of hybrid training with three different networks: an optical linear classifier, a hybrid opto-electronic network, and a complex-valued optical network. We perform a comparative study to in silico training, and our results show that hybrid training is robust against different kinds of static noise. Our platform-agnostic hybrid training scheme can be applied to a wide variety of optical neural networks, and this work paves the way towards advanced all-optical training in machine intelligence.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源