论文标题

硬件/软件与无ADC的内存计算硬件共同设计用于峰值神经网络

Hardware/Software co-design with ADC-Less In-memory Computing Hardware for Spiking Neural Networks

论文作者

Apolinario, Marco Paul E., Kosta, Adarsh Kumar, Saxena, Utkarsh, Roy, Kaushik

论文摘要

尖峰神经网络(SNN)是可行的模型,具有在资源约束的边缘设备上实现节能实现的能源有效实现的巨大潜力。但是,基于标准GPU的商业边缘平台并未优化用于部署SNN,从而产生了高能量和延迟。虽然模拟内存计算(IMC)平台可以用作节能推理引擎,但它们被高精度ADC(HP-ADC)的巨大能量,潜伏期和面积要求所征收,从而掩盖了内存计算的好处。我们提出了一种硬件/软件共同设计方法,将SNNS部署到无ADC IMC架构中,使用感官示出器作为1位ADC代替常规HP-ADC并减轻上述问题。我们提出的框架通过执行硬件感知训练会导致最小的准确性降低,并能够超越简单的图像分类任务,以使其更复杂的顺序回归任务。关于光流估计和手势识别的复杂任务的实验表明,在SNN训练期间逐渐提高硬件意识,使该模型由于与无ADC-IMC相关的非理想性而适应和学习错误。此外,与HP-ADC IMC相比,拟议的无IMC提供了显着的能源和潜伏期改进,分别为$ 2-7 \ times $ $和$ 8.9-24.6 \ times $ $。

Spiking Neural Networks (SNNs) are bio-plausible models that hold great potential for realizing energy-efficient implementations of sequential tasks on resource-constrained edge devices. However, commercial edge platforms based on standard GPUs are not optimized to deploy SNNs, resulting in high energy and latency. While analog In-Memory Computing (IMC) platforms can serve as energy-efficient inference engines, they are accursed by the immense energy, latency, and area requirements of high-precision ADCs (HP-ADC), overshadowing the benefits of in-memory computations. We propose a hardware/software co-design methodology to deploy SNNs into an ADC-Less IMC architecture using sense-amplifiers as 1-bit ADCs replacing conventional HP-ADCs and alleviating the above issues. Our proposed framework incurs minimal accuracy degradation by performing hardware-aware training and is able to scale beyond simple image classification tasks to more complex sequential regression tasks. Experiments on complex tasks of optical flow estimation and gesture recognition show that progressively increasing the hardware awareness during SNN training allows the model to adapt and learn the errors due to the non-idealities associated with ADC-Less IMC. Also, the proposed ADC-Less IMC offers significant energy and latency improvements, $2-7\times$ and $8.9-24.6\times$, respectively, depending on the SNN model and the workload, compared to HP-ADC IMC.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源