论文标题
轴突延迟作为馈电的短期记忆深尖峰神经网络
Axonal Delay As a Short-Term Memory for Feed Forward Deep Spiking Neural Networks
论文作者
论文摘要
尖峰神经网络(SNN)的信息通过SPIKE在相邻的生物神经元之间传播,Spikes提供了一个计算范式,并有望模拟人脑。最近的研究发现,神经元的时间延迟在学习过程中起着重要作用。因此,配置尖峰的精确时机是理解和改善SNN中时间信息传输过程的有希望的方向。但是,大多数用于尖峰神经元的现有学习方法都集中在调整突触重量上,而很少有研究对轴突延迟进行了研究。在本文中,我们验证将时间延迟整合到监督学习中的有效性,并提出一个模块,该模块通过短期记忆来调节轴突延迟。为此,将整流的轴突延迟(RAD)模块与尖峰模型集成在一起,以对齐尖峰时序,从而提高时间特征的表征学习能力。在三个神经形态基准数据集上进行的实验:NMNIST,DVS手势和N-Tidigits18表明,所提出的方法在使用最少的参数时实现了最新性能。
The information of spiking neural networks (SNNs) are propagated between the adjacent biological neuron by spikes, which provides a computing paradigm with the promise of simulating the human brain. Recent studies have found that the time delay of neurons plays an important role in the learning process. Therefore, configuring the precise timing of the spike is a promising direction for understanding and improving the transmission process of temporal information in SNNs. However, most of the existing learning methods for spiking neurons are focusing on the adjustment of synaptic weight, while very few research has been working on axonal delay. In this paper, we verify the effectiveness of integrating time delay into supervised learning and propose a module that modulates the axonal delay through short-term memory. To this end, a rectified axonal delay (RAD) module is integrated with the spiking model to align the spike timing and thus improve the characterization learning ability of temporal features. Experiments on three neuromorphic benchmark datasets : NMNIST, DVS Gesture and N-TIDIGITS18 show that the proposed method achieves the state-of-the-art performance while using the fewest parameters.