论文标题

尖峰神经网络的大小和弹性的多目标优化

Multi-Objective Optimization for Size and Resilience of Spiking Neural Networks

论文作者

Dimovska, Mihaela, Johnston, Travis, Schuman, Catherine D., Mitchell, J. Parker, Potok, Thomas E.

论文摘要

受到大脑中连通性机制的启发,神经形态计算体系结构模型在硅中尖峰神经网络(SNN)。因此,设计和开发神经形态体系结构的目标是拥有可以执行控制和机器学习任务的小型低功率芯片。但是,开发的硬件的功耗很大程度上取决于芯片上评估的网络的大小。此外,在芯片上评估的训练有素的SNN的准确性可能会由于硬件的电压和当前变化而改变,从而扰乱了网络的学习权重。尽管在硬件方面做出了努力,以最大程度地减少这些扰动,但使部署网络更具弹性的基于软件的策略可以帮助进一步缓解该问题。在这项工作中,我们研究了两个神经形态体系结构实现中的尖峰神经网络,目的是降低其尺寸,同时提高其对硬件故障的弹性。我们利用一种进化算法来训练SNN,并提出多主体适应性功能来优化SNN的大小和弹性。我们证明,这种策略会导致表现出色的小型网络,这些网络对硬件故障更具弹性。

Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low power chips that can perform control and machine learning tasks. However, the power consumption of the developed hardware can greatly depend on the size of the network that is being evaluated on the chip. Furthermore, the accuracy of a trained SNN that is evaluated on chip can change due to voltage and current variations in the hardware that perturb the learned weights of the network. While efforts are made on the hardware side to minimize those perturbations, a software based strategy to make the deployed networks more resilient can help further alleviate that issue. In this work, we study Spiking Neural Networks in two neuromorphic architecture implementations with the goal of decreasing their size, while at the same time increasing their resiliency to hardware faults. We leverage an evolutionary algorithm to train the SNNs and propose a multiobjective fitness function to optimize the size and resiliency of the SNN. We demonstrate that this strategy leads to well-performing, small-sized networks that are more resilient to hardware faults.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源