论文标题
为重要性和渠道意识的蜂窝联合边缘学习安排
Scheduling for Cellular Federated Edge Learning with Importance and Channel Awareness
论文作者
论文摘要
在蜂窝联合边缘学习(FEEL)中,持有本地数据的多个边缘设备通过与访问点进行通信无需交换数据样本,共同训练神经网络。凭借非常有限的沟通资源,安排最有用的本地学习更新是有益的。在本文中,提出了一项新颖的调度策略,以利用多元渠道的多样性和Edge设备学习更新的“重要性”的多样性。首先,开发了一个新的概率调度框架,以产生无偏更新的感觉。本地学习更新的重要性是通过其梯度差异来衡量的。如果每个通信中都安排了一个边缘设备,则计划策略以封闭形式得出,以实现频道质量和更新重要性之间的最佳权衡。然后将概率调度框架扩展,以允许在每个通信回合中调度多个边缘设备。使用流行模型和学习数据集获得的数值结果表明,与仅利用单一类型的多样性类型的传统调度策略相比,提出的调度策略可以实现更快的模型收敛性和更高的学习准确性。
In cellular federated edge learning (FEEL), multiple edge devices holding local data jointly train a neural network by communicating learning updates with an access point without exchanging their data samples. With very limited communication resources, it is beneficial to schedule the most informative local learning updates. In this paper, a novel scheduling policy is proposed to exploit both diversity in multiuser channels and diversity in the "importance" of the edge devices' learning updates. First, a new probabilistic scheduling framework is developed to yield unbiased update aggregation in FEEL. The importance of a local learning update is measured by its gradient divergence. If one edge device is scheduled in each communication round, the scheduling policy is derived in closed form to achieve the optimal trade-off between channel quality and update importance. The probabilistic scheduling framework is then extended to allow scheduling multiple edge devices in each communication round. Numerical results obtained using popular models and learning datasets demonstrate that the proposed scheduling policy can achieve faster model convergence and higher learning accuracy than conventional scheduling policies that only exploit a single type of diversity.