论文标题
多任务学习的任务项目超法计算
Task-Projected Hyperdimensional Computing for Multi-Task Learning
论文作者
论文摘要
受脑启发的高维(HD)计算是低功率设计领域认知任务的新兴技术。作为一种快速学习和节能的计算范式,高清计算在许多现实世界中都取得了巨大的成功。但是,对多个任务进行训练的高清模型遭受了灾难性遗忘的负面影响。该模型忘记了从以前的任务中学到的知识,而仅关注当前的知识。据我们所知,尚未进行研究来研究将多任务学习应用于HD计算的可行性。在本文中,我们提出了任务项目的超尺寸计算(TP-HDC),以通过利用超空间中的冗余维度来同时支持多个任务。为了减轻不同任务之间的干扰,我们将每个任务投影到一个单独的学习子空间中。与基线方法相比,我们的方法有效地利用了超空间中未使用的能力,并显示出可忽略不计的存储空间的平均准确性提高了12.8%。
Brain-inspired Hyperdimensional (HD) computing is an emerging technique for cognitive tasks in the field of low-power design. As a fast-learning and energy-efficient computational paradigm, HD computing has shown great success in many real-world applications. However, an HD model incrementally trained on multiple tasks suffers from the negative impacts of catastrophic forgetting. The model forgets the knowledge learned from previous tasks and only focuses on the current one. To the best of our knowledge, no study has been conducted to investigate the feasibility of applying multi-task learning to HD computing. In this paper, we propose Task-Projected Hyperdimensional Computing (TP-HDC) to make the HD model simultaneously support multiple tasks by exploiting the redundant dimensionality in the hyperspace. To mitigate the interferences between different tasks, we project each task into a separate subspace for learning. Compared with the baseline method, our approach efficiently utilizes the unused capacity in the hyperspace and shows a 12.8% improvement in averaged accuracy with negligible memory overhead.