论文标题

通过层的自适应更新,以进行几个图像分类

Layer-Wise Adaptive Updating for Few-Shot Image Classification

论文作者

Qin, Yunxiao, Zhang, Weiguo, Wang, Zezheng, Zhao, Chenxu, Shi, Jingping

论文摘要

很少有图像分类(FSIC)需要一个模型来通过从这些类别的少数图像中学习来识别新类别的模型,引起了很多关注。最近,基于元学习的方法已显示为FSIC的有希望的方向。通常,他们训练一个元学习者(元学习模型)来学习简单的微调重量,以及在解决FSIC任务时,元学习者通过在几个任务的少数图像上更新自身来有效地将自己微调为特定于任务的模型。在本文中,我们提出了一种基于元学习的新型基于层的自适应更新(LWAU)的FSIC方法。 LWAU的灵感来自一个有趣的发现,该发现与常见的深层模型相比,Meta-Learner在从几个图像中学习时更加关注其顶层。根据这一发现,我们假设元学习者可能非常喜欢更新其顶层,以更新其底层以获得更好的FSIC性能。因此,在LWAU中,Meta-Learner受过训练,不仅可以学习简单的微调模型,还可以学习其最喜欢的层次自适应更新规则,以提高其学习效率。广泛的实验表明,借助层的自适应更新规则,提出的LWAU:1)优于现有的少量射击分类方法,这些方法明确。 2)在求解FSIC时,从少数图像中学习的效率比现有的元学习者至少5倍。

Few-shot image classification (FSIC), which requires a model to recognize new categories via learning from few images of these categories, has attracted lots of attention. Recently, meta-learning based methods have been shown as a promising direction for FSIC. Commonly, they train a meta-learner (meta-learning model) to learn easy fine-tuning weight, and when solving an FSIC task, the meta-learner efficiently fine-tunes itself to a task-specific model by updating itself on few images of the task. In this paper, we propose a novel meta-learning based layer-wise adaptive updating (LWAU) method for FSIC. LWAU is inspired by an interesting finding that compared with common deep models, the meta-learner pays much more attention to update its top layer when learning from few images. According to this finding, we assume that the meta-learner may greatly prefer updating its top layer to updating its bottom layers for better FSIC performance. Therefore, in LWAU, the meta-learner is trained to learn not only the easy fine-tuning model but also its favorite layer-wise adaptive updating rule to improve its learning efficiency. Extensive experiments show that with the layer-wise adaptive updating rule, the proposed LWAU: 1) outperforms existing few-shot classification methods with a clear margin; 2) learns from few images more efficiently by at least 5 times than existing meta-learners when solving FSIC.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源