论文标题
跨领域的自学学习
Self-Supervised Learning Across Domains
论文作者
论文摘要
人类的适应能力至关重要地依赖于从监督和无监督任务中学习和合并知识:父母指出了很少的重要概念,但随后孩子们自己填补了空白。这是特别有效的,因为监督的学习永远不会详尽,因此自主学习可以发现有助于概括的不可能和规律性。在本文中,我们建议将类似的方法应用于跨领域的对象识别问题:我们的模型以监督的方式学习语义标签,并通过从相同图像上的自我监督信号中学习来扩大对数据的理解。这项次要任务有助于网络专注于对象形状,学习诸如空间方向和部分相关的学习概念,同时充当多个视觉域上的分类任务的正规化程序。广泛的实验证实了我们的直觉,并表明我们的多任务方法结合了受监管和自我监督的知识,显示了有关更复杂的领域概括和适应解决方案的竞争结果。它还证明了其在新颖而富有挑战性的预测和部分领域适应情景中的潜力。
Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly effective, because supervised learning can never be exhaustive and thus learning autonomously allows to discover invariances and regularities that help to generalize. In this paper we propose to apply a similar approach to the problem of object recognition across domains: our model learns the semantic labels in a supervised fashion, and broadens its understanding of the data by learning from self-supervised signals on the same images. This secondary task helps the network to focus on object shapes, learning concepts like spatial orientation and part correlation, while acting as a regularizer for the classification task over multiple visual domains. Extensive experiments confirm our intuition and show that our multi-task method combining supervised and self-supervised knowledge shows competitive results with respect to more complex domain generalization and adaptation solutions. It also proves its potential in the novel and challenging predictive and partial domain adaptation scenarios.