论文标题

重新考虑域适应的最大平均差异

Rethink Maximum Mean Discrepancy for Domain Adaptation

论文作者

Wang, Wei, Li, Haojie, Ding, Zhengming, Wang, Zhihui

论文摘要

现有的域适应方法旨在通过建立最大平均差异(MMD)和判别距离来减少源和目标域之间的分布差异,并尊重其特定的歧视性信息。但是,他们通常会积累来考虑这些统计数据,并通过盲目估算参数来处理其关系。从理论上讲,本文证明了两个基本事实:1)将MMD等于源以分别最大化和目标阶层距离的最大化,但可以共同将其差异最小化,以使其具有某些隐式权重,以使特征可区分性降解; 2)阶层内和阶层间距离之间的关系是一个跌倒,另一个跌落。基于此,我们提出了一种新颖的歧视性MMD。一方面,我们仅考虑级别和阶层间距离以去除冗余参数,而揭示的重量则提供了大约最佳的范围。另一方面,我们设计了两种不同的策略来提高特征可区分性:1)我们直接将权衡参数强加于MMD中隐式内距离距离以调节其变化; 2)我们强加了MMD中揭示的类似权重,并最大程度地提出了平衡因子,以定量地利用特征可传递性和其可区分性之间的相对重要性。几个基准数据集上的实验不仅证明了理论结果的有效性,而且还证明我们的方法可以基本上比对比较最先进的方法更好。

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the discriminative distances. However, they usually accumulate to consider those statistics and deal with their relationships by estimating parameters blindly. This paper theoretically proves two essential facts: 1) minimizing the MMD equals to maximize the source and target intra-class distances respectively but jointly minimize their variance with some implicit weights, so that the feature discriminability degrades; 2) the relationship between the intra-class and inter-class distances is as one falls, another rises. Based on this, we propose a novel discriminative MMD. On one hand, we consider the intra-class and inter-class distances alone to remove a redundant parameter, and the revealed weights provide their approximate optimal ranges. On the other hand, we design two different strategies to boost the feature discriminability: 1) we directly impose a trade-off parameter on the implicit intra-class distance in MMD to regulate its change; 2) we impose the similar weights revealed in MMD on inter-class distance and maximize it, then a balanced factor could be introduced to quantitatively leverage the relative importance between the feature transferability and its discriminability. The experiments on several benchmark datasets not only prove the validity of theoretical results but also demonstrate that our approach could perform better than the comparative state-of-art methods substantially.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源