论文标题
基于属性的人搜索的共生对抗性学习
Symbiotic Adversarial Learning for Attribute-based Person Search
论文作者
论文摘要
基于属性的人搜索对没有可用的查询图像的应用有很大的需求,例如从证人中识别罪犯。但是,任务本身非常具有挑战性,因为图像和属性的物理描述之间存在巨大的方式差距。通常,也可能有很多看不见的类别(属性组合)。当前的最新方法要么通过仅挖掘看到的数据来学习更好的跨模式嵌入,要么明确使用生成的对抗网络(GAN)来综合看不见的特征。由于数据不足,前者倾向于产生较差的嵌入,而后者在发电过程中不能保留类内的紧凑性。在本文中,我们提出了一个共生的对抗性学习框架,称为sal。两个甘斯在框架的基础上以共生学习方案为基础:一个综合了看不见的类别/类别的特征相互利益彼此。广泛的评估表明,萨尔(Sal)优于九种最先进的方法,具有两个具有挑战性的行人基准PETA和Market-1501。该代码可公开可用:https://github.com/ycao5602/sal。
Attribute-based person search is in significant demand for applications where no detected query images are available, such as identifying a criminal from witness. However, the task itself is quite challenging because there is a huge modality gap between images and physical descriptions of attributes. Often, there may also be a large number of unseen categories (attribute combinations). The current state-of-the-art methods either focus on learning better cross-modal embeddings by mining only seen data, or they explicitly use generative adversarial networks (GANs) to synthesize unseen features. The former tends to produce poor embeddings due to insufficient data, while the latter does not preserve intra-class compactness during generation. In this paper, we present a symbiotic adversarial learning framework, called SAL.Two GANs sit at the base of the framework in a symbiotic learning scheme: one synthesizes features of unseen classes/categories, while the other optimizes the embedding and performs the cross-modal alignment on the common embedding space .Specifically, two different types of generative adversarial networks learn collaboratively throughout the training process and the interactions between the two mutually benefit each other. Extensive evaluations show SAL's superiority over nine state-of-the-art methods with two challenging pedestrian benchmarks, PETA and Market-1501. The code is publicly available at: https://github.com/ycao5602/SAL .