论文标题

重新识别人的深度学习:调查和前景

Deep Learning for Person Re-identification: A Survey and Outlook

论文作者

Ye, Mang, Shen, Jianbing, Lin, Gaojie, Xiang, Tao, Shao, Ling, Hoi, Steven C. H.

论文摘要

人重新识别(RE-ID)的目的是在多个非重叠摄像机中检索一个感兴趣的人。随着深度神经网络的发展以及对智能视频监视的需求不断增长,它对计算机视觉社区的兴趣大大增加了。通过在开发人员重新ID系统中剖析所涉及的组件,我们将其分类为封闭世界和开放世界的设置。经过广泛研究的封闭世界设置通常在各种面向研究的假设下应用,并在许多数据集中使用深度学习技术取得了鼓舞人心的成功。我们首先从三种不同的角度对封闭世界的人重新进行深入分析进行了全面的概述,包括深度特征表示学习,深度度量学习和排名优化。随着封闭世界设置下的性能饱和度,Re-ID的研究重点最近转移到了开放世界的环境中,面临着更具挑战性的问题。在特定情况下,此设置更接近实际应用。我们从五个不同的方面总结了开放世界的重新ID。通过分析现有方法的优势,我们设计了一个强大的AGW基线,在十二个数据集上实现了最新的或至少可比的性能,以实现四个不同的重新ID任务。同时,我们引入了一个新的评估度量标准(MINP),以指示查找所有正确匹配的成本,这提供了评估真实应用程序的RE-ID系统的附加标准。最后,讨论了一些重要但不足的开放问题。

Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras. With the advancement of deep neural networks and increasing demand of intelligent video surveillance, it has gained significantly increased interest in the computer vision community. By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings. The widely studied closed-world setting is usually applied under various research-oriented assumptions, and has achieved inspiring success using deep learning techniques on a number of datasets. We first conduct a comprehensive overview with in-depth analysis for closed-world person Re-ID from three different perspectives, including deep feature representation learning, deep metric learning and ranking optimization. With the performance saturation under closed-world setting, the research focus for person Re-ID has recently shifted to the open-world setting, facing more challenging issues. This setting is closer to practical applications under specific scenarios. We summarize the open-world Re-ID in terms of five different aspects. By analyzing the advantages of existing methods, we design a powerful AGW baseline, achieving state-of-the-art or at least comparable performance on twelve datasets for FOUR different Re-ID tasks. Meanwhile, we introduce a new evaluation metric (mINP) for person Re-ID, indicating the cost for finding all the correct matches, which provides an additional criteria to evaluate the Re-ID system for real applications. Finally, some important yet under-investigated open issues are discussed.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源