论文标题
面部操作的全面数据集用于开发和评估法医工具
Comprehensive Dataset of Face Manipulations for Development and Evaluation of Forensic Tools
论文作者
论文摘要
数字媒体(例如,照片,视频)可以轻松创建,编辑和共享。编辑数字媒体的工具能够这样做,同时还可以保持高度的照片现实主义。尽管对数字媒体的许多类型的编辑通常是良性的,但其他类型的编辑也可以用于恶意目的。例如,最先进的面部编辑工具和软件可以人为地使一个人在不合时宜的时间里微笑,或者将权威人物描绘成脆弱和疲倦以使个人抹黑。鉴于越来越容易编辑数字媒体和滥用的潜在风险,因此媒体取证已经大大努力。为此,我们创建了一个编辑的面部图像的挑战数据集,以帮助研究社区开发新颖的方法来解决和对数字媒体的真实性进行分类。我们的数据集包括应用于受控的,肖像式的额叶脸部图像和全场景图像的编辑,这些图像可能包括每个图像的多个(即多个)脸部。我们数据集的目标是解决以下挑战问题:(1)我们可以确定给定图像的真实性(编辑检测)吗? (2)如果已经编辑了图像,我们可以\ textIt {本地化}编辑区域吗? (3)如果已经编辑了图像,我们可以推论(分类)执行哪种编辑类型?图像取证中的大多数研究通常试图回答项目(1),检测。据我们所知,没有专门策划的正式数据集分别评估项目(2)和(3),本地化和分类。我们的希望是,我们准备好的评估协议将帮助研究人员改善与这些挑战有关的图像取证中最新的。
Digital media (e.g., photographs, video) can be easily created, edited, and shared. Tools for editing digital media are capable of doing so while also maintaining a high degree of photo-realism. While many types of edits to digital media are generally benign, others can also be applied for malicious purposes. State-of-the-art face editing tools and software can, for example, artificially make a person appear to be smiling at an inopportune time, or depict authority figures as frail and tired in order to discredit individuals. Given the increasing ease of editing digital media and the potential risks from misuse, a substantial amount of effort has gone into media forensics. To this end, we created a challenge dataset of edited facial images to assist the research community in developing novel approaches to address and classify the authenticity of digital media. Our dataset includes edits applied to controlled, portrait-style frontal face images and full-scene in-the-wild images that may include multiple (i.e., more than one) face per image. The goals of our dataset is to address the following challenge questions: (1) Can we determine the authenticity of a given image (edit detection)? (2) If an image has been edited, can we \textit{localize} the edit region? (3) If an image has been edited, can we deduce (classify) what edit type was performed? The majority of research in image forensics generally attempts to answer item (1), detection. To the best of our knowledge, there are no formal datasets specifically curated to evaluate items (2) and (3), localization and classification, respectively. Our hope is that our prepared evaluation protocol will assist researchers in improving the state-of-the-art in image forensics as they pertain to these challenges.