论文标题

用于本地化图像伪造的两流编码器网络

Two-stream Encoder-Decoder Network for Localizing Image Forgeries

论文作者

Mazumdar, Aniruddha, Bora, Prabin Kumar

论文摘要

本文提出了一个新颖的两流编码器网络,该网络利用了在操纵图像中精确定位锻造区域的高级和低级图像特征。这是由于伪造过程通常引入高级人工制品(例如,不自然的对比度)和低级伪像(例如噪声不一致)的事实。在提出的两流网络中,一个流通过通过编码器网络第一层中的一组高通滤波器提取噪声残差来学习编码器侧的低级操纵相关特征。在第二个流中,编码器从输入图像RGB值中学习了高级图像操纵特征。两个编码器的粗糙特征图都由其相应的解码器网络更加采样,以产生密集的特征图。两条流的密集特征图被串联,并喂入最终卷积层,并带有Sigmoidal激活,以产生像素的预测。我们已经对多个标准取证数据集进行了实验分析,以评估所提出方法的性能。实验结果表明,所提出的方法在最先进方面的功效。

This paper proposes a novel two-stream encoder-decoder network, which utilizes both the high-level and the low-level image features for precisely localizing forged regions in a manipulated image. This is motivated from the fact that the forgery creation process generally introduces both the high-level artefacts (e.g. unnatural contrast) and the low-level artefacts (e.g. noise inconsistency) to the forged images. In the proposed two-stream network, one stream learns the low-level manipulation-related features in the encoder side by extracting noise residuals through a set of high-pass filters in the first layer of the encoder network. In the second stream, the encoder learns the high-level image manipulation features from the input image RGB values. The coarse feature maps of both the encoders are upsampled by their corresponding decoder network to produce dense feature maps. The dense feature maps of the two streams are concatenated and fed to a final convolutional layer with sigmoidal activation to produce pixel-wise prediction. We have carried out experimental analysis on multiple standard forensics datasets to evaluate the performance of the proposed method. The experimental results show the efficacy of the proposed method with respect to the state-of-the-art.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源