论文标题
基于卷积神经网络的低复杂性滤波器
A Convolutional Neural Network-Based Low Complexity Filter
论文作者
论文摘要
基于卷积的神经网络(CNN)的过滤器在减少视频伪影方面已取得了显着性能。但是,现有方法的高复杂性使得很难在实际使用中应用。在本文中,提出了基于CNN的低复杂性滤波器。我们利用与批处理归一化(BN)合并的深度可分离卷积(DSC)作为我们建议的基于CNN的网络的骨干。此外,提出了一种重量初始化方法来增强训练性能。为了解决框架间框架的平滑问题,框架级残留映射(RM)。我们分析了一些主流方法,例如框架级和基于块级的过滤器,并通过框架级控制构建基于CNN的过滤器,以避免由块级控制引起的额外的复杂性和人工边界。此外,一个名为RM的新型模块旨在恢复学习残差的失真。结果,我们可以有效地提高基于学习的过滤器的概括能力并达到自适应滤波效果。此外,该模块是灵活的,可以与其他基于学习的过滤器结合使用。实验结果表明,我们提出的方法比H.265/HEVC实现了显着的BD率降低。与VR-CNN相比,它可实现大约1.2%的BD率降低,而Flops降低了79.1%。最后,还进行了H.266/VVC和消融研究的测量,以确保该方法的有效性。
Convolutional Neural Network (CNN)-based filters have achieved significant performance in video artifacts reduction. However, the high complexity of existing methods makes it difficult to be applied in real usage. In this paper, a CNN-based low complexity filter is proposed. We utilize depth separable convolution (DSC) merged with the batch normalization (BN) as the backbone of our proposed CNN-based network. Besides, a weight initialization method is proposed to enhance the training performance. To solve the well known over smoothing problem for the inter frames, a frame-level residual mapping (RM) is presented. We analyze some of the mainstream methods like frame-level and block-level based filters quantitatively and build our CNN-based filter with frame-level control to avoid the extra complexity and artificial boundaries caused by block-level control. In addition, a novel module called RM is designed to restore the distortion from the learned residuals. As a result, we can effectively improve the generalization ability of the learning-based filter and reach an adaptive filtering effect. Moreover, this module is flexible and can be combined with other learning-based filters. The experimental results show that our proposed method achieves significant BD-rate reduction than H.265/HEVC. It achieves about 1.2% BD-rate reduction and 79.1% decrease in FLOPs than VR-CNN. Finally, the measurement on H.266/VVC and ablation studies are also conducted to ensure the effectiveness of the proposed method.