论文标题

DP-NERF:带有物理场景先验的Deblurred神经辐射场

DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priors

论文作者

Lee, Dogyoon, Lee, Minhyeok, Shin, Chajin, Lee, Sangyoun

论文摘要

神经辐射场(NERF)通过多视图图像和配对的校准摄像机参数的新型视图综合,表现出了出色的三维(3D)重建质量。但是,在严格控制的设置下已经证明了以前的基于NERF的系统,很少关注不太理想的情况,包括存在诸如暴露,照明变化和模糊之类的噪声。特别是,尽管模糊经常在实际情况下发生,但可以处理模糊图像的NERF很少受到关注。研究了模糊图像的NERF的少数研究并未考虑3D空间中的几何和外观一致性,这是3D重建中最重要的因素之一。这导致了构造场景的感知质量的不一致和退化。因此,本文提出了一个DP-NERF,这是一个新型的用于模糊图像的清洁NERF框架,该框架受到两个物理先验的约束。这些先验是从相机在图像采集过程中的实际模糊过程中得出的。 DP-NERF建议使用物理先验和适应性权重提案施加3D一致性,以考虑到深度与Blur之间的关系,从而提出3D一致性。我们为合成和真实场景带来了两种类型的模糊:摄像机运动模糊和Defocus Blur的广泛实验结果。结果表明,DP-NERF成功地提高了构造的NERF的感知质量,以确保3D几何和外观一致性。我们通过全面的消融分析进一步证明了模型的有效性。

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been demonstrated under strictly controlled settings, with little attention paid to less ideal scenarios, including with the presence of noise such as exposure, illumination changes, and blur. In particular, though blur frequently occurs in real situations, NeRF that can handle blurred images has received little attention. The few studies that have investigated NeRF for blurred images have not considered geometric and appearance consistency in 3D space, which is one of the most important factors in 3D reconstruction. This leads to inconsistency and the degradation of the perceptual quality of the constructed scene. Hence, this paper proposes a DP-NeRF, a novel clean NeRF framework for blurred images, which is constrained with two physical priors. These priors are derived from the actual blurring process during image acquisition by the camera. DP-NeRF proposes rigid blurring kernel to impose 3D consistency utilizing the physical priors and adaptive weight proposal to refine the color composition error in consideration of the relationship between depth and blur. We present extensive experimental results for synthetic and real scenes with two types of blur: camera motion blur and defocus blur. The results demonstrate that DP-NeRF successfully improves the perceptual quality of the constructed NeRF ensuring 3D geometric and appearance consistency. We further demonstrate the effectiveness of our model with comprehensive ablation analysis.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源