论文标题
日落：肖像重建和重新建造和重新使用太阳作为光舞台
SunStage: Portrait Reconstruction and Relighting using the Sun as a Light Stage
论文作者
论文摘要
轻型舞台使用一系列校准的摄像头和灯光来捕捉受试者在不同的照明和观点下的面部外观。这些捕获的信息对于面部重建和重新构建至关重要。不幸的是，光阶段通常是无法访问的：它们很昂贵，需要大量的技术专业知识才能建设和运营。在本文中，我们介绍了日落：轻巧的替代品，用于轻型阶段，该阶段仅使用智能手机摄像头和太阳捕获可比的数据。我们的方法仅要求用户在户外捕获自拍照视频，旋转到位，并使用太阳和面部之间的不同角度作为面部几何形状，反射率，相机姿势和照明参数的关节重建的指导。尽管有未核心的环境设置，但我们的方法还是能够重建详细的面部外观和几何形状，从而产生了令人信服的效果，例如重新构成，新型视图合成和反射率编辑。结果和交互式演示可在https://sunstage.cs.washington.edu/上获得。
A light stage uses a series of calibrated cameras and lights to capture a subject's facial appearance under varying illumination and viewpoint. This captured information is crucial for facial reconstruction and relighting. Unfortunately, light stages are often inaccessible: they are expensive and require significant technical expertise for construction and operation. In this paper, we present SunStage: a lightweight alternative to a light stage that captures comparable data using only a smartphone camera and the sun. Our method only requires the user to capture a selfie video outdoors, rotating in place, and uses the varying angles between the sun and the face as guidance in joint reconstruction of facial geometry, reflectance, camera pose, and lighting parameters. Despite the in-the-wild un-calibrated setting, our approach is able to reconstruct detailed facial appearance and geometry, enabling compelling effects such as relighting, novel view synthesis, and reflectance editing. Results and interactive demos are available at https://sunstage.cs.washington.edu/.
