论文标题
通过渲染和能力从单一视图中的一般3D房间布局
General 3D Room Layout from a Single View by Render-and-Compare
论文作者
论文摘要
我们提出了一种新颖的方法，可以从挑战性的条件下单个透视图重建房间（墙壁，地板，天花板）的3D布局，与以前的单视图方法相反，它仅限于Cuboid形的布局。此输入视图只能由颜色图像组成，但是考虑深度图会导致更准确的重建。我们的方法被形式化为解决一个有限的离散优化问题，以找到构成布局的3D多边形集。为了处理布局组件之间的遮挡，这是以前的作品所忽略的问题，我们引入了逐个分析方法，以迭代地完善3D布局估计。由于没有数据集可用于定量评估我们的方法，因此我们与几个适当的指标共同创建了方法。我们的数据集由Scannet中的293张图像组成，我们用这些图像以精确的3D布局注释。它提供的样品是流行的NYUV2 303基准的三倍，以及多种布局。
We present a novel method to reconstruct the 3D layout of a room (walls, floors, ceilings) from a single perspective view in challenging conditions, by contrast with previous single-view methods restricted to cuboid-shaped layouts. This input view can consist of a color image only, but considering a depth map results in a more accurate reconstruction. Our approach is formalized as solving a constrained discrete optimization problem to find the set of 3D polygons that constitute the layout. In order to deal with occlusions between components of the layout, which is a problem ignored by previous works, we introduce an analysis-by-synthesis method to iteratively refine the 3D layout estimate. As no dataset was available to evaluate our method quantitatively, we created one together with several appropriate metrics. Our dataset consists of 293 images from ScanNet, which we annotated with precise 3D layouts. It offers three times more samples than the popular NYUv2 303 benchmark, and a much larger variety of layouts.
