论文标题

通过学习的纹理扰动恢复几何信息

Recovering Geometric Information with Learned Texture Perturbations

论文作者

Wu, Jane, Jin, Yongxu, Geng, Zhenglin, Zhou, Hui, Fedkiw, Ronald

论文摘要

正则化用于避免训练神经网络时过度拟合;不幸的是,这降低了可实现的细节水平,阻碍了捕获培训数据中存在的高频信息的能力。即使可以使用各种方法来重新引入高频细节,但它通常与训练数据不匹配,并且通常与时间相干。在网络推断的布上,这些情感通过缺乏详细的皱纹或不自然出现和/或时间不一致的替代皱纹而表现出来。因此,我们提出了一种一般策略,从而将高频信息嵌入到低频数据中,以便当后者被网络涂抹时,前者仍然保留其高频细节。我们通过学习纹理坐标来说明这种方法,而当涂抹时,涂抹时,这些纹理又不涂抹纹理本身中的高频细节,而只是平稳地扭曲了纹理细节。值得注意的是,我们开出了扰动的纹理坐标,后来用于校正推断布的过度平滑外观,并从多个相机视图中纠正外观自然会恢复失去的几何信息。

Regularization is used to avoid overfitting when training a neural network; unfortunately, this reduces the attainable level of detail hindering the ability to capture high-frequency information present in the training data. Even though various approaches may be used to re-introduce high-frequency detail, it typically does not match the training data and is often not time coherent. In the case of network inferred cloth, these sentiments manifest themselves via either a lack of detailed wrinkles or unnaturally appearing and/or time incoherent surrogate wrinkles. Thus, we propose a general strategy whereby high-frequency information is procedurally embedded into low-frequency data so that when the latter is smeared out by the network the former still retains its high-frequency detail. We illustrate this approach by learning texture coordinates which when smeared do not in turn smear out the high-frequency detail in the texture itself but merely smoothly distort it. Notably, we prescribe perturbed texture coordinates that are subsequently used to correct the over-smoothed appearance of inferred cloth, and correcting the appearance from multiple camera views naturally recovers lost geometric information.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源