论文标题
肯德尔形状的空间方法,可从2D地标进行3D形状估算
A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks
论文作者
论文摘要
3D形状比2D图像提供了更多的信息。但是,与获取2D图像相比,有时候3D形状的采集有时非常困难甚至是不可能的,因此有必要从2D图像中得出3D形状。尽管总的来说,这是一个数学上不适的问题,但可以通过使用先验信息来限制问题表述来解决。在这里,我们提出了一种基于肯德尔的形状空间的新方法,可从单眼2D图像重建3D形状。这项工作是由研究basking鲨鱼的喂养行为的应用,这是一种濒临灭绝的物种,其巨大的大小和迁移率使3D形状数据几乎无法获得,从而阻碍了对其喂养行为和生态学的了解。但是,这些动物处于进食位置的2D图像很容易获得。我们将方法与基于最先进的形状方法的方法进行了比较,无论是在人棒模型还是在鲨鱼头骨架上。我们使用一系列的训练形状表明,肯德尔形状空间方法比以前的方法更强大,并导致形状合理的形状。这对于标本很少见的激励应用至关重要,因此只有很少的训练形状可用。
3D shapes provide substantially more information than 2D images. However, the acquisition of 3D shapes is sometimes very difficult or even impossible in comparison with acquiring 2D images, making it necessary to derive the 3D shape from 2D images. Although this is, in general, a mathematically ill-posed problem, it might be solved by constraining the problem formulation using prior information. Here, we present a new approach based on Kendall's shape space to reconstruct 3D shapes from single monocular 2D images. The work is motivated by an application to study the feeding behavior of the basking shark, an endangered species whose massive size and mobility render 3D shape data nearly impossible to obtain, hampering understanding of their feeding behaviors and ecology. 2D images of these animals in feeding position, however, are readily available. We compare our approach with state-of-the-art shape-based approaches, both on human stick models and on shark head skeletons. Using a small set of training shapes, we show that the Kendall shape space approach is substantially more robust than previous methods and results in plausible shapes. This is essential for the motivating application in which specimens are rare and therefore only few training shapes are available.