论文标题

STD-NET:从单个图像进行3D重建的结构保存和拓扑自适应变形网络

STD-Net: Structure-preserving and Topology-adaptive Deformation Network for 3D Reconstruction from a Single Image

论文作者

Mao, Aihua, Dai, Canglan, Gao, Lin, He, Ying, Liu, Yong-jin

论文摘要

来自单个视图图像的3D重建是计算机视觉中的长期概率。已经提出了基于不同形状表示(例如点云或体积表示)的各种方法。但是,具有精细细节和复杂结构的3D形状重建仍然是挑剔的,尚未解决。多亏了深层表示的最新进展,使用深神经网络学习结构和细节复制变得很有希望。 In this paper, we propose a novel methodcalled STD-Net to reconstruct the 3D models utilizing the mesh representationthat is well suitable for characterizing complex structure and geometry details.To reconstruct complex 3D mesh models with fine details, our method consists of(1) an auto-encoder network for recovering the structure of an object with bound-ing box representation from a single image, (2) a topology-adaptive graph CNNfor updating复杂拓扑网格的顶点位置,以及(3)统一的变形块,将结构框变形为结构 - 瓦雷列明模型。对Shapenet图像的实验结果表明,我们所在的STD-NET具有比其他最先进的方法更好的性能,该方法对具有复杂结构和精细几何细节的3D对象进行了构造。

3D reconstruction from a single view image is a long-standing prob-lem in computer vision. Various methods based on different shape representations(such as point cloud or volumetric representations) have been proposed. However,the 3D shape reconstruction with fine details and complex structures are still chal-lenging and have not yet be solved. Thanks to the recent advance of the deepshape representations, it becomes promising to learn the structure and detail rep-resentation using deep neural networks. In this paper, we propose a novel methodcalled STD-Net to reconstruct the 3D models utilizing the mesh representationthat is well suitable for characterizing complex structure and geometry details.To reconstruct complex 3D mesh models with fine details, our method consists of(1) an auto-encoder network for recovering the structure of an object with bound-ing box representation from a single image, (2) a topology-adaptive graph CNNfor updating vertex position for meshes of complex topology, and (3) an unifiedmesh deformation block that deforms the structural boxes into structure-awaremeshed models. Experimental results on the images from ShapeNet show that ourproposed STD-Net has better performance than other state-of-the-art methods onreconstructing 3D objects with complex structures and fine geometric details.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源