论文标题
3D META点签名:学习学习3D密集形状对应的3D点签名
3D Meta Point Signature: Learning to Learn 3D Point Signature for 3D Dense Shape Correspondence
论文作者
论文摘要
点签名是描述3D形状点的结构邻域的表示,可以应用于在3D形状中建立点之间的对应关系。常规方法应用了一个体重共享网络,例如任何类型的图形神经网络,都可以直接生成点签名,并通过大量的SCRATCH培训样本在大量培训样本中获得广泛的训练能力。但是,这些方法缺乏快速适应看不见的邻里结构的灵活性,因此在新的点集上概括了很差。在本文中,我们提出了一种新型的基于元学习的3D点签名模型,称为3DMetapointSignature(MEPS)网络,该模型能够以3D形状学习稳健的点签名。通过将每个点签名学习过程作为一项任务,我们的方法在所有任务的分布上获得了优化的模型,为新任务(即未见点社区的签名)生成可靠的签名。具体而言,MEP由两个模块组成:一个基本签名学习者和一个元签名学习者。在培训期间,培训基础学习者可以执行特定的签名学习任务。同时,对元学习者进行了训练,可以使用最佳参数更新基础学习者。在测试过程中,通过所有任务分布来学到的元学习者可以自适应地更改基础学习者的参数,从而适应看不见的本地社区。我们在两个数据集上评估了MEPS模型,例如Faust和Tosca,以进行密集的3DShape对应关系。实验结果表明,我们的方法不仅比基线模型获得了重大改进,并获得了最先进的结果,而且还能够处理看不见的3D形状。
Point signature, a representation describing the structural neighborhood of a point in 3D shapes, can be applied to establish correspondences between points in 3D shapes. Conventional methods apply a weight-sharing network, e.g., any kind of graph neural networks, across all neighborhoods to directly generate point signatures and gain the generalization ability by extensive training over a large amount of training samples from scratch. However, these methods lack the flexibility in rapidly adapting to unseen neighborhood structures and thus generalizes poorly on new point sets. In this paper, we propose a novel meta-learning based 3D point signature model, named 3Dmetapointsignature (MEPS) network, that is capable of learning robust point signatures in 3D shapes. By regarding each point signature learning process as a task, our method obtains an optimized model over the best performance on the distribution of all tasks, generating reliable signatures for new tasks, i.e., signatures of unseen point neighborhoods. Specifically, the MEPS consists of two modules: a base signature learner and a meta signature learner. During training, the base-learner is trained to perform specific signature learning tasks. In the meantime, the meta-learner is trained to update the base-learner with optimal parameters. During testing, the meta-learner that is learned with the distribution of all tasks can adaptively change parameters of the base-learner, accommodating to unseen local neighborhoods. We evaluate the MEPS model on two datasets, e.g., FAUST and TOSCA, for dense 3Dshape correspondence. Experimental results demonstrate that our method not only gains significant improvements over the baseline model and achieves state-of-the-art results, but also is capable of handling unseen 3D shapes.