论文标题
脱钩使弱监督的本地功能更好
Decoupling Makes Weakly Supervised Local Feature Better
论文作者
论文摘要
弱监督的学习可以帮助局部特征方法克服获得带有密集标记对应的大规模数据集的障碍。但是,由于弱监督无法区分检测和描述步骤造成的损失,因此在联合描述中直接进行弱监督的学习会遭受有限的性能。在本文中,我们提出了一条脱钩的描述,然后是针对弱监督的本地特征学习量身定制的检测管道。在我们的管道中,检测步骤与描述步骤并脱钩,并推迟到歧视性和强大的描述符为止。此外,我们还引入了线到窗口搜索策略,以明确使用相机姿势信息以进行更好的描述符学习。广泛的实验表明,我们的方法,即POSFEAT(相机姿势监督功能),超过以前的完全和弱监督的方法,并在各种下游任务上实现了最先进的性能。
Weakly supervised learning can help local feature methods to overcome the obstacle of acquiring a large-scale dataset with densely labeled correspondences. However, since weak supervision cannot distinguish the losses caused by the detection and description steps, directly conducting weakly supervised learning within a joint describe-then-detect pipeline suffers limited performance. In this paper, we propose a decoupled describe-then-detect pipeline tailored for weakly supervised local feature learning. Within our pipeline, the detection step is decoupled from the description step and postponed until discriminative and robust descriptors are learned. In addition, we introduce a line-to-window search strategy to explicitly use the camera pose information for better descriptor learning. Extensive experiments show that our method, namely PoSFeat (Camera Pose Supervised Feature), outperforms previous fully and weakly supervised methods and achieves state-of-the-art performance on a wide range of downstream tasks.