论文标题
在点云中使用特征去相关的特征去相关朝向类不足的跟踪
Towards Class-agnostic Tracking Using Feature Decorrelation in Point Clouds
论文作者
论文摘要
点云中的单个对象跟踪由于在3D视觉中存在激光雷达传感器而引起了越来越多的关注。但是,基于深神经网络的现有方法主要集中于针对不同类别的不同模型培训不同的模型,这使得它们在培训阶段遇到不见的课程时无法在现实世界应用中表现良好。在这项工作中,我们研究了LiDar Point Cloud,Agr-Nostic Tracking的一项更具挑战性的任务,该任务应该为观察到的类别的任何指定目标学习一个通用模型。特别是,我们首先通过在测试过程中向他们暴露于未见类别的类别,首先研究最先进的跟踪器的类别表现,发现类 - 敏锐的跟踪的关键因素是如何在模板和搜索区域之间限制融合功能,以在分布从观察到的分布中转移到unsesseenssens中,以维持概括。因此,我们提出了一种解决此问题的功能去相关方法,该方法通过一组学习的权重消除了融合功能的虚假相关性,并进一步使搜索区域之间的搜索区域之间的搜索区域在前景点之间保持一致,并且在前景和背景点之间具有独特性。 Kitti和Nuscenes上的实验表明,提出的方法可以通过对高级跟踪器P2B和BAT进行基准测试,尤其是在跟踪看不见的物体时,可以实现相当大的改进。
Single object tracking in point clouds has been attracting more and more attention owing to the presence of LiDAR sensors in 3D vision. However, the existing methods based on deep neural networks focus mainly on training different models for different categories, which makes them unable to perform well in real-world applications when encountering classes unseen during the training phase. In this work, we investigate a more challenging task in the LiDAR point clouds, class-agnostic tracking, where a general model is supposed to be learned for any specified targets of both observed and unseen categories. In particular, we first investigate the class-agnostic performances of the state-of-the-art trackers via exposing the unseen categories to them during testing, finding that a key factor for class-agnostic tracking is how to constrain fused features between the template and search region to maintain generalization when the distribution is shifted from observed to unseen classes. Therefore, we propose a feature decorrelation method to address this problem, which eliminates the spurious correlations of the fused features through a set of learned weights and further makes the search region consistent among foreground points and distinctive between foreground and background points. Experiments on the KITTI and NuScenes demonstrate that the proposed method can achieve considerable improvements by benchmarking against the advanced trackers P2B and BAT, especially when tracking unseen objects.