论文标题

BMD:无源域适应的一般类平衡的多中心动态原型策略

BMD: A General Class-balanced Multicentric Dynamic Prototype Strategy for Source-free Domain Adaptation

论文作者

Qu, Sanqing, Chen, Guang, Zhang, Jing, Li, Zhijun, He, Wei, Tao, Dacheng

论文摘要

无源域的适应(SFDA)旨在将预先训练的源模型调整到未标记的目标域而无需访问标记良好的源数据的情况下,由于数据隐私,安全性和传输问题,这是一个更实用的设置。为了弥补缺乏源数据,大多数现有方法引入了基于特征原型的伪标记策略,以实现自我训练模型的适应性。但是,特征原型是通过基于实例级预测的特征群集获得的,该特征群集是偏见的,并且倾向于导致嘈杂的标签,因为源和目标之间的视觉域间隙通常在类别之间有所不同。此外,我们发现单中心特征原型可能无效地表示每个类别并引入负转移,尤其是对于这些硬转移数据。为了解决这些问题,我们为SFDA任务提供了一般级别平衡的多中心动态原型(BMD)策略。具体而言,对于每个目标类别,我们首先引入全球类间平衡采样策略,以汇总潜在的代表性目标样本。然后,我们设计了类内中心聚类策略,以实现更健壮和代表性的原型生成。与在固定培训期更新伪标签的现有策略相反,我们进一步引入了动态伪标签策略,以在模型适应过程中整合网络更新信息。广泛的实验表明,所提出的模型Anostic BMD策略显着改善了代表性的SFDA方法,以产生新的最新结果。该代码可在https://github.com/ispc-lab/bmd上找到。

Source-free Domain Adaptation (SFDA) aims to adapt a pre-trained source model to the unlabeled target domain without accessing the well-labeled source data, which is a much more practical setting due to the data privacy, security, and transmission issues. To make up for the absence of source data, most existing methods introduced feature prototype based pseudo-labeling strategies to realize self-training model adaptation. However, feature prototypes are obtained by instance-level predictions based feature clustering, which is category-biased and tends to result in noisy labels since the visual domain gaps between source and target are usually different between categories. In addition, we found that a monocentric feature prototype may be ineffective to represent each category and introduce negative transfer, especially for those hard-transfer data. To address these issues, we propose a general class-Balanced Multicentric Dynamic prototype (BMD) strategy for the SFDA task. Specifically, for each target category, we first introduce a global inter-class balanced sampling strategy to aggregate potential representative target samples. Then, we design an intra-class multicentric clustering strategy to achieve more robust and representative prototypes generation. In contrast to existing strategies that update the pseudo label at a fixed training period, we further introduce a dynamic pseudo labeling strategy to incorporate network update information during model adaptation. Extensive experiments show that the proposed model-agnostic BMD strategy significantly improves representative SFDA methods to yield new state-of-the-art results. The code is available at https://github.com/ispc-lab/BMD.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源