论文标题
可证明不确定性引导的通用域适应
Provably Uncertainty-Guided Universal Domain Adaptation
论文作者
论文摘要
通用域的适应性(UNIDA)旨在将知识从标记的源域转移到未标记的目标域,而没有任何标签集的假设,这需要将未知样本与目标域中的已知样本区分开。 UNIDA的主要挑战是非相同的标签集导致两个域之间的错位。此外,源域中的域差异和监督目标很容易导致整个模型偏向通用类别,并对未知样本产生过度自信的预测。为了解决上述具有挑战性的问题,我们提出了一个新的不确定性引导的UNIDA框架。首先,我们介绍了属于未知类别的目标样本的概率的经验估计,该概率完全利用了潜在空间中目标样本的分布。然后,根据估计,我们在线性子空间中提出了一个新颖的邻居搜索方案,该方案具有$δ$ - 滤波器,以估计目标样本的不确定性得分并发现未知样本。它充分利用了源域中目标样本与其邻居之间的关系,以避免域未对准的影响。其次,本文通过基于发现的未知样本的信心的不确定性引导的边缘损失来平衡已知样本和未知样本的预测信心,这可以减少已知类别差异与未知类别相对于未知类别的阶段方差之间的差距。最后,在三个公共数据集上的实验表明,我们的方法显着胜过现有的最新方法。
Universal domain adaptation (UniDA) aims to transfer the knowledge from a labeled source domain to an unlabeled target domain without any assumptions of the label sets, which requires distinguishing the unknown samples from the known ones in the target domain. A main challenge of UniDA is that the nonidentical label sets cause the misalignment between the two domains. Moreover, the domain discrepancy and the supervised objectives in the source domain easily lead the whole model to be biased towards the common classes and produce overconfident predictions for unknown samples. To address the above challenging problems, we propose a new uncertainty-guided UniDA framework. Firstly, we introduce an empirical estimation of the probability of a target sample belonging to the unknown class which fully exploits the distribution of the target samples in the latent space. Then, based on the estimation, we propose a novel neighbors searching scheme in a linear subspace with a $δ$-filter to estimate the uncertainty score of a target sample and discover unknown samples. It fully utilizes the relationship between a target sample and its neighbors in the source domain to avoid the influence of domain misalignment. Secondly, this paper well balances the confidences of predictions for both known and unknown samples through an uncertainty-guided margin loss based on the confidences of discovered unknown samples, which can reduce the gap between the intra-class variances of known classes with respect to the unknown class. Finally, experiments on three public datasets demonstrate that our method significantly outperforms existing state-of-the-art methods.