论文标题
FACEMAP:通过地图方程迈向无监督的面部聚类
FaceMap: Towards Unsupervised Face Clustering via Map Equation
论文作者
论文摘要
由于相关应用程序(例如增强现实或相册管理)的爆炸,面部聚类是计算机视觉中的重要任务。该任务的主要挑战在于图像特征表示之间的相似性不完美。给定现有的特征提取模型,仍然无法解决的问题是,如何利用未标记图像相似性的固有特征来提高聚类性能。通过回答这个问题,我们通过将面部聚类作为非重叠社区检测的过程进行了有效的无监督方法,称为Facemap,并最大程度地减少了图像网络上信息流的熵。熵用地图方程表示,其最小值表示预期图像中路径的最小描述。受到观察到由面部图像构建的亲和力图中排名的过渡概率的观察的启发,我们开发了一种离群检测策略,以适应图像之间的过渡概率。进行消融研究的实验表明,Facemap在三个流行的大型大规模数据集上实现了现有方法,并实现了新的最新方法,例如,与先前的无人驾驶和监督方法相比,与以前的无人驾驶和监督方法相比,绝对改善了$ 10 \%$ $ $ $ \%$ $。我们的代码在GitHub上公开可用。
Face clustering is an essential task in computer vision due to the explosion of related applications such as augmented reality or photo album management. The main challenge of this task lies in the imperfectness of similarities among image feature representations. Given an existing feature extraction model, it is still an unresolved problem that how can the inherent characteristics of similarities of unlabelled images be leveraged to improve the clustering performance. Motivated by answering the question, we develop an effective unsupervised method, named as FaceMap, by formulating face clustering as a process of non-overlapping community detection, and minimizing the entropy of information flows on a network of images. The entropy is denoted by the map equation and its minimum represents the least description of paths among images in expectation. Inspired by observations on the ranked transition probabilities in the affinity graph constructed from facial images, we develop an outlier detection strategy to adaptively adjust transition probabilities among images. Experiments with ablation studies demonstrate that FaceMap significantly outperforms existing methods and achieves new state-of-the-arts on three popular large-scale datasets for face clustering, e.g., an absolute improvement of more than $10\%$ and $4\%$ comparing with prior unsupervised and supervised methods respectively in terms of average of Pairwise F-score. Our code is publicly available on github.