论文标题
超越不可能:平衡足够,分离和准确性
Beyond Impossibility: Balancing Sufficiency, Separation and Accuracy
论文作者
论文摘要
在近年来研究的算法公平的各个方面中,满足\ textit {Adusification}和\ textit {shipation} - 例如,正面或阴性预测值的比率以及各组之间的假阳性或假负率的比率引起了很多关注。在由刑事司法预测系统Compas引发的辩论之后,学术界做出了重要的回应,提出了重要的理论理解,这表明当群体之间的标签分布不相等时,就无法通过不完善的预测指标实现这两者。在本文中,我们更多地阐明了可能在不可能之外可能仍然有可能的事情 - 权衡的存在意味着我们应该旨在在其中找到良好的平衡。在完善了现有的理论结果之后,我们提出了一个目标,旨在平衡\ textit {Adusificity}和\ textit {shipation}测量,同时保持相似的精度级别。我们在两个经验案例研究中显示了这种目标的使用,一个涉及多目标框架,另一个对预先训练的模型进行精确的微调。我们显示出令人鼓舞的结果,与现有替代方案相比,实现更好的权衡。
Among the various aspects of algorithmic fairness studied in recent years, the tension between satisfying both \textit{sufficiency} and \textit{separation} -- e.g. the ratios of positive or negative predictive values, and false positive or false negative rates across groups -- has received much attention. Following a debate sparked by COMPAS, a criminal justice predictive system, the academic community has responded by laying out important theoretical understanding, showing that one cannot achieve both with an imperfect predictor when there is no equal distribution of labels across the groups. In this paper, we shed more light on what might be still possible beyond the impossibility -- the existence of a trade-off means we should aim to find a good balance within it. After refining the existing theoretical result, we propose an objective that aims to balance \textit{sufficiency} and \textit{separation} measures, while maintaining similar accuracy levels. We show the use of such an objective in two empirical case studies, one involving a multi-objective framework, and the other fine-tuning of a model pre-trained for accuracy. We show promising results, where better trade-offs are achieved compared to existing alternatives.