论文标题

研究偏见从程序员到程序的转移

Studying the Transfer of Biases from Programmers to Programs

论文作者

Johansen, Johanna, Pedersen, Tore, Johansen, Christian

论文摘要

人们普遍认为,机器偏差的一种起源是由于训练算法的数据集中的特征而产生的,即数据不保证广义推断。但是,我们假设迄今未在文献中尚未阐明的一种不同的“机制”也可能导致机器的偏见,即偏见可能源于(i)程序员的文化背景,例如教育或工作线,或(II)上下文编程环境,例如软件要求或开发人员工具,例如软件编程环境。结合了实验性和比较设计,我们研究了文化隐喻和上下文隐喻的影响,并测试了这些隐喻和上下文隐喻的影响是否会从程序员中“转移”到程序,从而构成了机器偏见。结果表明(i)文化隐喻会影响程序员的选择,并且(ii)“诱发”上下文隐喻可用于缓和或加剧文化隐喻的影响。这支持了我们的假设,即自动化系统中的偏见并不总是来自机器培训数据中的偏见。取而代之的是,机器也可以通过将文化隐喻转移到编程过程中来“复制”和“复制”偏见。对学术界和专业实践的影响范围从微型编程级别到宏观国家监管或教育水平,并且跨越了所有基于软件系统运行的社会领域,例如流行的基于AI的自动化决策支持系统。

It is generally agreed that one origin of machine bias is resulting from characteristics within the dataset on which the algorithms are trained, i.e., the data does not warrant a generalized inference. We, however, hypothesize that a different `mechanism', hitherto not articulated in the literature, may also be responsible for machine's bias, namely that biases may originate from (i) the programmers' cultural background, such as education or line of work, or (ii) the contextual programming environment, such as software requirements or developer tools. Combining an experimental and comparative design, we studied the effects of cultural metaphors and contextual metaphors, and tested whether each of these would `transfer' from the programmer to program, thus constituting a machine bias. The results show (i) that cultural metaphors influence the programmer's choices and (ii) that `induced' contextual metaphors can be used to moderate or exacerbate the effects of the cultural metaphors. This supports our hypothesis that biases in automated systems do not always originate from within the machine's training data. Instead, machines may also `replicate' and `reproduce' biases from the programmers' cultural background by the transfer of cultural metaphors into the programming process. Implications for academia and professional practice range from the micro programming-level to the macro national-regulations or educational level, and span across all societal domains where software-based systems are operating such as the popular AI-based automated decision support systems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源