论文标题

通过深层生成建模迈向仇恨言语检测

Towards Hate Speech Detection at Large via Deep Generative Modeling

论文作者

Wullach, Tomer, Adler, Amir, Minkov, Einat

论文摘要

仇恨言论检测是社交媒体平台中的一个关键问题,经常被指控使仇恨和点燃身体暴力的传播。仇恨言论检测需要压倒性的资源,包括用于在线帖子和推文监视的高性能计算以及成千上万的人类专家,以每天筛选可疑帖子或推文。最近,已经提出了使用数千种仇恨言论序列的适度训练数据集自动检测仇恨言论的深度学习解决方案。尽管这些方法在特定的数据集上表现良好,但它们检测新的仇恨语音序列的能力是有限的,尚未研究。作为一种数据驱动的方法,众所周知,每当达到火车数据集大小和多样性的扩大规模时,DL都会超过其他方法。因此,我们首先介绍由深层生成语言模型产生的100万个现实仇恨和非讨厌序列的数据集。我们进一步利用生成的数据集来培训基于DL的仇恨语音探测器,并在五个公共仇恨言论数据集中表现出一致且显着的绩效改进。因此,所提出的解决方案可以对多种仇恨言语序列进行高灵敏度检测,从而为通往全自动解决方案铺平了道路。

Hate speech detection is a critical problem in social media platforms, being often accused for enabling the spread of hatred and igniting physical violence. Hate speech detection requires overwhelming resources including high-performance computing for online posts and tweets monitoring as well as thousands of human experts for daily screening of suspected posts or tweets. Recently, Deep Learning (DL)-based solutions have been proposed for automatic detection of hate speech, using modest-sized training datasets of few thousands of hate speech sequences. While these methods perform well on the specific datasets, their ability to detect new hate speech sequences is limited and has not been investigated. Being a data-driven approach, it is well known that DL surpasses other methods whenever a scale-up in train dataset size and diversity is achieved. Therefore, we first present a dataset of 1 million realistic hate and non-hate sequences, produced by a deep generative language model. We further utilize the generated dataset to train a well-studied DL-based hate speech detector, and demonstrate consistent and significant performance improvements across five public hate speech datasets. Therefore, the proposed solution enables high sensitivity detection of a very large variety of hate speech sequences, paving the way to a fully automatic solution.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源