论文标题
RHO($ρ$):通过知识接地减少开放域对话中的幻觉
RHO ($ρ$): Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding
论文作者
论文摘要
对话系统可以利用大型的预训练的语言模型和知识来产生流利而有益的响应。但是,这些模型仍然容易产生输入源不支持的幻觉响应,这极大地阻碍了他们的应用。外部知识与对话环境之间的异质性挑战表示学习和源融合,并进一步促进了不忠。为了应对这一挑战并产生更忠实的回应,本文提出了Rho($ρ$),利用链接实体和关系图(kg)的关系谓词的表示形式。我们建议(1)本地知识接地,将文本嵌入与相应的kg嵌入相结合; (2)通过注意机制为Rho配备多跳的推理能力的全球知识基础。此外,我们设计了一种基于KG子图的步行,以更好的对话推理来设计响应重新排列技术。 OpenDialKG的实验结果表明,我们的方法在自动和人类评估方面的最先进方法大大优于降低幻觉(FEQA为17.54%)。
Dialogue systems can leverage large pre-trained language models and knowledge to generate fluent and informative responses. However, these models are still prone to produce hallucinated responses not supported by the input source, which greatly hinders their application. The heterogeneity between external knowledge and dialogue context challenges representation learning and source integration, and further contributes to unfaithfulness. To handle this challenge and generate more faithful responses, this paper presents RHO ($ρ$) utilizing the representations of linked entities and relation predicates from a knowledge graph (KG). We propose (1) local knowledge grounding to combine textual embeddings with the corresponding KG embeddings; and (2) global knowledge grounding to equip RHO with multi-hop reasoning abilities via the attention mechanism. In addition, we devise a response re-ranking technique based on walks over KG sub-graphs for better conversational reasoning. Experimental results on OpenDialKG show that our approach significantly outperforms state-of-the-art methods on both automatic and human evaluation by a large margin, especially in hallucination reduction (17.54% in FeQA).