论文标题
提示作为探测：使用语言模型进行知识基础构建
Prompting as Probing: Using Language Models for Knowledge Base Construction
论文作者
论文摘要
语言模型（LMS）已被证明在各种下游应用程序中很有用，例如摘要，翻译，问答和文本分类。由于它们可以存储的大量信息，LMS正在成为人工智能中越来越重要的工具。在这项工作中，我们提出了道具（提示为探测），该道具利用了GPT-3，这是OpenAI在2020年最初提出的大型语言模型，以执行知识基础构建任务（KBC）。 Prop实施了一种多步骤方法，该方法结合了各种提示技术来实现这一目标。我们的结果表明，手动提示策划是必不可少的，必须鼓励LM给出可变长度的答案集，特别是包括空的答案集，True/False问题是提高LM产生的建议精度的有用设备，LM的大小是至关重要的因素，并且是至关重要的因素，并且该实体Alias Aliass Aliass Aliass a Aliass scorce scrip lm scorce scrist。我们的评估研究表明，这些提出的技术可以大大提高最终预测的质量：Prop赢得了LM-KBC竞争的轨道2，表现优于基线36.4个百分点。我们的实施可在https://github.com/hemile/iswc-challenge上获得。
Language Models (LMs) have proven to be useful in various downstream applications, such as summarisation, translation, question answering and text classification. LMs are becoming increasingly important tools in Artificial Intelligence, because of the vast quantity of information they can store. In this work, we present ProP (Prompting as Probing), which utilizes GPT-3, a large Language Model originally proposed by OpenAI in 2020, to perform the task of Knowledge Base Construction (KBC). ProP implements a multi-step approach that combines a variety of prompting techniques to achieve this. Our results show that manual prompt curation is essential, that the LM must be encouraged to give answer sets of variable lengths, in particular including empty answer sets, that true/false questions are a useful device to increase precision on suggestions generated by the LM, that the size of the LM is a crucial factor, and that a dictionary of entity aliases improves the LM score. Our evaluation study indicates that these proposed techniques can substantially enhance the quality of the final predictions: ProP won track 2 of the LM-KBC competition, outperforming the baseline by 36.4 percentage points. Our implementation is available on https://github.com/HEmile/iswc-challenge.
