论文标题
部分可观测时空混沌系统的无模型预测
Discontinuous Constituency and BERT: A Case Study of Dutch
论文作者
论文摘要
在本文中，我们着手量化荷兰语中非文本无文化模式的评估制度中BERT的句法能力。我们设计了一个基于温和上下文敏感的形式主义的测试套件，我们从中得出了语法，从而捕获了控制动词嵌套和动词的语言现象。语法与小词典配对，为我们提供了大量的自然主义话语，并用动词对象配对注释，这些话语是基于注意的跨度选择探针的评估测试床。我们的结果以广泛的分析为支持，表明所研究的模型失败了所检查的依赖项的隐含获取。
In this paper, we set out to quantify the syntactic capacity of BERT in the evaluation regime of non-context free patterns, as occurring in Dutch. We devise a test suite based on a mildly context-sensitive formalism, from which we derive grammars that capture the linguistic phenomena of control verb nesting and verb raising. The grammars, paired with a small lexicon, provide us with a large collection of naturalistic utterances, annotated with verb-subject pairings, that serve as the evaluation test bed for an attention-based span selection probe. Our results, backed by extensive analysis, suggest that the models investigated fail in the implicit acquisition of the dependencies examined.
