论文标题
介绍贝雷尔：拉比编码语言的伯特嵌入
Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language
论文作者
论文摘要
我们为拉比希伯来语提出了一种新的预训练的语言模型（PLM），称为贝雷尔（伯特（Bert）编码语言）。尽管存在其他PLM用于处理希伯来文本（例如Hebert，Alephbert），但它们都接受了现代希伯来语文本的培训，其在词典，形态学，语法和正学规范方面与犹太人希伯来语有很大不同。我们通过一组希伯来语同源物来证明贝雷尔在拉比文本上的优越性。我们发布了无限制使用的新模型和同型挑战。
We present a new pre-trained language model (PLM) for Rabbinic Hebrew, termed Berel (BERT Embeddings for Rabbinic-Encoded Language). Whilst other PLMs exist for processing Hebrew texts (e.g., HeBERT, AlephBert), they are all trained on modern Hebrew texts, which diverges substantially from Rabbinic Hebrew in terms of its lexicographical, morphological, syntactic and orthographic norms. We demonstrate the superiority of Berel on Rabbinic texts via a challenge set of Hebrew homographs. We release the new model and homograph challenge set for unrestricted use.
