论文标题

通过训练问题嵌入来改善知识跟踪

Improving Knowledge Tracing via Pre-training Question Embeddings

论文作者

Liu, Yunfei, Yang, Yang, Chen, Xianyu, Shen, Jian, Zhang, Haifeng, Yu, Yong

论文摘要

知识追踪(KT)定义了预测学生是否可以根据历史回答正确回答问题的任务。尽管大量研究专门用于利用问题信息,但问题和技能之间的大量高级信息尚未得到充分提取,这使得先前的工作要充分表现挑战。在本文中,我们证明了KT上的大量收益可以通过在丰富侧面信息上的每个问题的预训练嵌入来实现,然后在获得的嵌入式上训练深kt模型。具体来说,侧面信息包括问题和技能之间的两分图中包含的三种关系。为了预先培训问题嵌入,我们建议使用基于产品的神经网络来恢复侧面信息。结果,在现有的Deep KT模型中采用预训练的嵌入量显着超过了三个常见的KT数据集上的最先进的基线。

Knowledge tracing (KT) defines the task of predicting whether students can correctly answer questions based on their historical response. Although much research has been devoted to exploiting the question information, plentiful advanced information among questions and skills hasn't been well extracted, making it challenging for previous work to perform adequately. In this paper, we demonstrate that large gains on KT can be realized by pre-training embeddings for each question on abundant side information, followed by training deep KT models on the obtained embeddings. To be specific, the side information includes question difficulty and three kinds of relations contained in a bipartite graph between questions and skills. To pre-train the question embeddings, we propose to use product-based neural networks to recover the side information. As a result, adopting the pre-trained embeddings in existing deep KT models significantly outperforms state-of-the-art baselines on three common KT datasets.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源