论文标题
研究社区以外的可重复性：NLP初学者的经验
Reproducibility Beyond the Research Community: Experience from NLP Beginners
论文作者
论文摘要
随着NLP研究引起公众的关注和兴奋，对于广泛的受众来说，它可以使用它变得越来越重要。随着研究界致力于民主化NLP，尚不清楚该领域的初学者是否可以轻松地采用最新发展。为了了解他们的需求，我们在NLP入门课程中对93名学生进行了一项研究，学生在该课程中复制了最近的NLP论文结果。令人惊讶的是，我们的结果表明，他们的技术技能（即编程经验）对他们完成练习所花费的努力的影响有限。取而代之的是，我们发现研究作者的可访问性是成功体验的关键，包括彻底的文档以及轻松访问所需的模型和数据集。
As NLP research attracts public attention and excitement, it becomes increasingly important for it to be accessible to a broad audience. As the research community works to democratize NLP, it remains unclear whether beginners to the field can easily apply the latest developments. To understand their needs, we conducted a study with 93 students in an introductory NLP course, where students reproduced results of recent NLP papers. Surprisingly, our results suggest that their technical skill (i.e., programming experience) has limited impact on their effort spent completing the exercise. Instead, we find accessibility efforts by research authors to be key to a successful experience, including thorough documentation and easy access to required models and datasets.
