论文标题

Phyaat:听觉上关注语音数据集的生理学

PhyAAt: Physiology of Auditory Attention to Speech Dataset

论文作者

Bajaj, Nikesh, Carrión, Jesús Requena, Bellotti, Francesco

论文摘要

听觉对自然语音的关注是一个复杂的大脑过程。它从生理信号进行的量化对于改善和扩大当前大脑计算机接口系统的应用范围可能很有价值,但是它仍然是一项艰巨的任务。在本文中,我们介绍了从听觉上关注自然语音的实验中收集的生理信号数据集。在此实验中,向25名非本地参与者提出了由不同听觉条件下的英语句子复制的听觉刺激,他们被要求抄录句子。在实验过程中,从每个参与者收集了14个通道脑电图,电流皮肤响应和光杀解自我图的信号。基于正确转录单词的数量,为受试者提出的每个听觉刺激获得了注意力评分。发现了注意力评分和听觉条件之间的强相关性($ p << 0.0001 $)。我们还制定了涉及收集到的数据集并开发特征提取框架的四个不同的预测任务。每个预测任务的结果是使用具有光谱特征的支持向量机获得的,并且比机会级别更好。该数据集已公开用于进一步研究,以及Python库-Phyaat,以促进本文提出的结果的预处理,建模和复制。数据集和其他资源在网页上共享-https://phyaat.github.io。

Auditory attention to natural speech is a complex brain process. Its quantification from physiological signals can be valuable to improving and widening the range of applications of current brain-computer-interface systems, however it remains a challenging task. In this article, we present a dataset of physiological signals collected from an experiment on auditory attention to natural speech. In this experiment, auditory stimuli consisting of reproductions of English sentences in different auditory conditions were presented to 25 non-native participants, who were asked to transcribe the sentences. During the experiment, 14 channel electroencephalogram, galvanic skin response, and photoplethysmogram signals were collected from each participant. Based on the number of correctly transcribed words, an attention score was obtained for each auditory stimulus presented to subjects. A strong correlation ($p<<0.0001$) between the attention score and the auditory conditions was found. We also formulate four different predictive tasks involving the collected dataset and develop a feature extraction framework. The results for each predictive task are obtained using a Support Vector Machine with spectral features, and are better than chance level. The dataset has been made publicly available for further research, along with a python library - phyaat to facilitate the preprocessing, modeling, and reproduction of the results presented in this paper. The dataset and other resources are shared on webpage - https://phyaat.github.io.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源