论文标题

在婴儿自发运动的自动姿势估计上达到人级表现

Towards human-level performance on automatic pose estimation of infant spontaneous movements

论文作者

Groos, Daniel, Adde, Lars, Støen, Ragnhild, Ramampiaro, Heri, Ihlen, Espen A. F.

论文摘要

自发运动的评估可以预测高危婴儿的长期发育障碍。为了开发以后疾病自动预测的算法,需要通过婴儿姿势估计对细分和关节进行高度精确的定位。在一个新颖的婴儿姿势数据集上对四种类型的卷积神经网络进行了培训和评估,涵盖了临床国际社会的1 424个视频的巨大差异。将网络的定位性能评估为估计关键点位置与人类专家注释之间的偏差。还评估了计算效率,以确定神经网络在临床实践中的可行性。表现最佳的神经网络与人类专家注释的评价者间分布相似,同时仍然有效地运行。总体而言,我们的研究结果表明,对婴儿自发运动的姿势估计具有巨大的潜力,可以通过量化来自人类水平表现的视频记录的婴儿运动来支持围产期脑损伤的儿童早期发现发育障碍的研究计划。

Assessment of spontaneous movements can predict the long-term developmental disorders in high-risk infants. In order to develop algorithms for automated prediction of later disorders, highly precise localization of segments and joints by infant pose estimation is required. Four types of convolutional neural networks were trained and evaluated on a novel infant pose dataset, covering the large variation in 1 424 videos from a clinical international community. The localization performance of the networks was evaluated as the deviation between the estimated keypoint positions and human expert annotations. The computational efficiency was also assessed to determine the feasibility of the neural networks in clinical practice. The best performing neural network had a similar localization error to the inter-rater spread of human expert annotations, while still operating efficiently. Overall, the results of our study show that pose estimation of infant spontaneous movements has a great potential to support research initiatives on early detection of developmental disorders in children with perinatal brain injuries by quantifying infant movements from video recordings with human-level performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源