论文标题
步态视频的人类健康指标预测
Human Health Indicator Prediction from Gait Video
论文作者
论文摘要
体重指数(BMI),年龄,身高和体重是人类健康状况的重要指标,可以为大量实际目的提供有用的信息,例如医疗保健,监测和重新识别。大多数现有的健康指标预测方法主要使用前视体或面部图像。这些投入很难在日常生活中获得,并且通常会导致模型缺乏鲁棒性,考虑到它们对视图和姿势的严格要求。在本文中,我们建议采用步态视频来预测健康指标,这些指标在监视和家庭监测方案中更为普遍。但是,由于少量开源数据,使用深度学习对步态视频进行的健康指标预测的研究受到了阻碍。为了解决这个问题,我们分析了姿势估计和健康指标预测任务之间的相似性和关系,然后提出了一个范式,通过预先培训姿势估计任务,从而为小型健康指标数据集提供深入学习。此外,为了更好地适合健康指标预测任务,我们提出了全球现有意识和中心对称编码器(GLANCE)模块。它首先通过渐进式卷积提取本地和全局特征,然后通过两种不同的方式通过中心对称双路径沙漏结构融合多层特征。 实验表明,所提出的范式可实现预测MOVI健康指标的最新结果,并且Glance模块也有助于3DPW上的姿势估计。
Body Mass Index (BMI), age, height and weight are important indicators of human health conditions, which can provide useful information for plenty of practical purposes, such as health care, monitoring and re-identification. Most existing methods of health indicator prediction mainly use front-view body or face images. These inputs are hard to be obtained in daily life and often lead to the lack of robustness for the models, considering their strict requirements on view and pose. In this paper, we propose to employ gait videos to predict health indicators, which are more prevalent in surveillance and home monitoring scenarios. However, the study of health indicator prediction from gait videos using deep learning was hindered due to the small amount of open-sourced data. To address this issue, we analyse the similarity and relationship between pose estimation and health indicator prediction tasks, and then propose a paradigm enabling deep learning for small health indicator datasets by pre-training on the pose estimation task. Furthermore, to better suit the health indicator prediction task, we bring forward Global-Local Aware aNd Centrosymmetric Encoder (GLANCE) module. It first extracts local and global features by progressive convolutions and then fuses multi-level features by a centrosymmetric double-path hourglass structure in two different ways. Experiments demonstrate that the proposed paradigm achieves state-of-the-art results for predicting health indicators on MoVi, and that the GLANCE module is also beneficial for pose estimation on 3DPW.