论文标题
集合多样的假设和知识蒸馏,用于无监督的跨主题适应
Ensemble diverse hypotheses and knowledge distillation for unsupervised cross-subject adaptation
论文作者
论文摘要
识别人类运动意图和活动对于在复杂环境中行走时控制可穿戴机器人很重要。但是,人类机器人接口信号通常是用户依赖性的,这导致对源对象进行训练的分类器在新主题上的表现差。为了解决这个问题,本文设计了集合多样的假设和知识蒸馏(EDHKD)方法,以实现无监督的跨主题适应。 EDH减轻了源主题的标记数据与目标对象的未标记数据之间的差异,以准确地对目标受试者的运动模式进行准确分类,而无需标记数据。与以前的基于单个学习者的域适应方法相比,该方法只能从输入信号中学习一部分特征,EDH可以通过结合多种功能生成器来学习各种功能,从而提高准确性并降低对目标数据进行分类的方差,但是它牺牲了效率。为了解决这个问题,EDHKD(学生)将知识从EDH(教师)提炼为单个网络,以保持高效和准确。理论上证明了EDHKD的性能,并在2D月球数据集和两个公共人类运动数据集上进行了实验验证。实验结果表明,EDHKD的表现优于所有其他方法。 EDHKD可以以96.9%,94.4%和97.4%的平均精度在上述三个数据集中对目标数据进行分类,而计算时间很短(1 ms)。与基准(BM)方法相比,EDHKD对目标受试者的运动模式进行分类为1.3%和7.1%的平均准确性。 EDHKD还稳定了学习曲线。因此,EDHKD对于提高人类意图预测和人类活动识别系统的概括能力和效率很重要,这将改善人类机器人的相互作用。
Recognizing human locomotion intent and activities is important for controlling the wearable robots while walking in complex environments. However, human-robot interface signals are usually user-dependent, which causes that the classifier trained on source subjects performs poorly on new subjects. To address this issue, this paper designs the ensemble diverse hypotheses and knowledge distillation (EDHKD) method to realize unsupervised cross-subject adaptation. EDH mitigates the divergence between labeled data of source subjects and unlabeled data of target subjects to accurately classify the locomotion modes of target subjects without labeling data. Compared to previous domain adaptation methods based on the single learner, which may only learn a subset of features from input signals, EDH can learn diverse features by incorporating multiple diverse feature generators and thus increases the accuracy and decreases the variance of classifying target data, but it sacrifices the efficiency. To solve this problem, EDHKD (student) distills the knowledge from the EDH (teacher) to a single network to remain efficient and accurate. The performance of the EDHKD is theoretically proved and experimentally validated on a 2D moon dataset and two public human locomotion datasets. Experimental results show that the EDHKD outperforms all other methods. The EDHKD can classify target data with 96.9%, 94.4%, and 97.4% average accuracy on the above three datasets with a short computing time (1 ms). Compared to a benchmark (BM) method, the EDHKD increases 1.3% and 7.1% average accuracy for classifying the locomotion modes of target subjects. The EDHKD also stabilizes the learning curves. Therefore, the EDHKD is significant for increasing the generalization ability and efficiency of the human intent prediction and human activity recognition system, which will improve human-robot interactions.