论文标题

基于可穿戴设备的联合活动细分和识别的多级对比网络

Multi-level Contrast Network for Wearables-based Joint Activity Segmentation and Recognition

论文作者

Xia, Songpengcheng, Chu, Lei, Pei, Ling, Yu, Wenxian, Qiu, Robert C.

论文摘要

具有可穿戴设备的人类活动识别(HAR)是有希望的研究,在许多智能医疗保健应用中都可以广泛采用。近年来,基于深度学习的HAR模型已取得了令人印象深刻的识别表现。但是,大多数HAR算法都容易受到多级窗口问题的影响,而多级窗口问题却很少被利用。在本文中,我们建议通过将细分技术引入HAR来缓解这个具有挑战性的问题,从而产生共同的活动细分和认可。特别是,我们介绍了多个阶段的时间卷积网络(MS-TCN)体系结构,以进行样品级活动预测至关节段并识别活性序列。此外,为了增强HAR对阶层间相似性和阶层内异质性的鲁棒性,已经提出了多层对比损失,其中包含样本级别和段级对比度,以学习一个结构结构化的嵌入空间,以实现更好的活动分割和识别性能。最后,通过全面的实验,我们验证了提出方法对两个公共HAR数据集的有效性,从而在各种评估指标方面取得了重大改进。

Human activity recognition (HAR) with wearables is promising research that can be widely adopted in many smart healthcare applications. In recent years, the deep learning-based HAR models have achieved impressive recognition performance. However, most HAR algorithms are susceptible to the multi-class windows problem that is essential yet rarely exploited. In this paper, we propose to relieve this challenging problem by introducing the segmentation technology into HAR, yielding joint activity segmentation and recognition. Especially, we introduce the Multi-Stage Temporal Convolutional Network (MS-TCN) architecture for sample-level activity prediction to joint segment and recognize the activity sequence. Furthermore, to enhance the robustness of HAR against the inter-class similarity and intra-class heterogeneity, a multi-level contrastive loss, containing the sample-level and segment-level contrast, has been proposed to learn a well-structured embedding space for better activity segmentation and recognition performance. Finally, with comprehensive experiments, we verify the effectiveness of the proposed method on two public HAR datasets, achieving significant improvements in the various evaluation metrics.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源