论文标题

实时的人类活动识别使用有条件的移动和可穿戴设备上有条件参数化的卷积

Real-time Human Activity Recognition Using Conditionally Parametrized Convolutions on Mobile and Wearable Devices

论文作者

Cheng, Xin, Zhang, Lei, Tang, Yin, Liu, Yue, Wu, Hao, He, Jun

论文摘要

最近,深度学习代表了人类活动识别的重要研究趋势(HAR)。特别是,深度卷积神经网络(CNN)在各种HAR数据集上实现了最先进的性能。为了深入学习,绩效的改善必须在很大程度上依赖于增加模型大小或能力,以扩展到越来越大的数据集,这不可避免地导致运营的增加。深度倾斜的大量操作增加了计算成本,不适合使用移动和可穿戴传感器实时HAR。尽管浅层学习技术通常是轻量级的,但它们无法取得良好的表现。因此,高度需要在准确性和计算成本之间取舍的深度学习方法,据我们所知,这很少受到研究。在本文中,我们首次使用有条件的参数化卷积进行计算有效的CNN,以在移动设备和可穿戴设备上进行实时HAR。我们在四个公共基准HAR数据集上评估了所提出的方法,该数据集由WISDM数据集,PAMAP2数据集,Unimib-Shar数据集和机会数据集组成,在不损害计算成本的情况下实现了最先进的准确性。进行了各种消融实验,以说明在需要类似操作的同时,具有大容量的这种网络显然比基线更可取。该方法可以用作现有深HAR体系结构的置换式替换,并轻松部署到移动设备上,用于实时HAR应用程序。

Recently, deep learning has represented an important research trend in human activity recognition (HAR). In particular, deep convolutional neural networks (CNNs) have achieved state-of-the-art performance on various HAR datasets. For deep learning, improvements in performance have to heavily rely on increasing model size or capacity to scale to larger and larger datasets, which inevitably leads to the increase of operations. A high number of operations in deep leaning increases computational cost and is not suitable for real-time HAR using mobile and wearable sensors. Though shallow learning techniques often are lightweight, they could not achieve good performance. Therefore, deep learning methods that can balance the trade-off between accuracy and computation cost is highly needed, which to our knowledge has seldom been researched. In this paper, we for the first time propose a computation efficient CNN using conditionally parametrized convolution for real-time HAR on mobile and wearable devices. We evaluate the proposed method on four public benchmark HAR datasets consisting of WISDM dataset, PAMAP2 dataset, UNIMIB-SHAR dataset, and OPPORTUNITY dataset, achieving state-of-the-art accuracy without compromising computation cost. Various ablation experiments are performed to show how such a network with large capacity is clearly preferable to baseline while requiring a similar amount of operations. The method can be used as a drop-in replacement for the existing deep HAR architectures and easily deployed onto mobile and wearable devices for real-time HAR applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源