4.6 Article

CapsGaNet: Deep Neural Network Based on Capsule and GRU for Human Activity Recognition

期刊

IEEE SYSTEMS JOURNAL
卷 16, 期 4, 页码 5845-5855

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSYST.2022.3153503

关键词

Feature extraction; Deep learning; Convolutional neural networks; Activity recognition; Convolution; Sensors; Kernel; Aggressive activity; deep learning; human activity recognition (HAR); spatiotemporal feature

资金

  1. National Key Research and Development Program of China [2020YFC0833200]
  2. Natural Science Foundation of Shandong Province of China [ZR2020MF139]

向作者/读者索取更多资源

CapsGaNet, a novel framework for spatiotemporal multi-feature extraction, effectively improves the accuracy of human activity recognition. The construction of the DAAD dataset and the proposed threshold-based approach for aggressive activity detection meet the requirements of high real-time and low computational complexity in smart prison scenarios.
The advances in deep learning with the ability to automatically extract advanced features have achieved a bright prospect for human activity recognition (HAR). However, the traditional HAR methods still have the deficiencies of incomplete feature extraction, which may lead to incorrect recognition results. To resolve the above problem, a novel framework for spatiotemporal multi-feature extraction on HAR called CapsGaNet is propounded, which is based on capsule and gated recurrent units (GRU) with attention mechanisms. The proposed framework involves a spatial feature extraction layer consisting of capsule blocks, a temporal feature extraction layer consisting of GRU with attention mechanisms, and an output layer. At the same time, considering the actual demands for recognizing aggressive activities in some specific scenarios like smart prison, we constructed a daily and aggressive activity dataset (DAAD). Moreover, based on the acceleration characteristics of aggressive activity, a threshold-based approach for aggressive activity detection is propounded to meet the needs of high real-time and low computational complexity in prison scenarios. The experiments are performed on the wireless sensor data mining (WISDM) dataset and the DAAD dataset, and the results verify that the propounded CapsGaNet could effectually improve the recognition accuracy. The proposed threshold-based approach for aggressive activity detection provides a more effective HAR way by using smart sensor devices in smart prison scenarios.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

A spatiotemporal multi-feature extraction framework with space and channel based squeeze-and-excitation blocks for human activity recognition

Beibei Zhang, Hongji Xu, Hailiang Xiong, Xiaojie Sun, Leixin Shi, Shidi Fan, Juan Li

Summary: This paper proposes a new activity recognition framework based on spatiotemporal multi-feature extraction with SCbSE blocks. By simulating the prison environment and collecting an aggressive activity dataset, a threshold-based aggressive activity detection method is developed to simplify the model and enhance recognition speed.

JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING (2021)

Article Computer Science, Information Systems

8-QAM Division for Uplink Massive SIMO Systems

Gangtao Han, Zheng Dong, Jian-Kang Zhang, Xiaomin Mu

Summary: In this letter, an ultra-reliable low-latency communication (URLLC) scheme for one uplink massive single-input multiple-output (SIMO) system with three users is considered. A new multiuser space-time modulation scheme is devised for all users to update status information to the base station (BS) concurrently with extremely low latency. Additionally, a noncoherent maximum likelihood (ML) receiver is investigated for the receiver side to detect all signals of different users simultaneously with high reliability and low latency when the antenna array size is scaled up. Extensive computer simulations are carried out to validate the proposed design's effectiveness in the case of a large antenna array size.

IEEE WIRELESS COMMUNICATIONS LETTERS (2021)

Article Computer Science, Information Systems

Constellation Design for Energy-Based Noncoherent Massive SIMO Systems Over Correlated Channels

Wentong Han, Zheng Dong, He Chen, Xiangchuan Gao

Summary: This letter addresses the constellation design problem in energy-based noncoherent massive SIMO systems over correlated channels. An approximation method based on maximizing the minimum KL divergence of received signal vectors is proposed, and the difficult max-min KL divergence problem is optimally solved through Szego's theorem and a one-dimensional bisection search.

IEEE WIRELESS COMMUNICATIONS LETTERS (2022)

Article Computer Science, Information Systems

TMSO-Net: Texture adaptive multi-scale observation for light field image depth estimation

Congrui Fu, Hui Yuan, Hongji Xu, Hao Zhang, Liquan Shen

Summary: Light field technology can capture the four-dimensional information of light rays, including position, direction, and depth information. To improve the accuracy of depth estimation, a depth estimation algorithm based on convolutional neural network (CNN) is proposed. The algorithm utilizes a single image super-resolution algorithm to enhance the sub-aperture images and partitions the images into simple and complex texture regions based on texture analysis. Epipolar plane images (EPIs) are extracted and fed into specified network branches for both texture regions. A fusion module is used to generate the depth map. Experimental results show that the proposed method outperforms state-of-the-art methods in terms of objective and subjective quality, and is more robust to noise.

JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION (2023)

Article Engineering, Electrical & Electronic

A Novel Deep Multifeature Extraction Framework Based on Attention Mechanism Using Wearable Sensor Data for Human Activity Recognition

Yang Wang, Hongji Xu, Yunxia Liu, Mengmeng Wang, Yuhao Wang, Yang Yang, Shuang Zhou, Jiaqi Zeng, Jie Xu, Shijie Li, Jianjun Li

Summary: Human activity recognition using wearable sensors has various applications but faces challenges such as incomplete feature extraction and low utilization rate of features. To address this, a novel deep multifeature extraction framework based on attention mechanism (DMEFAM) is proposed, achieving high recognition accuracies of 97.9%, 96.0%, and 99.2% on the WISDM, UCI-HAR, and DAAD datasets respectively, outperforming other advanced HAR frameworks.

IEEE SENSORS JOURNAL (2023)

Article Engineering, Electrical & Electronic

Robust Beamforming Design for RIS-Aided NOMA Secure Networks With Transceiver Hardware Impairments

Qian Zhang, Ju Liu, Zhichao Gao, Ziyu Li, Zhiying Peng, Zheng Dong, Hongji Xu

Summary: This paper proposes a robust transmission scheme for RIS-aided NOMA secure networks with transceiver HWI. A closed-form expression for the distortion noise power caused by transceiver HWI in NOMA networks is derived. The proposed scheme achieves more robust security and outperforms other networks without considering HWI and imperfect SIC.

IEEE TRANSACTIONS ON COMMUNICATIONS (2023)

Article Computer Science, Information Systems

A new context correctness measure CMoC and corresponding context inconsistency elimination algorithm

Jie Xu, Hongji Xu, Shijie Li, Shuang Zhou, Mengmeng Wang, Yuhao Wang, Jiaqi Zeng, Jianjun Li, Xiaoman Li, Yiran Li, Xinya Li, Wentao Ai, Yang Wang

Summary: This paper introduces an algorithm for context inconsistency elimination based on a comprehensive measure of correctness and a two-dimensional mass function. The algorithm aims to solve the problem of context inconsistency in CASs and has been demonstrated to be effective through experimental analyses.

INFORMATION SCIENCES (2023)

Article Computer Science, Information Systems

Multiresolution Fusion Convolutional Network for Open Set Human Activity Recognition

Juan Li, Hongji Xu, Yuhao Wang

Summary: This article proposes a multiresolution fusion convolution network (MRFC-Net) to improve the accuracy of human activity recognition by correctly identifying confusing activities. It also introduces a multiresolution fusion convolution variational auto-encoder network (MRFC-VAE-Net) for open set HAR, which effectively classifies known and unknown class (UC) activities. Furthermore, a rich data set named daily-abnormal activity of special group (DAASG) is constructed for daily monitoring of special groups.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Computer Science, Information Systems

A Multidimensional Parallel Convolutional Connected Network Based on Multisource and Multimodal Sensor Data for Human Activity Recognition

Yuhao Wang, Hongji Xu, Lina Zheng, Guozhen Zhao, Zhi Liu, Shuang Zhou, Mengmeng Wang, Jie Xu

Summary: In this study, a deep learning network for HAR based on MMS data is proposed, which fully utilizes the advantages of multidimensional convolutional kernels. Multiscale residual convolutional squeeze-and-excitation modules are also introduced to increase the diversity of feature information. The proposed network achieves high FW-scores on the PAMAP2 and OPPORTUNITY data sets using both tenfold and LOSO cross-validations.

IEEE INTERNET OF THINGS JOURNAL (2023)

Proceedings Paper Computer Science, Theory & Methods

Robust Transmission Design for IRS-Aided MISO Network with Reflection Coefficient Mismatch

Ran Yang, Ning Wei, Zheng Dong, Hongji Xu, Ju Liu

Summary: This paper proposes a robust reflection coefficient design for an IRS-aided system to enhance signal quality, addressing the imperfect adjustment of reflection coefficients. By linear approximation and alternating optimization methods, the non-convex optimization problem is converted into a sequence of convex subproblems for efficient solutions. Numerical results demonstrate that high resolution for phase shifts is not necessary for approaching ideal performance.

COMMUNICATIONS AND NETWORKING (CHINACOM 2021) (2022)

暂无数据