4.6 Article

MCDCD: Multi-Source Unsupervised Domain Adaptation for Abnormal Human Gait Detection

Journal

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
Volume 25, Issue 10, Pages 4017-4028

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JBHI.2021.3080502

Keywords

Feature extraction; Training; Electromyography; Data models; Data mining; Kinematics; Adaptation models; Gait abnormality detection; multi-source unsupervised domain adaptation; cross-domain; mocap; EMG

Funding

  1. Science and Technology Commission of Shanghai Municipality [20DZ2220400]
  2. Interdisciplinary Program of Shanghai Jiao Tong University [YG2021QN117]

Ask authors/readers for more resources

A novel deep multi-source Unsupervised Domain Adaptation (UDA) approach, namely Maximum Cross-Domain Classifier Discrepancy (MCDCD), is proposed to improve classification performance on test subjects by leveraging information from multiple labelled training subjects. Experimental results demonstrate superior performance in detecting gait abnormalities on novel subjects compared to baseline deep models and state-of-the-art UDA methods.
For gait analysis, especially for the detection of subtle gait abnormalities, the collected datasets involve high variability across subjects due to inherent biometric traits and movement behaviors, leading to limited detection accuracy and poor generalizability. To address this, we propose a novel deep multi-source Unsupervised Domain Adaptation (UDA) approach, namely Maximum Cross-Domain Classifier Discrepancy (MCDCD), which aims to improve the classification performance on the test subject (target domain) by leveraging the information from multiple labelled training subjects (source domains). Specifically, the proposed model consists of a feature extractor and a domain-specific category classifier per source domain. The former feature extractor learns to generate discriminative gait features. For the latter classifiers, we minimize the cross-entropy loss to accurately classify source samples, and simultaneously maximize a novel cross-domain discrepancy loss between any two category classifiers to minimize domain shift between multiple sources and the target domain. To validate the proposed MCDCD for detecting gait abnormalities on novel subjects, we collected both high-quality Motion capture (Mocap) and noisy Electromyography (EMG) data from eighteen subjects with both normal and imitated abnormal gaits. Experiment results using both data modalities demonstrate that the proposed approach can achieve superior performance in abnormal gait classification compared to baseline deep models and state-of-the-art UDA methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Cross-Subject and Cross-Modal Transfer for Generalized Abnormal Gait Pattern Recognition

Xiao Gu, Yao Guo, Fani Deligianni, Benny Lo, Guang-Zhong Yang

Summary: For abnormal gait recognition, the integration of pattern-specific features and subject-specific differences in deep representations can lead to overfitting and hinder generalization to new subjects. Limited availability of abnormal gait data from precise Motion Capture systems is compounded by slow adaptation of new technologies in healthcare. Our proposed cascade of deep architectures aims to address these challenges by encoding cross-modal and cross-subject transfer for improved abnormal gait recognition accuracy.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Computer Science, Artificial Intelligence

Eye-Tracking for Performance Evaluation and Workload Estimation in Space Telerobotic Training

Yao Guo, Daniel Freer, Fani Deligianni, Guang-Zhong Yang

Summary: Monitoring mental workload of operators in space telerobotic training and teleoperation tasks is crucial. This study investigates the impact of time-pressure and latency on space teleoperation, using eye-tracking technology for mental workload estimation and performance evaluation. Significant eye-tracking features such as fixation duration, saccade frequency and duration, pupil diameter, and pupillary activity index are identified for mental workload estimation and task performance evaluation.

IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS (2022)

Article Computer Science, Information Systems

Cross-Domain Self-Supervised Complete Geometric Representation Learning for Real-Scanned Point Cloud Based Pathological Gait Analysis

Xiao Gu, Yao Guo, Guang-Zhong Yang, Benny Lo

Summary: Accurate lower-limb pose estimation is crucial for skeleton based pathological gait analysis. Existing methods have limitations, and we propose a novel cross-domain self-supervised learning framework to address these issues and achieve accurate and precise pose estimation.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2022)

Article Robotics

Egocentric Human Trajectory Forecasting With a Wearable Camera and Multi-Modal Fusion

Jianing Qiu, Lipeng Chen, Xiao Gu, Frank P-W Lo, Ya-Yen Tsai, Jiankai Sun, Jiaqi Liu, Benny Lo

Summary: In this study, the problem of forecasting the trajectory of an egocentric camera wearer in crowded spaces is addressed. A novel egocentric human trajectory forecasting dataset is constructed, and a Transformer-based neural network model integrated with a cascaded cross-attention mechanism is designed. The results show that the proposed model outperforms the state-of-the-art methods in egocentric human trajectory forecasting.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Computer Science, Artificial Intelligence

Trustworthy learning with (un)sure annotation for lung nodule diagnosis with CT

Hanxiao Zhang, Liang Chen, Xiao Gu, Minghui Zhang, Yulei Qin, Feng Yao, Zhexin Wang, Yun Gu, Guang-Zhong Yang

Summary: This study addresses the generalizability issues in lung nodule classification by constructing a sure-annotation dataset and proposing a collaborative learning framework. By integrating unsure-annotation data knowledge through nodule segmentation and malignancy score regression, the proposed approach achieves improved performance and trustworthy model reasoning.

MEDICAL IMAGE ANALYSIS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Interpretable Lung Cancer Diagnosis with Nodule Attribute Guidance and Online Model Debugging

Hanxiao Zhang, Liang Chen, Minghui Zhang, Xiao Gu, Yulei Qin, Weihao Yu, Feng Yao, Zhexin Wang, Yun Gu, Guang-Zhong Yang

Summary: Accurate nodule labeling and interpretable machine learning play crucial roles in lung cancer diagnosis. The proposed collaborative model and regularization strategy combination achieves the best performances in lung cancer prediction and interpretable diagnosis.

INTERPRETABILITY OF MACHINE INTELLIGENCE IN MEDICAL IMAGE COMPUTING, IMIMIC 2022 (2022)

Proceedings Paper Automation & Control Systems

Ego plus X: An Egocentric Vision System for Global 3D Human Pose Estimation and Social Interaction Characterization

Yuxuan Liu, Jianxin Yang, Xiao Gu, Yao Guo, Guang-Zhong Yang

Summary: This paper proposes a system based on egocentric vision for 3D canonical pose estimation and human-centric social interaction characterization. By leveraging global context and two head-mounted cameras, the system can accurately estimate poses and handle various social interaction tasks.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Tackling Long-Tailed Category Distribution Under Domain Shifts

Xiao Gu, Yao Guo, Zeju Li, Jianing Qiu, Qi Dou, Yuxuan Liu, Benny Lo, Guang-Zhong Yang

Summary: This study investigates the problems of long-tailed classification and domain shift, proposing three new core functional blocks and adopting a meta-learning framework to improve domain generalization on unseen target domains. Experimental results demonstrate superior performance over existing approaches for long-tailed/domain generalization tasks.

COMPUTER VISION, ECCV 2022, PT XXIII (2022)

Proceedings Paper Computer Science, Information Systems

Clustering Egocentric Images in Passive Dietary Monitoring with Self-Supervised Learning

Jiachuan Peng, Peilun Shi, Jianing Qiu, Xinwei Ju, Frank P. -W. Lo, Xiao Gu, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A. McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo

Summary: In this study, researchers collected a large number of in-the-wild images using wearable camera technologies in Ghana. They proposed a novel self-supervised learning framework to cluster the images into separate events, which enabled more efficient data analysis. The framework outperformed baseline methods in terms of clustering quality and classification accuracy.

2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22) (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

A Novel Active Human Echolocation Device

Saeed Akbarzadeh, Xiao Gu, Zhipeng Wu, Benny Lo

Summary: The article introduces a wearable device that utilizes echolocation technique to help blind and visually impaired individuals acquire navigation skills. The research results show that trained subjects can 'visualize' the surrounding environment using the echoed signals.

2022 IEEE-EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL AND HEALTH INFORMATICS (BHI'22) JOINTLY ORGANISED WITH THE IEEE-EMBS INTERNATIONAL CONFERENCE ON WEARABLE AND IMPLANTABLE BODY SENSOR NETWORKS (BSN'22) (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Re-thinking and Re-labeling LID C-IDRI for Robust Pulmonary Cancer Prediction

Hanxiao Zhang, Xiao Gu, Minghui Zhang, Weihao Yu, Liang Chen, Zhexin Wang, Feng Yao, Yun Gu, Guang-Zhong Yang

Summary: The LIDC-IDRI database, a popular benchmark for lung cancer prediction, may have label assignment errors due to subjective assessment. This study proposes a strategy of re-labeling LIDC data using similar nodule retrieval, which improves model performance.

MEDICAL IMAGE LEARNING WITH LIMITED AND NOISY DATA (MILLAND 2022) (2022)

Proceedings Paper Automation & Control Systems

Indoor Future Person Localization from an Egocentric Wearable Camera

Jianing Qiu, Frank P-W Lo, Xiao Gu, Yingnan Sun, Shuo Jiang, Benny Lo

Summary: This research constructed a new egocentric dataset using a wearable camera and designed an LSTM-based encoder-decoder framework to predict the future location and movement trajectory of the targeted person. Experimental results have shown that the proposed method is more reliable and accurate in predicting the future person location and trajectory in egocentric videos compared to three baselines.

2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2021)

Article Computer Science, Artificial Intelligence

Coupled Real-Synthetic Domain Adaptation for Real-World Deep Depth Enhancement

Xiao Gu, Yao Guo, Fani Deligianni, Guang-Zhong Yang

IEEE TRANSACTIONS ON IMAGE PROCESSING (2020)

No Data Available