4.6 Article

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

Journal

APPLIED SCIENCES-BASEL
Volume 8, Issue 12, Pages -

Publisher

MDPI
DOI: 10.3390/app8122349

Keywords

HMT gesture recognition; smart infrastructure; nursing-care assistant robot; wearable wrist-worn camera; continuous gesture segmentation; human-robot interaction

Funding

  1. National Key R&D Program of China [2017YFB1301203]
  2. Fundamental Research Funds for the Central Universities
  3. National Natural Science Foundation of China [U1509204]
  4. Science Fund for Creative Research Groups of the National Natural Science Foundation of China [51521064]
  5. China's Thousand Talents Plan Young Professionals Program
  6. Robotics Institute of Zhejiang University [K18-508116-008-03]

Ask authors/readers for more resources

The expansion of nursing-care assistant robots in smart infrastructure has provided more applications for homecare services, which has raised new demands for smart and natural interaction between humans and robots. This article proposed an innovative hand motion trajectory (HMT) gesture recognition system based on background velocity features. Here, a new wearable wrist-worn camera prototype for gesture's video collection was designed, and a new method for the segmentation of continuous gestures was shown. Meanwhile, a nursing-care assistant robot prototype was designed for assisting the elderly, which is capable of carrying the elderly with omnidirectional motion and grabbing the specified object at home. In order to evaluate the performance of the gesture recognition system, 10 special gestures were defined as the move commands for interaction with the robot, and 1000 HMT gesture samples were obtained from five subjects for leave-one-subject-out (LOSO) cross-validation classification with an average recognition accuracy of up to 97.34%. Moreover, the performance and practicability of the proposed system were further demonstrated by controlling the omnidirectional movement of the nursing-care assistant robot using the predefined gesture commands.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Chemistry, Analytical

Flexible Insole Sensors with Stably Connected Electrodes for Gait Phase Detection

Wenzheng Heng, Gaoyang Pang, Feihong Xu, Xiaoyan Huang, Zhibo Pang, Geng Yang

SENSORS (2019)

Article Energy & Fuels

Internal Flow Analysis of a Heat Transfer Enhanced Tube with a Segmented Twisted Tape Insert

Gan Liu, Chen Yang, Junhui Zhang, Huaizhi Zong, Bing Xu, Jin-yuan Qian

ENERGIES (2020)

Editorial Material Engineering, Chemical

Special Issue: Smart Flow Control in Micro Scale

Jin-yuan Qian, Junhui Zhang, Zan Wu, Bengt Sunden

PROCESSES (2020)

Editorial Material Engineering, Mechanical

Keep Healthcare Workers Safe: Application of Teleoperated Robot in Isolation Ward for COVID-19 Prevention and Control

Geng Yang, Honghao Lv, Zhiyu Zhang, Liu Yang, Jia Deng, Siqi You, Juan Du, Huayong Yang

CHINESE JOURNAL OF MECHANICAL ENGINEERING (2020)

Article Computer Science, Information Systems

IoT-Enabled Dual-Arm Motion Capture and Mapping for Telerobotics in Home Care

Huiying Zhou, Geng Yang, Honghao Lv, Xiaoyan Huang, Huayong Yang, Zhibo Pang

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2020)

Article Engineering, Mechanical

Soft Controllable Carbon Fibre-based Piezoresistive Self-Sensing Actuators

Min Pan, Chenggang Yuan, Hastha Anpalagan, Andrew Plummer, Jun Zou, Junhui Zhang, Chris Bowen

ACTUATORS (2020)

Article Chemistry, Analytical

Plant Factory: A New Playground of Industrial Communication and Computing

Yu Liu, Sepehr Mousavi, Zhibo Pang, Zhongjun Ni, Magnus Karlsson, Shaofang Gong

Summary: This paper reviews the current status and requirements of the plant factory industry and proposes an architecture that integrates the domains of communication and computing. It also calls for a cross-disciplinary co-design methodology to accelerate the engineering implementation of plant factories and other industries.

SENSORS (2022)

Article Computer Science, Information Systems

User-Interactive Robot Skin With Large-Area Scalability for Safer and Natural Human-Robot Collaboration in Future Telehealthcare

Zakka Vincent Gbouna, Gaoyang Pang, Geng Yang, Zeyang Hou, Honghao Lv, Zhangwei Yu, Zhibo Pang

Summary: Healthcare 4.0 introduces collaborative robots into care services, presenting challenges in natural collaboration and safety. A proximity sensing solution based on self-capacitive technology is proposed to enhance touch and safety for collaborative robots, operating in interaction and safety modes.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2021)

Article Robotics

Soft Robot Skin With Conformal Adaptability for On-Body Tactile Perception of Collaborative Robots

Zhiqiu Ye, Gaoyang Pang, Kaichen Xu, Zeyang Hou, Honghao Lv, Yiren Shen, Geng Yang

Summary: This letter presents a soft robot skin that can mediate on-body tactile signals during tasks, adapt to complex robot contours, and enable real-time collision detection with high sensitivity and fast response time.

IEEE ROBOTICS AND AUTOMATION LETTERS (2022)

Article Health Care Sciences & Services

A Medical Assistive Robot for Telehealth Care During the COVID-19 Pandemic: Development and Usability Study in an Isolation Ward

Ruohan Wang, Honghao Lv, Zhangli Lu, Xiaoyan Huang, Haiteng Wu, Junjie Xiong, Geng Yang

Summary: This study developed a medical assistive robot called CareDo for remote health care in the isolation ward during the COVID-19 pandemic. The robot can assist patients and healthcare workers through tasks such as video chatting, emotion detection, and medical supplies delivery. Clinical trials showed that the system accurately recognized patients' facial expressions during psychological intervention.

JMIR HUMAN FACTORS (2023)

Article Automation & Control Systems

Impacts of Wireless on Robot Control: The Network Hardware-in-the-Loop Simulation Framework and Real-Life Comparisons

Honghao Lv, Zhibo Pang, Koushik Bhimavarapu, Geng Yang

Summary: This article proposes a network hardware-in-the-loop (N-HiL) simulation framework to evaluate the impacts of wireless on robot control more efficiently and accurately. The framework employs correlation analysis between communication and control performances to improve the design. The N-HiL method provides reliable network conditions and eliminates the efforts and costs of building and testing the entire physical robot system in real life.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Engineering, Biomedical

GuLiM: A Hybrid Motion Mapping Technique for Teleoperation of Medical Assistive Robot in Combating the COVID-19 Pandemic

Honghao Lv, Depeng Kong, Gaoyang Pang, Baicun Wang, Zhangwei Yu, Zhibo Pang, Geng Yang

Summary: This paper presents a novel motion synchronization method using a hybrid mapping technique of hand gesture and upper-limb motion for teleoperation of medical assistive robots. The proposed method reduces the burden on healthcare workers, simplifies the operation, and achieves superior performance compared to traditional methods.

IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS (2022)

Article Automation & Control Systems

Fluid-Driven Soft CoboSkin for Safer Human-Robot Collaboration: Fabrication and Adaptation

Wenzheng Heng, Geng Yang, Gaoyang Pang, Zhiqiu Ye, Honghao Lv, Juan Du, Guodong Zhao, Zhibo Pang

Summary: The fluid-driven soft robot skin with sensing and actuating function successfully applied to a collaborative robot provides tunable stiffness and sensitivity by altering the internal air pressure in pneumatic actuators. This skin reduces the peak force of collision and achieves actuating function, fabricated using three-dimensional printing and computer-aided design. The experiment demonstrating the applications of CoboSkin shows that it enhances robot adaptability to human daily life by mimicking human skin and muscle.

ADVANCED INTELLIGENT SYSTEMS (2021)

Article Engineering, Electrical & Electronic

Cooling Performance Analysis of Outside Fins of the Closed Circuit Axial Piston Transmission

Chen Yang, Long-jie Yu, Junhui Zhang, Jin-yuan Qian

Summary: The study investigates the influence of fin height, fin pitch, and fin thickness on the thermal performance of the closed circuit axial piston transmission (CCAPT) through designing a spiral fin structure and conducting numerical simulations. Attention should be paid to the heat accumulation in the area of rotating elements for better cooling effects. An increase in fin height, fin pitch, and fin thickness can enhance heat transfer, with optimal results obtained at a fin height of 7.5 mm and a fin pitch of 30 mm showing significant improvements in Nusselt number.

MACHINES (2021)

Article Engineering, Biomedical

Teleoperation of Collaborative Robot for Remote Dementia Care in Home Environments

Honghao Lv, Geng Yang, Huiying Zhou, Xiaoyan Huang, Huayong Yang, Zhibo Pang

IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE (2020)

No Data Available