Article
Automation & Control Systems
Yu Jiang, Minghao Zhao, Chong Wang, Fenglin Wei, Hong Qi
Summary: This paper introduces a gesture tracking method for underwater human-robot interaction based on fuzzy control. Utilizing YOLO V4-tiny as a gesture area recognition algorithm, a Siamese Network model for gestures classification is proposed, and a 3D fuzzy rule set is established by analyzing images from the AUV front camera. The experiment result demonstrates the efficiency of the proposed method.
INTERNATIONAL JOURNAL OF FUZZY SYSTEMS
(2021)
Article
Computer Science, Information Systems
Kyeong-Beom Park, Sung Ho Choi, Jae Yeol Lee, Yalda Ghasemi, Mustafa Mohammed, Heejin Jeong
Summary: This study introduces a novel hands-free interaction method using multimodal gestures and deep learning for human-robot interaction in mixed reality environments. The method supports coarse-to-fine interactions, utilizing eye gazing for searching and previewing and head gestures for selection and 3D manipulation. Deep learning-based object detection helps estimate initial object positioning, and virtual object-based indirect manipulation enables more intuitive and efficient control of the robot compared to traditional methods.
Article
Robotics
Shuaishuai Han, Haoping Wang, Haoyong Yu
Summary: The article proposes an assist-as-needed method for upper limb rehabilitation robots driven by series elastic actuators (SEAs) based on human-robot interaction evaluation. The method provides stable human-robot interaction through the design of a controller and the application of an iterative learning algorithm, as well as periodically adjusting the intensity of robotic assistance according to the evaluation results. The method adapts to different participants' abilities and provides adaptive assistance when a specific trainee tries to change their participation.
IEEE TRANSACTIONS ON ROBOTICS
(2023)
Article
Engineering, Electrical & Electronic
Dong Liu, Xianwei Wang, Ming Cong, Yu Du, Qiang Zou, Xiaomin Zhang
Summary: This article proposed a human-robot handover system based on human behavior patterns, established a human comfort model by combining the arm joint torque model and the medium joint angle model, and constructed a binary cost function to predict object transfer points. The research results indicate that the designed model can accurately predict object transfer points that conform to human handover habits.
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
(2021)
Article
Chemistry, Analytical
Chiara Filippini, David Perpetuini, Daniela Cardone, Arcangelo Merla
Summary: An intriguing challenge in the field of human-robot interaction is to endow robots with emotional intelligence to make the interaction more genuine and intuitive. This study proposes a convolutional-neural-network-based facial expression recognition model that can enhance the NAO robot's awareness of human facial expressions and provide arousal level detection capability during interactions.
Article
Computer Science, Information Systems
Erhan Sesli
Summary: This article discusses the possibilities of future human-robot interaction (HRI) based on effective hand gesture recognition. The Leap Motion Controller (LMC) was used to obtain hand gesture features, and only the relevant distances between fingers and the hand's normal were considered. Six hand gesture recognition methods of different complexities were examined for performance, with the proposed CDF-based DNN approach achieving an accuracy of 88.44%. This marks a 4.76% improvement compared to the second best method, Kullback Leibler Divergence. Although limited in features, high performance was achieved in the study, making it a potential pioneering study in the military field in the future.
MULTIMEDIA TOOLS AND APPLICATIONS
(2023)
Article
Materials Science, Textiles
Sijie Yang, Xiaohua Wang, Wenjie Wang
Summary: The paper proposes three deep learning-based models for sewing gesture detection, which improve accuracy and speed by enhancing network structure and feature extraction methods. The performance of each model is compared and analyzed.
JOURNAL OF ENGINEERED FIBERS AND FABRICS
(2022)
Article
Computer Science, Interdisciplinary Applications
Digang Sun, Ping Zhang, Mingxuan Chen
Summary: This paper proposes a framework for programming industrial and collaborative robots using hand gestures and poses. The framework allows operators to control the robot using both End-Effector (EE) and joint movements, and accurately transfer compound shapes to the robot. The hand gestures are classified using a deep neural network, achieving 99% test accuracy. The proposed method outperforms other gesture sets in terms of reaction time and accuracy in indicating instructions and reconstructing compound shapes.
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING
(2023)
Article
Automation & Control Systems
Yu-Jung Chae, Changjoo Nam, Daseul Yang, HunSeob Sin, ChangHwan Kim, Sung-Kee Park
Summary: This study proposes a method for a robot to automatically generate appropriate co-speech gestures corresponding to robot utterances. By analyzing the sentence morphology, the method determines the expression unit and predicts the gesture type to generate an appropriate gesture.
ROBOTICS AND AUTONOMOUS SYSTEMS
(2022)
Article
Computer Science, Artificial Intelligence
Zhihao Li, Yishan Mu, Zhenglong Sun, Sifan Song, Jionglong Su, Jiaming Zhang
Summary: This research proposes a novel task-based framework that enables robots to understand human intentions using visual semantics information and satisfy human intentions based on natural language instructions, further advancing human-robot interaction.
FRONTIERS IN NEUROROBOTICS
(2021)
Article
Automation & Control Systems
Yu Jiang, Xianglong Peng, Mingzhu Xue, Chong Wang, Hong Qi
Summary: This paper discusses the importance of AUV in ocean research and the impact of the underwater environment on AUV control and human-robot interaction. It introduces fuzzy control to address the parameter issue in the traditional control model, as well as the gesture recognition framework for controlling AUV.
INTERNATIONAL JOURNAL OF FUZZY SYSTEMS
(2021)
Article
Automation & Control Systems
Zhihao Shen, Armagan Elibol, Nak Young Chong
Summary: This study addressed three main challenges in human-robot interaction, including fusion of different interaction modalities, integration of variable length feature vectors, and compensation for camera shake caused by robot movements. By extracting key visual and audio features and utilizing a multi-layer Hidden Markov Model, the classification accuracy of personality traits was improved, enhancing the communicative competence of social robots.
ROBOTICS AND AUTONOMOUS SYSTEMS
(2021)
Article
Engineering, Manufacturing
Haodong Chen, Ming C. Leu, Zhaozheng Yin
Summary: As artificial intelligence and industrial automation continue to advance, human-robot collaboration with advanced interaction capabilities is becoming increasingly important. This paper presents a real-time, multi-modal human-robot collaboration system using speech and gestures. Dynamic gestures are designed and recognized in real time using a convolutional neural network, enabling effective communication between humans and robots.
JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME
(2022)
Article
Robotics
Changzeng Fu, Chaoran Liu, Carlos Toshinori Ishi, Yuichiro Yoshikawa, Takamasa Iio, Hiroshi Ishiguro
Summary: This study uses an android robot as an intermediary to increase intra-group connectedness through daily conversations, enhancing familiarity and closeness among group members. Experimental results show that this method effectively enhances social connectedness, as well as improving the closeness of the user-robot relation and the performance of robots in conducting conversations with people.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2021)
Article
Chemistry, Analytical
Tomoki Ishikura, Yuki Kitamura, Wataru Sato, Jun Takamatsu, Akishige Yuguchi, Sung-Gwi Cho, Ming Ding, Sakiko Yoshikawa, Tsukasa Ogasawara
Summary: Pleasant touching is an important aspect of social interactions and previous research has attempted to develop robots that can provide this kind of touch. This study compared the effect of different stroke speeds on human participants' emotional responses to human and robot agents. The results showed that a speed of 8.5 cm/s was more pleasant and arousing for both human and robot strokes compared to a speed of 2.6 cm/s.
Article
Computer Science, Software Engineering
Ke Gu, Junfei Qiao, Xiongkuo Min, Guanghui Yue, Weisi Lin, Daniel Thalmann
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2018)
Article
Automation & Control Systems
Hui Liang, Junsong Yuan, Jun Lee, Liuhao Ge, Daniel Thalmann
IEEE TRANSACTIONS ON CYBERNETICS
(2019)
Article
Computer Science, Artificial Intelligence
Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann
IEEE TRANSACTIONS ON IMAGE PROCESSING
(2018)
Article
Computer Science, Artificial Intelligence
Ke Gu, Vinit Jakhetiya, Jun-Fei Qiao, Xiaoli Li, Weisi Lin, Daniel Thalmann
IEEE TRANSACTIONS ON IMAGE PROCESSING
(2018)
Article
Computer Science, Artificial Intelligence
Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
(2019)
Article
Computer Science, Software Engineering
Nisha Jain, Andrzej Wydra, Wen Hai, Nadia Magnenat Thalmann, Daniel Thalmann
Editorial Material
Computer Science, Software Engineering
Soraia Raupp Musse, Daniel Thalmann, Rafael Bidarra
COMPUTERS & GRAPHICS-UK
(2018)
Article
Multidisciplinary Sciences
Yasir Tahir, Zixu Yang, Debsubhra Chakraborty, Nadia Thalmann, Daniel Thalmann, Yogeswary Maniam, Nur Amirah Binte Abdul Rashid, Bhing-Leet Tan, Jimmy Lee Chee Keong, Justin Dauwels
Proceedings Paper
Computer Science, Software Engineering
Li Tian, Nadia Magnenat Thalmann, Daniel Thalmann, Zhiwen Fang, Jianmin Zheng
ADVANCES IN COMPUTER GRAPHICS, CGI 2019
(2019)
Proceedings Paper
Engineering, Electrical & Electronic
Shihao Xu, Zixu Yang, Debsubhra Chakraborty, Yasir Tahir, Tomasz Maszczyk, Victoria Yi Han Chua, Justin Dauwels, Daniel Thalmann, Nadia Magnenat, Thalmann Bhing-Leet Tan, Jimmy Lee Chee Keong
2018 IEEE 23RD INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP)
(2018)
Proceedings Paper
Computer Science, Theory & Methods
Daniel Thalmann, Nadia Magnenat Thalmann, Manoj Ramanathan
SA'17: SIGGRAPH ASIA 2017 COURSES
(2017)
Proceedings Paper
Computer Science, Artificial Intelligence
Hui Liang, Junhui Hou, Junsong Yuan, Daniel Thalmann
COMPUTER VISION - ACCV 2016, PT III
(2017)
Proceedings Paper
Engineering, Electrical & Electronic
Daniel Thalmann
FRONTIERS IN ELECTRONIC TECHNOLOGIES: TRENDS AND CHALLENGES
(2017)
Proceedings Paper
Computer Science, Artificial Intelligence
Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017)
(2017)
Proceedings Paper
Computer Science, Information Systems
Debsubhra Chakraborty, Yasir Tahir, Zixu Yang, Tomasz Maszczyk, Justin Dauwels, Daniel Thalmann, Nadia Magnenat Thalmann, Bhing-Leet Tan, Jimmy Lee
2017 IEEE 19TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP)
(2017)