Article
Automation & Control Systems
Zecai Lin, Zheng Xu, Huanghua Liu, Xuyang Wang, Xiaojie Ai, Cheng Zhou, Bidan Huang, Weidong Chen, Guang-Zhong Yang, Anzhu Gao
Summary: Robotic telemedicine can provide timely treatment to critical patients in geographically remote locations. However, the lack of depth information, occlusion of instrument, and view direction limitations affect the visual feedback from patient to clinician, thus impacting surgical safety. To solve this problem, an omnidirectional augmented reality (AR)-assisted robotic telepresence for interventional medicine is developed, which integrates AR, virtual reality (VR), and endoscopic views to provide intuitive visual feedback.
ADVANCED INTELLIGENT SYSTEMS
(2023)
Article
Engineering, Mechanical
Janos Simon, Laszlo Gogolak, Jozsef Sarosi, Igor Furstner
Summary: This paper focuses on implementing AR-based maintenance approaches using Industry 4.0 technology. The objective is to highlight the benefits of AR in maintenance and provide a framework for implementing AR-based maintenance systems. AR can assist maintenance personnel by providing real-time instructions and information, improving the quality of work and reducing human errors. The proposed application utilizes AR and telepresence technologies to provide motorcycle service assistance, including remote monitoring, automated part identification, 3D modeling, and parts ordering.
Article
Chemistry, Analytical
Le Luo, Dongdong Weng, Jie Hao, Ziqi Tu, Haiyan Jiang
Summary: This paper proposes a telepresence system with viewpoint control, which uses a robotic arm equipped with a stereo camera to present the local environment to remote users wearing VR headsets. The system allows remote users to actively and flexibly observe the local environment by moving their heads to manipulate the robotic arm. To overcome the limited field of view and movement range of the robotic arm, a 3D reconstruction method and a stereo video field-of-view enhancement technique are proposed.
Article
Robotics
Ziyuan Liu, Wei Liu, Yuzhe Qin, Fanbo Xiang, Minghao Gou, Songyan Xin, Maximo A. Roa, Berk Calli, Hao Su, Yu Sun, Ping Tan
Summary: This paper proposes a cloud-based benchmark for robotic grasping and manipulation, called the OCRTOC benchmark. It introduces the features and usage of the benchmark, including remote experiments and standardized scenarios, to facilitate reproducible research and fair comparisons in the field. The paper also presents the results and observations of the 2020 OCRTOC competition, along with adjustments and improvements for the upcoming 2021 competition.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2022)
Article
Engineering, Biomedical
Zecai Lin, Tianxue Zhang, Zhenglong Sun, Hongyan Gao, Xiaojie Ai, Weidong Chen, Guang-Zhong Yang, Anzhu Gao
Summary: Robotic telemedicine has high potential in future medicine by enabling timely treatment for critical patients in remote locations and reducing infection risks during pandemics. However, the lack of depth information, occlusion, and viewing angles makes visual feedback from the patient's side to the clinician's side often unintuitive. This paper proposes a robotic telepresence method based on augmented reality and human motion mapping, using an optical see-through head-mounted display (OSTHMD) to provide different views for clinicians to see through key anatomies and instruments inside the patient's body.
IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS
(2022)
Article
Computer Science, Information Systems
Zhenning Zhang, Zichen Li, Meng Han, Zhiyong Su, Weiqing Li, Zhigeng Pan
Summary: Researchers have proposed a multimedia environment based on augmented reality technology to enhance the participation of AR technology in educational activities. This environment includes AR experiment authoring tool, AR experiment application, and management application, providing real-time evaluation and remote guidance to students.
MULTIMEDIA TOOLS AND APPLICATIONS
(2021)
Article
Chemistry, Multidisciplinary
Dimitris Mourtzis, John Angelopoulos, Nikos Panopoulos
Summary: This research proposes a closed-loop framework for the development of human-robot interfaces based on digital technologies, aiming to achieve seamless collaboration and safe operation between human operators and robotic manipulators. The framework utilizes Mixed Reality (MR) technology to display safety zones and enables remote manipulation of the robotic arm. The method is developed using ROS for modeling, a Cloud database for data handling, and MR for human-machine interface.
APPLIED SCIENCES-BASEL
(2022)
Article
Construction & Building Technology
Shaoze Wu, Lei Hou, Haosen Chen, Guomin (Kevin) Zhang, Yang Zou, Quddus Tushar
Summary: There is a growing interest in using wearable Augmented Reality (AR) devices to improve the task performance of construction workers. This study introduces cognitive ergonomics theory to design and develop a customized and user-friendly AR application. The experiment results indicate that the application can enhance the skill development and kinaesthetic performance of construction workers, promoting the uptake of wearable AR in the construction industry.
AUTOMATION IN CONSTRUCTION
(2023)
Article
Business
Jeong Bin Whang, Ji Hee Song, Boreum Choi, Jong-Ho Lee
Summary: This study explores the relationship between augmented reality experience and purchase intention through the lens of consumer control, finding that cognitive control is a key factor influencing purchase intention. Additionally, the study reveals that peer opinions can affect cognitive control, which indirectly impacts purchase intention.
JOURNAL OF BUSINESS RESEARCH
(2021)
Article
Physics, Multidisciplinary
Yunpeng Liu, Tao Jing, Qiang Qu, Ping Zhang, Pei Li, Qian Yang, Xiaoyu Jiang, Xingpeng Yan
Summary: This paper proposes an augmented reality-holographic stereogram based on 3D reconstruction, which successfully achieves the fusion display of real and virtual scenes.
FRONTIERS IN PHYSICS
(2022)
Article
Computer Science, Artificial Intelligence
Zhenshan Bing, Matthias Brucker, Fabrice O. Morin, Rui Li, Xiaojie Su, Kai Huang, Alois Knoll
Summary: Reinforcement learning algorithms such as HER and HGG have been successful in solving challenging robotic manipulation tasks, with HGG enhancing HER performance by selecting intermediate goals. However, the original HGG is not applicable to tasks with obstacles, highlighting the need for a more feasible method to automatically solve such tasks.
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
(2022)
Article
Automation & Control Systems
Zhimin Hou, Wenhao Yang, Rui Chen, Pingfa Feng, Jing Xu
Summary: This study proposes a hierarchical compliance-based contextual policy search approach for learning robotic compliant skills in contact-rich manipulation tasks. It utilizes a parameterized impedance-conditioned action space for lower-level policy and a linear Gaussian contextual policy for higher-level optimization. Data efficiency is improved through a variation encoder-decoder model and a composite forward model. The approach is validated in simulated and real-world tasks, demonstrating its effectiveness.
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS
(2023)
Article
Computer Science, Cybernetics
Wanting Mao, Yaoguang Hu, Xiaonan Yang, Weibo Ren, Haonan Fang
Summary: This paper proposes an augmented reality-based ergonomic evaluation platform for assessing the level of risk to workers' bodies during operations in smart manufacturing systems. The platform reduces verification time and economic cost, and provides rapid response for ergonomic evaluation and feedback in the context of smart manufacturing.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2023)
Article
Computer Science, Software Engineering
Xuanyu Wang, Hui Ye, Christian Sandor, Weizhan Zhang, Hongbo Fu
Summary: Transition delays in avatar telepresence can have negative effects, but a Predict-and-Drive controller can help reduce delay and ensure smooth transitions. Introducing a grouping component can also eliminate delay by immediately calculating a coarse virtual target.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2022)
Article
Computer Science, Software Engineering
Boram Yoon, Jae-eun Shin, Hyung-il Kim, Seo Young Oh, Dooyoung Kim, Woontack Woo
Summary: This study compared the effects of avatars with different transparency levels on the social presence of users in task-centric MR remote collaboration in AR and VR. Results showed that avatars with a strong visual presence are not necessary when task completion is prioritized over social interaction. However, AR users preferred more vivid avatars than VR users.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2023)
