Review
Chemistry, Multidisciplinary
Hedan Bai, Shuo Li, Robert F. Shepherd
Summary: The article explores the development and challenges of virtual and augmented reality technologies, particularly in the field of haptics. It suggests that soft robotics may offer potential solutions to overcome the difficulties in developing soft haptic output and input devices.
ADVANCED FUNCTIONAL MATERIALS
(2021)
Article
Computer Science, Theory & Methods
Carlos Bermejo, Pan Hui
Summary: Augmented reality applications have gained significant attention and growth in the mobile environment, enabled by advancements in smartphone hardware. However, the mobile nature of these applications can limit user interaction capabilities, particularly input and haptic feedback. This survey analyzes current research issues in human-computer interaction for haptic technologies in mobile augmented reality scenarios, focusing on wearable haptic devices and their possibilities in AR.
ACM COMPUTING SURVEYS
(2022)
Review
Psychology, Multidisciplinary
Matt C. Howard, Maggie M. Davis
Summary: Researchers have shown great interest in the creation of rehabilitation programs using mixed reality (MR), but there are still many unanswered questions. Meta-analysis and systematic literature review indicate that MR rehabilitation (MRR) programs significantly improve users' outcomes and are more effective than alternative rehabilitation programs. However, current research is still in the early stage and further development and improvement of study designs are needed.
COMPUTERS IN HUMAN BEHAVIOR
(2022)
Article
Computer Science, Software Engineering
Andre Zenner, Kristin Ullmann, Antonio Krueger
Summary: The study proposes the combination of Dynamic Passive Haptic Feedback (DPHF) and Haptic Retargeting techniques, demonstrating through experiments that this combination can better address the challenges of similarity and colocation in immersive haptic experiences.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2021)
Article
Computer Science, Information Systems
Jongkyu Shin, Kyogu Lee
Summary: This study investigates an alternative input method for virtual reality by incorporating a real-world object with augmented virtuality. A mobile phone is used as the real-world object and imported into the virtual environment to evaluate its potential as an input device. By overlaying the real texture of the phone and the user's hand onto a virtual scene in real-time using external cameras, the study aims to provide VR users with more flexibility in input methods and reduce the physical barrier between the reality and virtual environment.
MULTIMEDIA TOOLS AND APPLICATIONS
(2022)
Article
Computer Science, Information Systems
Yiming Liu, Chun Ki Yiu, Zhao Zhao, Shiyuan Liu, Xingcan Huang, Wooyoung Park, Jingyou Su, Jingkun Zhou, Tsz Hung Wong, Kuanming Yao, Ling Zhao, Ya Huang, Jiyu Li, Pu Fan, Binbin Zhang, Yuan Dai, Zhengbao Yang, Yuhang Li, Xinge Yu
Summary: The recent concept of metaverse emphasizes the importance of virtual reality (VR) and augmented reality (AR), which have various applications in entertainment, medical treatment, and human-machine interfaces. This article presents a wearable and flexible haptic interface based on electromagnetic vibrotactile actuators, which offer high wearability and stability. The actuators generate an enhanced electromagnetic field using double layers of copper (Cu) coils and the intensity of haptic feedback can be adjusted based on sensed pressure. The actuators demonstrate superior performance and applications compared to conventional haptic actuators when developed into soft VR interfaces for forearms, fingers, and hands.
IEEE INTERNET OF THINGS JOURNAL
(2023)
Review
Chemistry, Multidisciplinary
Eisha Imran, Necdet Adanir, Zohaib Khurshid
Summary: The use of haptic and virtual reality technologies in dental education has revolutionized teaching methods by allowing students to interact with digital simulations to learn treatment skills and gain confidence. This approach also aids in material conservation, teacher-controlled student assessments, and creating a safe learning environment for participants.
APPLIED SCIENCES-BASEL
(2021)
Article
Surgery
Margaret Siu, Kaitlin Debbink, Amanda Duda, George Orthopoulos, John Romanelli, Jacqueline Wu, Neal E. Seymour
Summary: This study compares the skills of experienced laparoscopic surgeons using virtual reality simulators with and without haptic feedback. The results show that using a simulator with haptic feedback leads to higher accuracy, more efficient instrument motion, and avoidance of excessive traction force.
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES
(2023)
Article
Surgery
Margaret Siu, Kaitlin Debbink, Amanda Duda, George Orthopoulos, John Romanelli, Jacqueline Wu, Neal E. Seymour
Summary: This study aimed to compare the skills characteristics of expert laparoscopists using VR laparoscopic tasks delivered through haptic and nonhaptic interfaces. The results showed that using a VR simulator with haptic feedback improved accuracy, efficiency of instrument motion, and avoidance of excessive traction force. However, this study did not demonstrate an advantage in skills acquisition with haptic feedback.
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES
(2023)
Review
Chemistry, Multidisciplinary
Tae-Heon Yang, Jin Ryong Kim, Hanbit Jin, Hyunjae Gil, Jeong-Hoi Koo, Hye Jin Kim
Summary: Tele-haptics technology is emerging as a future of the VR/AR industry, enabling human-to-human interactions beyond traditional VR/AR interactions. Active materials play a significant role in haptic innovations, addressing the needs and challenges for current and future VR/AR technologies.
ADVANCED FUNCTIONAL MATERIALS
(2021)
Article
Computer Science, Software Engineering
Huidong Bai, Li Zhang, Jing Yang, Mark Billinghurst
Summary: The paper discusses a novel Augmented Virtuality (AV) interface that allows users to interact with a mobile phone in a virtual environment, but the experiment showed that using AV interfaces in VR was more difficult than regular smartphone touch interaction, with increased workload and lower system usability.
COMPUTERS & GRAPHICS-UK
(2021)
Article
Computer Science, Cybernetics
Zhenxing Li, Maria Kiiveri, Jussi Rantala, Roope Raisamo
Summary: This study proposed two haptic VR interfaces for medical diagnosis and planning. The kinesthetic VR interface performed best in terms of marking accuracy, while the vibrotactile VR interface performed best in terms of task completion time. Participants preferred to use the kinesthetic VR interface for the medical task.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2021)
Article
Education & Educational Research
Mary Webb, Megan Tracey, William Harwin, Ozan Tokatli, Faustina Hwang, Ros Johnson, Natasha Barrett, Chris Jones
Summary: The study designed and developed a multi-fingered haptic interface along with a 3D virtual model of a cell membrane for collaborative learning of cell biology among students aged 12 to 13. Results showed that immersion in the 3D VR environment, combined with the ability to feel structures and movements within the model, facilitated learning and collaboration. The pilot/co-pilot model was successful in enabling collaborative learning and overcoming the isolating effects of using a 3D headset.
EDUCATION AND INFORMATION TECHNOLOGIES
(2022)
Review
Computer Science, Interdisciplinary Applications
Shaveta Dargan, Shally Bansal, Munish Kumar, Ajay Mittal, Krishan Kumar
Summary: Augmented Reality (AR) is a technology that modifies the perception of real-world images by overlaying digital data on them. It has diverse applications in various fields and is distinct from virtual reality.
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING
(2023)
Article
Chemistry, Multidisciplinary
Hojoong Kim, Young-Tae Kwon, Hyo-Ryoung Lim, Jong-Hoon Kim, Yun-Soung Kim, Woon-Hong Yeo
Summary: This report highlights the recent advancements in multifunctional wearable sensors and integrated functional devices for VR/AR applications, emphasizing the importance of enhanced sensor functions and seamless integration for more natural interactions with the virtual world.
ADVANCED FUNCTIONAL MATERIALS
(2021)
Article
Engineering, Manufacturing
J. Ernesto Solanes, Luis Gracia, Pau Munoz-Benavent, Jaime Valls Miro, Carlos Perez-Vidal, Josep Tornero
JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME
(2019)
Article
Engineering, Manufacturing
Adolfo Munoz, Ana Marti, Xavier Mahiques, Luis Gracia, J. Ernesto Solanes, Josep Tornero
CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY
(2020)
Article
Automation & Control Systems
J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Ana Marti, Vicent Girbes-Juan, Josep Tornero
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY
(2020)
Article
Computer Science, Interdisciplinary Applications
Alberto Garcia, Luis Gracia, J. Ernesto Solanes, Vicent Girbes-Juan, Carlos Perez-Vidal, Josep Tornero
Summary: This study has developed a method for true cooperation between human operators and robotic systems for precise surface treatment of workpieces. The human operator provides flexibility, while the robot system provides strength, accuracy, and security. An automatic operation is activated when the user is not guiding the robot tool, and a camera network is used for real-time global view of the robot workspace and workpiece location.
COMPUTERS & INDUSTRIAL ENGINEERING
(2021)
Article
Computer Science, Interdisciplinary Applications
J. Ernesto Solanes, Pau Munoz-Benavent, Leopoldo Armesto, Luis Gracia, Josep Tornero
Summary: This paper presents the application of the Dual Rate Dual Sampling Reference Filtering Control Strategy to 2D and 3D visual feedback control, effectively addressing sensor latency and control task failure caused by visual features leaving the camera field of view. By utilizing a Dual Rate Kalman Filter and Extended Kalman Filter Smoother, improvement in solution reachability, robustness, and time domain response of the system is achieved. The proposed control strategy is validated on an industrial system with real-time constraints, demonstrating its effectiveness in enhancing visual feedback control performance.
INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING
(2022)
Article
Automation & Control Systems
Alberto Garcia, J. Ernesto Solanes, Luis Gracia, Pau Munoz-Benavent, Vicent Girbes-Juan, Josep Tornero
Summary: This work introduces a method for surface treatment tasks using a bimanual robotic system, with one arm holding the workpiece and the other arm operating the treatment tool under human teleoperation. The method employs force sensors and constraints to ensure safe and effective task completion, demonstrating feasibility through experimental results.
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE
(2022)
Article
Computer Science, Artificial Intelligence
Vicent Girbes-Juan, Vinicius Schettino, Luis Gracia, J. Ernesto Solanes, Yiannis Demiris, Josep Tornero
Summary: This paper presents a multi-modal teleoperation system that combines haptics and an inertial motion capture system, which improves task performance and efficiency through haptic and visual feedback, as well as a flexible and maneuverable robot.
JOURNAL ON MULTIMODAL USER INTERFACES
(2022)
Article
Computer Science, Information Systems
Ana Marti-Teston, Adolfo Munoz, J. Ernesto Solanes, Luis Gracia, Josep Tornero
Summary: The use of technology in museums has evolved to provide immersive experiences, with the emergence of augmented-reality glasses offering new opportunities for development. However, many initial projects have not fully utilized the potential of this technology.
Article
Chemistry, Multidisciplinary
Alberto Garcia, J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Josep Tornero
Summary: This paper proposes a novel augmented reality-based interface for teleoperating bimanual robots, which is more natural to the user and reduces the interface learning process. The effectiveness of the proposed interface is demonstrated through experiments, and the drawbacks and limitations of the traditional teleoperation interface are analyzed.
APPLIED SCIENCES-BASEL
(2022)
Article
Chemistry, Multidisciplinary
J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Josep Tornero
Summary: This work proposes a new interface for teleoperation of mobile robots based on virtual reality, allowing natural and intuitive interaction and cooperation between humans and robots. The effectiveness of the proposed method is demonstrated through experimentation, and usability and presence questionnaires show the advantages of the approach in terms of intuitiveness and ergonomics.
APPLIED SCIENCES-BASEL
(2022)
Article
Automation & Control Systems
Jorge Borrell, Alejandra Gonzalez, Carlos Perez-Vidal, Luis Gracia, J. Ernesto Solanes
Summary: A patina is the aged appearance that leather develops over time, which can also be artificially created through specific products. Manual finishing operations on objects require skilled artisans and present challenges for automation. This research presents a new method using cooperative robotics for automatic and semi-automatic shoe patina growing in the footwear industry. The implemented system saves operator time without compromising the quality of the finishing work.
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY
(2023)
Article
Computer Science, Interdisciplinary Applications
Alejandra Gonzalez, Carlos Perez-Vidal, Jorge Borrell, J. Ernesto Solanes, Luis Gracia
Summary: This research introduces a new method for automating the creation of patina on leather footwear using collaborative robots. The solution involves designing and implementing a collaborative tool specifically created to cultivate a patina finish on shoe surfaces, aiming to speed up the process without compromising the quality of the finished product.
INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING
(2023)
Article
Chemistry, Multidisciplinary
Ana Marti-Teston, Adolfo Munoz, Luis Gracia, J. Ernesto Solanes
Summary: In recent years, there has been a rise in Metaverse applications and tools, particularly in the tourism sector. However, major corporations have faced criticism for their marketing of the Metaverse concept. On the other hand, smaller entities like Spatial-io offer a more accessible and innovative approach to the Metaverse, catering to contemporary devices and platforms.
APPLIED SCIENCES-BASEL
(2023)
Article
Computer Science, Information Systems
Alberto Garcia, Vicent Girbes-Juan, J. Ernesto Solanes, Luis Gracia, Carlos Perez-Vidal, Josep Tornero
Article
Engineering, Industrial
Xiaoliang Yan, Reed Williams, Elena Arvanitis, Shreyes Melkote
Summary: This paper extends prior work by developing a semantic segmentation approach for machinable volume decomposition using pre-trained generative process capability models, providing manufacturability feedback and labels of candidate machining operations for query 3D parts.
JOURNAL OF MANUFACTURING SYSTEMS
(2024)
Article
Engineering, Industrial
Jing Huang, Zhifen Zhang, Rui Qin, Yanlong Yu, Guangrui Wen, Wei Cheng, Xuefeng Chen
Summary: In this study, a deep learning framework that combines interpretability and feature fusion is proposed for real-time monitoring of pipeline leaks. The proposed method extracts abstract feature details of leak acoustic emission signals through multi-level dynamic receptive fields and optimizes the learning process of the network using a feature fusion module. Experimental results show that the proposed method can effectively extract distinguishing features of leak acoustic emission signals, achieving higher recognition accuracy compared to typical deep learning methods. Additionally, feature map visualization demonstrates the physical interpretability of the proposed method in abstract feature extraction.
JOURNAL OF MANUFACTURING SYSTEMS
(2024)
