Article
Engineering, Industrial
Michela Dalle Mura, Gino Dini
Summary: One major challenge in automotive assembly is aligning car panels within specified tolerances for the bodywork. Augmented Reality (AR) is identified as a promising tool to guide workers and reduce errors and time in assembly tasks. This study introduces an AR prototype system to assist operators in panel fitting operations and presents a real case study on aligning car body panels with the front light projector.
JOURNAL OF MANUFACTURING SYSTEMS
(2021)
Review
Food Science & Technology
Jackey J. K. Chai, Carol O'Sullivan, Aoife A. Gowen, Brendan Rooney, Jun-Li Xu
Summary: This article investigated the application of augmented/mixed reality (AR/MR) in the food industry, revealing its multidisciplinary nature and identifying limitations and challenges. The research showed that AR/MR technology is widely used in areas such as dietary assessment, food nutrition and traceability, food sensory science, retail food chain applications, food education and learning, and precision farming.
TRENDS IN FOOD SCIENCE & TECHNOLOGY
(2022)
Review
Psychology, Multidisciplinary
Matt C. Howard, Maggie M. Davis
Summary: Researchers have shown great interest in the creation of rehabilitation programs using mixed reality (MR), but there are still many unanswered questions. Meta-analysis and systematic literature review indicate that MR rehabilitation (MRR) programs significantly improve users' outcomes and are more effective than alternative rehabilitation programs. However, current research is still in the early stage and further development and improvement of study designs are needed.
COMPUTERS IN HUMAN BEHAVIOR
(2022)
Article
Chemistry, Analytical
Yongjun Kim, Yung-Cheol Byun
Summary: This research aims to enhance the design of an AR-based participatory business card information system, which includes acquiring contextual information from paper business cards and transmitting it to mobile devices through a server. It also facilitates interactivity between users and content through a screen interface and provides multimedia business content via image markers recognized by users. The AR business card system designed in this research incorporates visual information and interactive elements, enriching users' overall experience while adhering to strict quality control measures.
Review
Chemistry, Multidisciplinary
Chongyu Zhu, Yao Lu, Lixin Jiang, Yanlei Yu
Summary: Liquid crystals (LCs) are soft and intelligent materials that can adjust their properties in response to external stimuli, making them ideal for constructing soft actuators and robots. By combining LC actuators and robots with virtual reality and augmented reality technologies, a new world of mixed reality (MR) with multi-sensory interaction can be created. The development of LC actuators and robots is expected to accelerate the practical application of MR technology.
ADVANCED FUNCTIONAL MATERIALS
(2021)
Article
Computer Science, Artificial Intelligence
Huiyu Duan, Xiongkuo Min, Yucheng Zhu, Guangtao Zhai, Xiaokang Yang, Patrick Le Callet
Summary: With the development of multimedia technology, Augmented Reality (AR) has emerged as a promising next-generation mobile platform. However, there is a lack of studies on how the fusion of digital contents and real-world environments in AR will affect the Quality of Experience (QoE). This paper introduces the theory of visual confusion and proposes a model and metric for evaluating the perceptual quality of superimposed images in AR.
IEEE TRANSACTIONS ON IMAGE PROCESSING
(2022)
Article
Multidisciplinary Sciences
Oskari Pakari, Ricardo Lopez, Ivan Druckman, Emilee Meng, Erik Zhou, Ziang Wang, Shaun D. Clarke, Sara A. Pozzi
Summary: This article demonstrates the real-time visualization of gamma ray and neutron radiation detector data in mixed reality (MR) using Microsoft HoloLens 2 smart glasses, reducing the interpretation burden. By combining a state-of-the-art dual particle imaging system with HoloLens 2, the data is displayed directly to the user through the head-mounted MR smart glasses, providing an overlay of directional information to the user's 3D visual experience.
SCIENTIFIC REPORTS
(2023)
Review
Medicine, General & Internal
Tadatsugu Morimoto, Takaomi Kobayashi, Hirohito Hirata, Koji Otani, Maki Sugimoto, Masatsugu Tsukamoto, Tomohito Yoshihara, Masaya Ueno, Masaaki Mawatari
Summary: In recent years, the use of XR technology in spine medicine has become increasingly popular, driven by the rapid advancement of virtual reality, augmented reality, mixed reality, and extended reality technology, as well as the wave of digital transformation and the impact of the COVID-19 pandemic. XR technology has been applied in various aspects of spine medicine, including surgery, consultation, education, and rehabilitation.
JOURNAL OF CLINICAL MEDICINE
(2022)
Article
Engineering, Multidisciplinary
Quercus Hernandez, Alberto Badias, Francisco Chinesta, Elias Cueto
Summary: This research presents a method for computing the dynamic response of deformable objects induced by user interactions in mixed reality using deep learning. The graph-based architecture ensures thermodynamic consistency, while the visualization pipeline provides a realistic user experience. Two examples of virtual solids interacting with virtual or physical solids in mixed reality scenarios are provided to demonstrate the method's performance.
COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING
(2023)
Review
Chemistry, Multidisciplinary
Rosanna Maria Viglialoro, Sara Condino, Giuseppe Turini, Marina Carbone, Vincenzo Ferrari, Marco Gesi
Summary: Simulation-based medical training using AR, MR, and hybrid approaches offers an effective tool for technical skill acquisition. Most studies reviewed focus on custom-made simulators, with varying combinations and classifications of approaches. However, there is a need for further research to validate existing simulators and assess their impact on real patient outcomes beyond feasibility and preliminary validation assessments.
APPLIED SCIENCES-BASEL
(2021)
Review
Computer Science, Information Systems
Cinthya Lourdes Toledo-Peral, Gabriel Vega-Martinez, Jorge Airy Mercado-Gutierrez, Gerardo Rodriguez-Reyes, Arturo Vera-Hernandez, Lorenzo Leija-Salas, Josefina Gutierrez-Martinez
Summary: This article conducts a systematic literature review to explore the applications of virtual reality (VR) and augmented reality (AR) in rehabilitation therapy, with a focus on the use of surface electromyography (sEMG) signals for control and feedback. The study finds that while there is still limited research in this area, the applications are diverse, including neurological motor rehabilitation and prosthesis training. However, there is currently no consensus on signal processing and classification criteria.
Article
Engineering, Electrical & Electronic
Hung-Jui Guo, Jonathan Z. Bakdash, Laura R. Marusich, Balakrishnan Prabhakaran
Summary: This article surveys environmental-related HMD papers with measurements from users in the field of AR and MR, reviewing the results from a 32-year span. Using a new classification method, trends over time and user feedback presence or absence are analyzed, along with subdivision of the papers into ten main categories for user assessment domains and methods. Similarities and differences among the papers' characteristics in behavioral experiments are also categorized.
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT
(2022)
Article
Chemistry, Multidisciplinary
Phuong Thao Ho, Jose Antonio Albajez, Jorge Santolaria, Jose A. Yague-Fabra
Summary: This paper conducts a systematic literature review on the application of AR technology in the quality sector in an industry 4.0 context. It identifies three main categories of AR-based solutions for quality sector and improves an AR architecture layer framework for the development of long-term AR-based solutions in the future.
APPLIED SCIENCES-BASEL
(2022)
Article
Computer Science, Information Systems
Luis Fernando de Souza Cardoso, Bruno Yuji Lino Kimura, Ezequiel Roberto Zorzal
Summary: This article evaluates the impact of 5G and beyond mobile networks on AR/MR technology by surveying four digital libraries. The results describe the current state of mobile AR/MR applications, as well as the benefits and challenges of the technology. Lastly, a roadmap for the development of AR/MR hardware and software supported by future mobile networks is proposed.
MULTIMEDIA TOOLS AND APPLICATIONS
(2023)
Article
Engineering, Aerospace
Shirley Holt
Summary: Virtual reality (VR), augmented reality (AR), and mixed reality (MR) can create a sense of presence in virtual environments. This research explores the potential of VR/AR/MR in creating human connection and experience for astronaut mental health during space missions and for space tourism, education, and outreach purposes.
Article
Engineering, Manufacturing
Adolfo Munoz, Ana Marti, Xavier Mahiques, Luis Gracia, J. Ernesto Solanes, Josep Tornero
CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY
(2020)
Article
Automation & Control Systems
J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Ana Marti, Vicent Girbes-Juan, Josep Tornero
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY
(2020)
Article
Computer Science, Interdisciplinary Applications
Alberto Garcia, Luis Gracia, J. Ernesto Solanes, Vicent Girbes-Juan, Carlos Perez-Vidal, Josep Tornero
Summary: This study has developed a method for true cooperation between human operators and robotic systems for precise surface treatment of workpieces. The human operator provides flexibility, while the robot system provides strength, accuracy, and security. An automatic operation is activated when the user is not guiding the robot tool, and a camera network is used for real-time global view of the robot workspace and workpiece location.
COMPUTERS & INDUSTRIAL ENGINEERING
(2021)
Article
Engineering, Industrial
Claudia Gonzalez, J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Vicent Girbes-Juan, Josep Tornero
Summary: This study introduces an advanced teleoperation and control system for industrial robots to assist human operators in performing complex surface treatment tasks, providing strength, accuracy, security, and comfort. This system utilizes augmented virtuality and haptic feedback to offer an immersive virtual experience for remote operation of the robot tool. The effectiveness of the proposed approach is demonstrated through experiments and comparison with manual expert performance.
JOURNAL OF MANUFACTURING SYSTEMS
(2021)
Article
Computer Science, Interdisciplinary Applications
J. Ernesto Solanes, Pau Munoz-Benavent, Leopoldo Armesto, Luis Gracia, Josep Tornero
Summary: This paper presents the application of the Dual Rate Dual Sampling Reference Filtering Control Strategy to 2D and 3D visual feedback control, effectively addressing sensor latency and control task failure caused by visual features leaving the camera field of view. By utilizing a Dual Rate Kalman Filter and Extended Kalman Filter Smoother, improvement in solution reachability, robustness, and time domain response of the system is achieved. The proposed control strategy is validated on an industrial system with real-time constraints, demonstrating its effectiveness in enhancing visual feedback control performance.
INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING
(2022)
Article
Automation & Control Systems
Alberto Garcia, J. Ernesto Solanes, Luis Gracia, Pau Munoz-Benavent, Vicent Girbes-Juan, Josep Tornero
Summary: This work introduces a method for surface treatment tasks using a bimanual robotic system, with one arm holding the workpiece and the other arm operating the treatment tool under human teleoperation. The method employs force sensors and constraints to ensure safe and effective task completion, demonstrating feasibility through experimental results.
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE
(2022)
Article
Computer Science, Artificial Intelligence
Vicent Girbes-Juan, Vinicius Schettino, Luis Gracia, J. Ernesto Solanes, Yiannis Demiris, Josep Tornero
Summary: This paper presents a multi-modal teleoperation system that combines haptics and an inertial motion capture system, which improves task performance and efficiency through haptic and visual feedback, as well as a flexible and maneuverable robot.
JOURNAL ON MULTIMODAL USER INTERFACES
(2022)
Article
Computer Science, Information Systems
Ana Marti-Teston, Adolfo Munoz, J. Ernesto Solanes, Luis Gracia, Josep Tornero
Summary: The use of technology in museums has evolved to provide immersive experiences, with the emergence of augmented-reality glasses offering new opportunities for development. However, many initial projects have not fully utilized the potential of this technology.
Article
Chemistry, Multidisciplinary
Alberto Garcia, J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Josep Tornero
Summary: This paper proposes a novel augmented reality-based interface for teleoperating bimanual robots, which is more natural to the user and reduces the interface learning process. The effectiveness of the proposed interface is demonstrated through experiments, and the drawbacks and limitations of the traditional teleoperation interface are analyzed.
APPLIED SCIENCES-BASEL
(2022)
Article
Chemistry, Multidisciplinary
J. Ernesto Solanes, Adolfo Munoz, Luis Gracia, Josep Tornero
Summary: This work proposes a new interface for teleoperation of mobile robots based on virtual reality, allowing natural and intuitive interaction and cooperation between humans and robots. The effectiveness of the proposed method is demonstrated through experimentation, and usability and presence questionnaires show the advantages of the approach in terms of intuitiveness and ergonomics.
APPLIED SCIENCES-BASEL
(2022)
Article
Automation & Control Systems
Jorge Borrell, Alejandra Gonzalez, Carlos Perez-Vidal, Luis Gracia, J. Ernesto Solanes
Summary: A patina is the aged appearance that leather develops over time, which can also be artificially created through specific products. Manual finishing operations on objects require skilled artisans and present challenges for automation. This research presents a new method using cooperative robotics for automatic and semi-automatic shoe patina growing in the footwear industry. The implemented system saves operator time without compromising the quality of the finishing work.
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY
(2023)
Article
Computer Science, Interdisciplinary Applications
Alejandra Gonzalez, Carlos Perez-Vidal, Jorge Borrell, J. Ernesto Solanes, Luis Gracia
Summary: This research introduces a new method for automating the creation of patina on leather footwear using collaborative robots. The solution involves designing and implementing a collaborative tool specifically created to cultivate a patina finish on shoe surfaces, aiming to speed up the process without compromising the quality of the finished product.
INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING
(2023)
Article
Chemistry, Multidisciplinary
Ana Marti-Teston, Adolfo Munoz, Luis Gracia, J. Ernesto Solanes
Summary: In recent years, there has been a rise in Metaverse applications and tools, particularly in the tourism sector. However, major corporations have faced criticism for their marketing of the Metaverse concept. On the other hand, smaller entities like Spatial-io offer a more accessible and innovative approach to the Metaverse, catering to contemporary devices and platforms.
APPLIED SCIENCES-BASEL
(2023)
Article
Engineering, Industrial
Xiaoliang Yan, Reed Williams, Elena Arvanitis, Shreyes Melkote
Summary: This paper extends prior work by developing a semantic segmentation approach for machinable volume decomposition using pre-trained generative process capability models, providing manufacturability feedback and labels of candidate machining operations for query 3D parts.
JOURNAL OF MANUFACTURING SYSTEMS
(2024)
Article
Engineering, Industrial
Jing Huang, Zhifen Zhang, Rui Qin, Yanlong Yu, Guangrui Wen, Wei Cheng, Xuefeng Chen
Summary: In this study, a deep learning framework that combines interpretability and feature fusion is proposed for real-time monitoring of pipeline leaks. The proposed method extracts abstract feature details of leak acoustic emission signals through multi-level dynamic receptive fields and optimizes the learning process of the network using a feature fusion module. Experimental results show that the proposed method can effectively extract distinguishing features of leak acoustic emission signals, achieving higher recognition accuracy compared to typical deep learning methods. Additionally, feature map visualization demonstrates the physical interpretability of the proposed method in abstract feature extraction.
JOURNAL OF MANUFACTURING SYSTEMS
(2024)