Article
Computer Science, Artificial Intelligence
Inigo Fernandez del Amo, John Ahmet Erkoyuncu, Maryam Farsi, Dedy Ariansyah
Summary: This paper proposes dynamic authoring and hybrid recommender methods for accurate AR-based reporting in maintenance operations. Experimental results show that the proposed methods can improve the efficiency and effectiveness of reporting tasks.
KNOWLEDGE-BASED SYSTEMS
(2022)
Article
Computer Science, Software Engineering
Sara Romano, Enricoandrea Laviola, Michele Gattullo, Michele Fiorentino, Antonio Emmanuele Uva
Summary: This article addresses the challenges of content creation and management in Augmented Reality by providing design guidelines for the localization of in-view and not occluded components. Two user studies were conducted to validate the effectiveness of designing optimized auxiliary models based on the component shapes.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2023)
Review
Computer Science, Cybernetics
Floris van den Oever, Morten Fjeld, Bjorn Saetrevik
Summary: Augmented Reality (AR) has the potential to enhance maritime collaboration by improving situation awareness and decision-making. However, the specific ways in which AR can be beneficial in maritime operations are still unclear. This paper conducts a systematic literature review to explore state-of-the-art AR applications in maritime collaboration. The findings highlight the applications of AR in ship navigation, personal navigation, maritime construction, maritime maintenance and inspection, among others. The authors suggest further research focusing on advancing promising AR applications, learning from other industries, adopting robust evaluation methods, and considering human factors such as decision-making, situation awareness, and communication.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2023)
Article
Computer Science, Information Systems
Riccardo Palmarini, Inigo Fernandez Del Amo, Dedy Ariansyah, Samir Khan, John Ahmet Erkoyuncu, Rajkumar Roy
Summary: Augmented Reality (AR) has great potential in improving maintenance operations, but research is still in its early stages due to limitations in hardware capabilities, object recognition robustness, and content-related issues. This article proposes a new geometry-based method called Fast Augmented Reality Authoring (FARA) for creating step-by-step AR procedures for maintenance activities. Testing FARA with over 30 participants showed an average time saving of 34.7% and an error reduction of 68.6% compared to traditional hard-copy manuals.
Article
Computer Science, Cybernetics
Feederico Morosi, Iacopo Carli, Giandomenico Caruso, Gaetano Cascini, Elies Dekoninck, Jean-Francois Boujut
Summary: The users' acceptance of innovative product appearance authoring tools based on Spatial Augmented Reality (SAR) is limited due to perceived high technology complexity and low performance of current interaction systems. This study proposes and validates three UI configurations to improve user experience, showing comparable accuracy, efficiency, and perceived usability.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2021)
Article
Computer Science, Interdisciplinary Applications
Enrui Liu, Su Cai, Zifeng Liu, Changhao Liu
Summary: This study designed and developed an augmented reality learning resource authoring tool called WebART to assist teachers in creating and sharing AR learning resources without prior programming experience. Feedback and opinions on WebART were collected from 51 K-12 teachers through questionnaires and interviews. The results showed that there is a relationship between teachers' intentions to use technology and the user experience of the proposed WebART tool.
IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES
(2023)
Article
Chemistry, Analytical
Jehn-Ruey Jiang, Hanas Subakti
Summary: This paper proposes an indoor location-based augmented reality framework (ILARF) for the development of indoor AR systems. ILARF integrates an indoor localization unit, a secure context-aware message exchange unit, and an AR visualization and interaction unit. The ILARF prototype app, GAR, helps gym users locate equipment, provides usage instructions, and enables socialization. It outperforms other AR systems by offering more information and desirable properties such as secure communication and a 3D graphical user interface.
Article
Engineering, Mechanical
Janos Simon, Laszlo Gogolak, Jozsef Sarosi, Igor Furstner
Summary: This paper focuses on implementing AR-based maintenance approaches using Industry 4.0 technology. The objective is to highlight the benefits of AR in maintenance and provide a framework for implementing AR-based maintenance systems. AR can assist maintenance personnel by providing real-time instructions and information, improving the quality of work and reducing human errors. The proposed application utilizes AR and telepresence technologies to provide motorcycle service assistance, including remote monitoring, automated part identification, 3D modeling, and parts ordering.
Article
Chemistry, Multidisciplinary
Gahyeon Kim, Mankyu Sung
Summary: CoR-SketchAR is an augmented reality (AR) environment authoring tool that allows real-time collaboration using dry-erase markers. It enables users to place and modify 3D virtual objects in specific locations. Unlike marker-based techniques, CoR-SketchAR uses sketches drawn with dry-erase markers to create an urban AR environment, automatically recognizing shapes and colors to overlay virtual objects. By altering sketches, the system can create a wide variety of dynamic urban environments. Experiments show that users prefer sketch-based authoring tools over 2D screen-based ones.
APPLIED SCIENCES-BASEL
(2022)
Review
Chemistry, Multidisciplinary
Joo Chan Kim, Teemu H. Laine, Christer Ahlund
Summary: This paper reviews various multimodal interaction systems utilizing IoT and AR, analyzing 23 studies to discuss system architectures, relationships between components, interaction modalities, and future research challenges for researchers and developers in the field of MI.
APPLIED SCIENCES-BASEL
(2021)
Article
Computer Science, Software Engineering
Ana Stanescu, Peter Mohr, Dieter Schmalstieg, Denis Kalkofen
Summary: This study proposes a system that extracts 3D instructions from demonstrations and visualizes them in augmented reality, making it easier for people to perform assembly operations.
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
(2022)
Article
Engineering, Industrial
Yong-Ku Kong, Sang -Soo Park, Jin-Woo Shim, Kyeong-Hee Choi, Hyun-Ho Shim, Kiana Kia, Jeong Ho Kim
Summary: The aim of this study was to evaluate the effectiveness of a passive upper-limb exoskeleton in reducing musculoskeletal load and discomfort in the shoulders during augmented reality (AR) interactions. The results showed that the exoskeleton significantly reduced muscle activity and self-reported discomfort without affecting shoulder postures and task performance. Therefore, a passive exoskeleton can be an effective ergonomic control measure to reduce the risks of developing musculoskeletal discomfort or injuries in the shoulder regions during AR interactions.
APPLIED ERGONOMICS
(2023)
Review
Chemistry, Analytical
Matea Zilak, Zeljka Car, Ivana Culjak
Summary: Mobile augmented reality (MAR) has become increasingly popular and effective in various areas of human life. However, not everyone has the same access to this technology. This review paper analyzes handheld AR solutions developed for people with disabilities, identifying accessibility challenges and exploring potential research directions for personalization and customization. The findings can contribute to the creation of accessibility guidelines and the development of accessible AR solutions for both disabled and non-disabled individuals.
Review
Green & Sustainable Science & Technology
Joel Murithi Runji, Yun-Ju Lee, Chih-Hsing Chu
Summary: Smart manufacturing is crucial for mass product customizations, and augmented reality technology can assist in intelligent manual operations. This paper provides a systematic literature review on AR-assisted maintenance in manufacturing and proposes a classification process to analyze maintenance operations based on geographical location, maintenance type, AR technical elements, and integrated external sensors.
INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING-GREEN TECHNOLOGY
(2023)
Article
Computer Science, Cybernetics
Chun-Ching Chen, Xin Kang, Xin-Zhu Li, Jian Kang
Summary: Many forms of Intangible Cultural Heritage (ICH) are disappearing, but the Lantern Festival is an important part of Chinese tradition and a crucial ICH of Taiwan. This study combines augmented reality, mobile websites, and paper-based exhibition brochures to educate participants about ICH, and found that the public understood ICH better through digital technology. Participants recognized the benefits of applying augmented reality to ICH, despite the learning curve of the new technology, and encouraged its use in ICH education to improve cultural awareness and learning motivation.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2023)
Article
Engineering, Industrial
Dedy Ariansyah, John Ahmet Erkoyuncu, Iveta Eimontaite, Teegan Johnson, Anne-Marie Oostveen, Sarah Fletcher, Sarah Sharples
Summary: This study investigates the impact of different AR modalities on user performance and usability during maintenance assembly tasks. The results show that 3D animation leads to a 14% improvement in task completion time compared to video instructions. Insights from eye gaze behaviors reveal differences in attention switching and task comprehension difficulty with the choice of AR modalities.
APPLIED ERGONOMICS
(2022)
Review
Neurosciences
Jun Cao, Yifan Zhao, Xiaocai Shan, Hua-liang Wei, Yuzhu Guo, Liangyu Chen, John Ahmet Erkoyuncu, Ptolemaios Georgios Sarrigiannis
Summary: This article reviews recent studies on EEG-based functional and effective connectivity, focusing on estimation, visualization, and machine learning classifier applications. Methods are explored from various dimensions, such as linear or nonlinear, parametric or nonparametric, and time-based, frequency-based or time-frequency-based.
HUMAN BRAIN MAPPING
(2022)
Article
Computer Science, Artificial Intelligence
Inigo Fernandez del Amo, John Ahmet Erkoyuncu, Maryam Farsi, Dedy Ariansyah
Summary: This paper proposes dynamic authoring and hybrid recommender methods for accurate AR-based reporting in maintenance operations. Experimental results show that the proposed methods can improve the efficiency and effectiveness of reporting tasks.
KNOWLEDGE-BASED SYSTEMS
(2022)
Article
Engineering, Industrial
Daniel Brissaud, Tomohiko Sakao, Andreas Riel, John Ahmet Erkoyuncu
Summary: Industrial Product-Service Systems (IPS2) have been increasingly researched and practiced in various fields and sectors. However, the implementation of IPS2 has not been as significant as expected, despite its economic and environmental advantages. This study analyzes literature and practice in the last decade to propose the main characteristics of future IPS2 and design processes suitable for IPS2.
CIRP ANNALS-MANUFACTURING TECHNOLOGY
(2022)
Article
Thermodynamics
Sam Brooks, Rajkumar Roy
Summary: This study designed a self-cleaning system using self-engineering technology to clean a fouled heat exchanger. The system utilized temperature outputs to identify fouling and trigger a cleaning response. The effectiveness of different complexity designs was investigated, and the results were evaluated through experiments.
INTERNATIONAL JOURNAL OF HEAT AND MASS TRANSFER
(2022)
Article
Computer Science, Information Systems
Riccardo Palmarini, Inigo Fernandez Del Amo, Dedy Ariansyah, Samir Khan, John Ahmet Erkoyuncu, Rajkumar Roy
Summary: Augmented Reality (AR) has great potential in improving maintenance operations, but research is still in its early stages due to limitations in hardware capabilities, object recognition robustness, and content-related issues. This article proposes a new geometry-based method called Fast Augmented Reality Authoring (FARA) for creating step-by-step AR procedures for maintenance activities. Testing FARA with over 30 participants showed an average time saving of 34.7% and an error reduction of 68.6% compared to traditional hard-copy manuals.
Article
Engineering, Industrial
Sri Addepalli, Tillman Weyde, Bernadin Namoano, Oluseyi Ayodeji Oyedeji, Tiancheng Wang, John Ahmet Erkoyuncu, Rajkumar Roy
Summary: This paper proposes an automated approach for degradation analysis by combining natural language processing methods, ontology, and a knowledge graph. The effectiveness of this approach is demonstrated by using an aero-engine component as a use-case.
CIRP ANNALS-MANUFACTURING TECHNOLOGY
(2023)
Article
Engineering, Industrial
Christina Latsou, Maryam Farsi, John Ahmet Erkoyuncu
Summary: Digital twin models are used to improve the performance of complex manufacturing systems by automatically detecting anomalies and identifying bottlenecks. This paper proposes a novel DT-CPS that can detect anomalies and remove bottlenecks in real-time using sensor data from a cryogenic warehouse shop-floor case study.
JOURNAL OF MANUFACTURING SYSTEMS
(2023)
Article
Engineering, Electrical & Electronic
Alex Grenyer, John Ahmet Erkoyuncu, Sri Addepalli, Yifan Zhao
Summary: This paper presents a Compound Uncertainty Quantification and Aggregation (CUQA) framework to determine compound outputs and their uncertainty contributions. Two case studies were conducted to validate the effectiveness of this framework, which successfully measured compound uncertainty and its impact on system reliability. Future work will focus on predicting uncertainty in-service and applying the framework to more complex case studies.
Article
Engineering, Multidisciplinary
Sam Brooks, Rajkumar Roy, Jan-Henning Dirks, David Taylor
Summary: This paper provides a systematic evaluation of the complexity of self-engineering biological systems, evaluating eight identified systems using Axiomatic design and complexity theory. Proposed design rules are presented to help designers handle complexity when creating new self-engineering systems inspired by biology.
JOURNAL OF ENGINEERING DESIGN
(2023)
Article
Computer Science, Artificial Intelligence
Rosario Davide D'Amico, Sri Addepalli, John Ahmet Erkoyuncu
Summary: This paper addresses the lack of understanding in the research on industrial practices in the digital twin (DT) field by sharing feedback and future requirements from the manufacturing industry. The study, based on a survey and interviews, reveals that DTs should possess characteristics such as adaptability, scalability, and interoperability, and completed DT projects reach the breakeven point in less than two years on average. The main motivators for DT development include autonomy, customer satisfaction, safety, while the main obstacles involve a lack of expertise, funding, and interoperability. The research concludes that the federation of twins and a paradigm shift in industrial thinking are essential for the future of DT development.
BIG DATA AND COGNITIVE COMPUTING
(2023)
Proceedings Paper
Computer Science, Artificial Intelligence
Damien Mazeas, John Ahmet Erkoyuncu, Frederic Noel
Summary: Remote work practice has significantly improved maintenance processes in the maritime sector through the use of telexistence technology. This study presents a scalable framework for evaluating the feasibility of conducting traditional machinery space maintenance using telexistence capabilities. By employing a physical robot and a simulated virtual environment, maintenance scenarios were developed based on expert responses to a contextual questionnaire. Future steps involve comparing telexistence with direct teleoperation in terms of presence, workload, and usability for vessel machinery space maintenance.
2023 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW
(2023)
Proceedings Paper
Engineering, Multidisciplinary
Damien Mazeas, John Ahmet Erkoyuncu, Frederic Noel
Summary: The increasing adoption of remote working practices and internetbased systems highlights the need for a new mode of interaction and communication interfaces between humans andmachines. Current human-machine interfaces (HMI) are based on complex controllers that are not intuitive for a novice or remote operators. Telexistence capabilities, combined with a digital-twin based framework and immersive VR interface, provide a solution to reduce the complexity of operating and programming industrial robots remotely.
PRODUCT LIFECYCLE MANAGEMENT PLM IN TRANSITION TIMES: THE PLACE OF HUMANS AND TRANSFORMATIVE TECHNOLOGIES, PLM 2022
(2023)
Proceedings Paper
Automation & Control Systems
R. D. D'Amico, A. Sarkar, H. Karray, S. Addepalli, J. A. Erkoyuncu
Summary: This paper presents a methodology for developing a digital twin using a rich semantic model and principles of system engineering. The methodology is demonstrated through experiments on a laboratory pilot plant and shows the effectiveness of semantic reasoning in improving real-time system monitoring and automatically detecting component-level failure.
Article
Computer Science, Interdisciplinary Applications
Francesco Pistolesi, Michele Baldassini, Beatrice Lazzerini
Summary: More than one in four workers worldwide suffer from back pain, resulting in the loss of 264 million work days annually. In the U.S., it costs $50 billion in healthcare expenses each year, rising up to $100 billion when accounting for decreased productivity and lost wages. The impending Industry 5.0 revolution emphasizes worker well-being and their rights, such as privacy, autonomy, and human dignity. This paper proposes a privacy-preserving artificial intelligence system that monitors the posture of assembly line workers. The system accurately assesses upper-body and lower-body postures while respecting privacy, enabling the detection of harmful posture habits and reducing the likelihood of musculoskeletal disorders.
COMPUTERS IN INDUSTRY
(2024)
Article
Computer Science, Interdisciplinary Applications
Xavier Boucher, Camilo Murillo Coba, Damien Lamy
Summary: This paper explores the new business strategies of digital servitization and smart PSS delivery, and develops conceptual prototypes of smart PSS value offers for early stages of the design process. It presents the development and experimentation of a modelling language and toolkit, and applies it to the design of a smart PSS in the field of heating appliances.
COMPUTERS IN INDUSTRY
(2024)
Article
Computer Science, Interdisciplinary Applications
Dieudonne Tchuente, Jerry Lonlac, Bernard Kamsu-Foguem
Summary: Artificial Intelligence (AI) is becoming increasingly important in various sectors of society. However, the black box nature of most AI techniques such as Machine Learning (ML) hinders their practical application. This has led to the emergence of Explainable artificial intelligence (XAI), which aims to provide AI-based decision-making processes and outcomes that are easily understood, interpreted, and justified by humans. While there has been a significant amount of research on XAI, there is currently a lack of studies on its practical applications. To address this research gap, this article proposes a comprehensive review of the business applications of XAI and a six-step framework to improve its implementation and adoption by practitioners.
COMPUTERS IN INDUSTRY
(2024)
Article
Computer Science, Interdisciplinary Applications
Francois-Alexandre Tremblay, Audrey Durand, Michael Morin, Philippe Marier, Jonathan Gaudreault
Summary: Continuous high-frequency wood drying, integrated with a traditional wood finishing line, improves the value of lumber by correcting moisture content piece by piece. Using reinforcement learning for continuous drying operation policies outperforms current industry methods and remains robust to sudden disturbances.
COMPUTERS IN INDUSTRY
(2024)
Article
Computer Science, Interdisciplinary Applications
Luyao Xia, Jianfeng Lu, Yuqian Lu, Wentao Gao, Yuhang Fan, Yuhao Xu, Hao Zhang
Summary: Efficient assembly sequence planning is crucial for enhancing production efficiency, ensuring product quality, and meeting market demands. This study proposes a dynamic graph learning algorithm called assembly-oriented graph attention sequence (A-GASeq), which optimizes the assembly graph structure to guide the search for optimal assembly sequences. The algorithm demonstrates superiority and broad utility in real-world scenarios.
COMPUTERS IN INDUSTRY
(2024)
Article
Computer Science, Interdisciplinary Applications
Mutahar Safdar, Padma Polash Paul, Guy Lamouche, Gentry Wood, Max Zimmermann, Florian Hannesen, Christophe Bescond, Priti Wanjara, Yaoyao Fiona Zhao
Summary: Metal-based additive manufacturing can achieve fully dense metallic components, and the application of machine learning in this field has been growing rapidly. However, there is a lack of framework to manage these machine learning models and guidance on the fundamental requirements for a cross-disciplinary platform to support process-based machine learning models in industrial metal AM.
COMPUTERS IN INDUSTRY
(2024)
