Article
Robotics
Marco Aggravi, Ahmed Alaaeldin Said Elsherif, Paolo Robuffo Giordano, Claudio Pacchierotti
Summary: The study introduces a decentralized haptic-enabled control framework for heterogeneous human-robot teams, showing its effectiveness in various search and rescue scenarios. The provision of haptic feedback was found to enhance performance compared to visual information alone, with distinct feedback regarding team connectivity and path direction outperforming combined feedback.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2021)
Article
Robotics
Brian Reily, Peng Gao, Fei Han, Hua Wang, Hao Zhang
Summary: Awareness of team behaviors is crucial in human-robot teaming, with autonomous robots needing to be aware of the overall intent of the team. The article introduces a novel representation learning approach for recognizing team intent awareness in real-time, which encodes individual activities as latent variables and represents teammate relationships through graph embedding. Experimental results demonstrate the superior accuracy and real-time suitability of the proposed approach on mobile robots.
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH
(2022)
Article
Computer Science, Artificial Intelligence
Mustafa Demir, Mustafa Canan, Myke C. Cohen
Summary: In this study, team agility was defined as the exploration and exploitation of team coordination. The effects of ontic and epistemic uncertainty on decision-making in a dynamic task environment were examined using quantum cognition and nonlinear dynamical systems modeling. The findings suggest that teams in the experimenter condition demonstrated more exploratory behavior, while teams in the control and synthetic conditions showed a preference for exploitative behavior.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2023)
Article
Computer Science, Interdisciplinary Applications
Da Hu, Long Chen, Jing Du, Jiannan Cai, Shuai Li
Summary: This study proposes a see-through technique by integrating ground-penetrating radar (GPR) with interactive augmented reality (AR) to reconstruct potential voids in disaster rubble and provide relevant information for first responders, aiming to enhance the efficiency and safety of urban search and rescue.
JOURNAL OF COMPUTING IN CIVIL ENGINEERING
(2022)
Article
Geosciences, Multidisciplinary
Halil Ibrahim Cicekdagi, Ertugrul Ayyildiz, Mehmet Cabir Akkoyunlu
Summary: Social loafing refers to a decrease in motivation and effort between group members when working collectively compared to when working individually. This study aims to assess the factors influencing social loafing behavior in search and rescue teams operating in disaster and emergency situations. The results indicate a clear association between higher team performance and reduced instances of social loafing, highlighting the crucial role of effective team dynamics in rescue operations.
Article
Behavioral Sciences
Nancy J. J. Cooke, Myke C. C. Cohen, Walter C. C. Fazio, Laura H. H. Inderberg, Craig J. J. Johnson, Glenn J. J. Lematta, Matthew Peel, Aaron Teo
Summary: This article reviews the current state-of-the-art in team cognition research, highlighting the limitations of existing theories, laboratory paradigms, and measures in light of the increasing complexities of modern teams and the study of team cognition. It proposes future research directions for expanding the conceptualization of teams and team cognition, including examining dimensions of teamness, incorporating nonhuman teammates in laboratory paradigms, and advancing unobtrusive, real-time, and automatic measures of team cognition.
Article
Robotics
Sangchul Han, Sanguk Chon, JungYeong Kim, Jeahong Seo, Dong Gwan Shin, Sangshin Park, Jin Tak Kim, Jinhyeon Kim, Maolin Jin, Jungsan Cho
Summary: This letter introduces a gripper module designed for a snake-like robot to conduct search and rescue tasks in narrow spaces. The module has three distinct features: it can house fingers inside its body, it possesses three fingers capable of stably gripping objects with irregular surfaces, and one of the fingers is equipped with a fingertip camera for search purposes. A novel design featuring three fingers and eight degrees of freedom is proposed to achieve a compact, lightweight gripper module. Experimental verification of the proposed gripper module showcases its light weight (0.4 kg), small size (less than 68 mm in diameter), and strong grasping force (2.48kgf), while a prototype integrated into a snake-like robot demonstrates its capability to perform rescue tasks in collapsed environments.
IEEE ROBOTICS AND AUTOMATION LETTERS
(2022)
Article
Computer Science, Artificial Intelligence
Nathan J. McNeese, Beau G. Schelble, Lorenzo Barberis Canonico, Mustafa Demir
Summary: This study investigated the characteristics and dynamics of human-AI teams in emergency response management scenarios, finding that mixed human-AI teams outperformed all-human teams, with AI-only teams achieving the highest performance. However, the study also highlighted the negative impact of mixed teams on perceived team cognition.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2021)
Article
Robotics
Gongcheng Wang, Weidong Wang, Pengchao Ding, Yueming Liu, Han Wang, Zhenquan Fan, Hua Bai, Zhu Hongbiao, Zhijiang Du
Summary: This paper proposes a dual-robot system solution for search and rescue in an underground building environment. The two robots focus on different tasks while sharing environmental perception information and location. The system integrates various technologies such as Lidar, inertial measurement unit, multiview cameras, depth camera, and wireless multinode networking to overcome challenges in underground rescue. Experimental results demonstrate the system's high reliability and applicability in over-the-horizon maneuvering, teleoperation, object searching, and environmental perception.
JOURNAL OF FIELD ROBOTICS
(2023)
Article
Psychology, Mathematical
Thuy Ngoc Nguyen, Cleotilde Gonzalez
Summary: Many aspects of dynamic decision-making (DDM) behaviors in humans have been studied using computer-simulated games called microworlds. However, most microworlds lack flexibility and only focus on specific elements of DDM. Additionally, there are limited tools available to study human decision-making behavior using browser-based gridworld environments. To address these limitations, Minimap, a dynamic interactive game, is introduced to examine DDM in search and rescue missions, providing flexibility in experimental setups and scenario creation. Minimap allows customization of dynamics, complexity, opaqueness, and dynamic complexity, and enables visualization and replay of recorded human trajectories for behavior analysis.
BEHAVIOR RESEARCH METHODS
(2023)
Article
Computer Science, Interdisciplinary Applications
Micael S. Couceiro, David Portugal, Rui P. Rocha, Andre Araujo
Summary: This research models the key features of a firefighting mission in response to an urban fire in a large basement garage and studies the addition of robotic teams to cooperate with human firefighters to overcome communication issues and improve situation awareness. The results highlight the importance of such human-robot partnership for a more effective response to urban fires and mitigation of life endangerment of first responders and victims.
SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL
(2021)
Article
Multidisciplinary Sciences
Bing Hao, Jianshuo Zhao, He Du, Qi Wang, Qi Yuan, Shuo Zhao
Summary: The search algorithm plays a crucial role in the robot's motion planning and task completion. A fusion algorithm combining Flower Pollination algorithm and Q-learning is proposed to solve search tasks in complex environments. Improving the accuracy and efficiency of the search and rescue robot path search, the algorithm uses an improved grid map and combines Q-learning and Flower Pollination algorithm for initialization of Q-table. It also introduces a combination of static and dynamic reward function to better accommodate different situations encountered by the robot during the search process. Experiment results demonstrate the success of the improved grid map and the effectiveness of the FIQL algorithm, which outperforms other algorithms in terms of reducing iterations, improving adaptability to complex environments, and minimizing computational effort.
Article
Environmental Sciences
Chang Cai, Jianfeng Chen, Qingli Yan, Fen Liu
Summary: In this study, we propose a novel Multi-robot Coverage Path Planning (MCPP) method for maritime Search And Rescue (SAR) missions using multiple Autonomous Underwater Vehicles (AUVs). The method transforms the MCPP problem into two sub-problems: area partitioning and single-AUV coverage path planning. Simulation results show that the proposed method maintains workload balance, improves efficiency and accuracy of target discovery.
Article
Robotics
Laura Miraglia, Cinzia Di Dio, Federico Manzi, Takayuki Kanda, Angelo Cangelosi, Shoji Itakura, Hiroshi Ishiguro, Davide Massaro, Peter Fonagy, Antonella Marchetti
Summary: According to the Theory of Natural Pedagogy, object-directed emotion conveys culturally shared knowledge in communicative contexts and personal preference in non-communicative contexts. This bias is present in infants and throughout the lifespan, and may be influenced by robotic ostensive cues. The study found that shared knowledge depends on context and who is sharing the information (human or robot), and robotic ostensive cues facilitate human-robot interaction. The study also highlights the impact of human attachment style on the interaction.
INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS
(2023)
Article
Robotics
Melvin P. Manuel, Mariam Faied, Mohan Krishnan, Mark Paulik
Summary: This paper introduces a vision-based robot platooning algorithm that can adapt to dynamic environmental changes in disaster sites and operate robot teams for search and rescue operations without a communication network.
INTELLIGENT SERVICE ROBOTICS
(2022)
Article
Engineering, Industrial
Jamie C. Gorman, Mustafa Demir, Nancy J. Cooke, David A. Grimm
Article
Computer Science, Artificial Intelligence
Nathan J. McNeese, Beau G. Schelble, Lorenzo Barberis Canonico, Mustafa Demir
Summary: This study investigated the characteristics and dynamics of human-AI teams in emergency response management scenarios, finding that mixed human-AI teams outperformed all-human teams, with AI-only teams achieving the highest performance. However, the study also highlighted the negative impact of mixed teams on perceived team cognition.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2021)
Article
Engineering, Industrial
Nathan J. McNeese, Mustafa Demir, Nancy J. Cooke, Manrong She
Summary: This article focuses on team situation awareness (TSA) and team conflict in human-machine teams. The experiment showed that TSA improved in synthetic and experimenter teams but not in control teams; control teams had the most team conflict, and team conflict negatively impacted TSA in the control condition.
JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING
(2021)
Article
Computer Science, Artificial Intelligence
Mustafa Demir, Nathan J. McNeese, Jaime C. Gorman, Nancy J. Cooke, Christopher W. Myers, David A. Grimm
Summary: This article explores the dynamic changes in team interaction and trust in human-autonomy teams (HATs), finding that team interaction is closely related to the development of trust, trust in the autonomous teammate is only associated with recovery from autonomy failures, and team interaction dynamics are linked to recovery from both automation and autonomy failures.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2021)
Article
Engineering, Industrial
Nathan Tenhundfeld, Mustafa Demir, Ewart de Visser
Summary: This paper proposes six requirements for future measures of trust assessment in automation, and emphasizes the importance of leveraging existing research and considering the needs of practitioners in order to realize the benefits of trust assessment. It also highlights the challenges of trust assessment outside the laboratory environment.
JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING
(2022)
Article
Computer Science, Cybernetics
Mustafa Demir, Myke Cohen, Craig J. Johnson, Erin K. Chiou, Nancy J. Cooke
Summary: This study investigates the interpersonal coordination dynamics between human and machine members in complex task environments, and how it is associated with team performance and shared situation awareness. The results indicate that teams with more flexible coordination dynamics are more adaptive to changes in the task environment. While revisiting the same communication pattern is associated with better team performance, it does not improve shared situation awareness.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2023)
Article
Engineering, Industrial
Akuadasuo Ezenyilimba, Margaret Wong, Alexander Hehr, Mustafa Demir, Alexandra Wolff, Erin Chiou, Nancy Cooke
Summary: Urban Search and Rescue missions benefit from human-robot teams, where robot explanations and transparency play a vital role in team effectiveness.
JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING
(2023)
Article
Engineering, Manufacturing
Paul M. M. Salmon, Chris Baber, Catherine Burns, Tony Carden, Nancy Cooke, Missy Cummings, Peter Hancock, Scott McLean, Gemma J. M. Read, Neville A. A. Stanton
Summary: Artificial General Intelligence (AGI) is the next stage of development in Artificial Intelligence (AI), which could bring significant benefits but also pose potential threats. Human Factors and Ergonomics (HFE) play a crucial role in designing safe and ethical AGI, but little evidence suggests its current influence. This article presents perspectives from 10 AI safety researchers on the risks associated with AGI, HFE concepts for AGI design, and the necessary activities for HFE to fulfill its critical role.
HUMAN FACTORS AND ERGONOMICS IN MANUFACTURING & SERVICE INDUSTRIES
(2023)
Article
Computer Science, Artificial Intelligence
Mustafa Demir, Mustafa Canan, Myke C. Cohen
Summary: In this study, team agility was defined as the exploration and exploitation of team coordination. The effects of ontic and epistemic uncertainty on decision-making in a dynamic task environment were examined using quantum cognition and nonlinear dynamical systems modeling. The findings suggest that teams in the experimenter condition demonstrated more exploratory behavior, while teams in the control and synthetic conditions showed a preference for exploitative behavior.
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS
(2023)
Review
Construction & Building Technology
Zhe Sun, Jinding Xing, Pingbo Tang, Nancy J. Cooke, Ronald L. Boring
DEVELOPMENTS IN THE BUILT ENVIRONMENT
(2020)
Article
Communication
Mustafa Demir, Nathan J. McNeese, Nancy J. Cooke
FRONTIERS IN COMMUNICATION
(2019)
Proceedings Paper
Computer Science, Artificial Intelligence
Mustafa Demir, Craig Johnson, David Grimm, Nathan J. McNeese, Jamie C. Gorman, Nancy J. Cooke
2019 IEEE INTERNATIONAL CONFERENCE ON COGNITIVE AND COMPUTATIONAL ASPECTS OF SITUATION MANAGEMENT (COGSIMA)
(2019)
Review
Computer Science, Cybernetics
Julia Seitz, Ivo Benke, Armin Heinzl, Alexander Maedche
Summary: Video meeting systems are widely used in work and life, but their impact on users' psychological states and outcomes is not well understood. This article provides a comprehensive review of existing research on psychological user states and outcomes, highlighting key findings and suggesting future research directions.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Alberto Monge Roffarello, Luigi De Russis
Summary: This paper presents a novel digital self-control tool called StepByStep, which proactively assists users in learning how to better manage smartphone use and reduce time spent on their devices. Preliminary studies show promising results in helping users change unwanted smartphone habits.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Evania L. Fasya, Esther van den Bos, Dirk K. J. Heylen, Mariska E. Kret
Summary: This study explores the relationship between mimicry, person-perception, and social anxiety levels by having participants interact with virtual humans. The results show that participants, regardless of anxiety levels, mimic the virtual humans' smiles, which is associated with increased liking and trust towards the virtual humans.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Naseem Ahmadpour, Ajit G. Pillai, Sofia Yao, Andrew Weatherall
Summary: Virtual Reality (VR) can be used in pediatric hospitals to create makerspaces that provide children with an enriched experience. Through observation of participants' engagement with VR, we identified three different maker identities and provided design considerations for makerspaces in pediatric settings.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Michael Jones, Mia Caminita, Elizabeth Klemm, Dustin Bruening, Sarah Ridge
Summary: This study conducted interviews with figure skating coaches to explore their perception of using IMU data in training. The findings indicate that coaches play a crucial role as gatekeepers in sharing and interpreting data, considering individual athletes' needs and being cautious when sharing data with parents.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Abhraneil Dam, Arsh Siddiqui, Charles Leclercq, Myounghoon Jeon
Summary: This article investigates the concept of audio augmented reality (AAR) and provides a systematic understanding, classification, and definition for AAR. The research identifies three categories for AAR applications - Environment Connected, Goal Directed, and Context Adapted, each with three subcategories. This taxonomy serves as a guide for the development and evaluation of AAR applications.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Minjung Kim, Saebyeol Kim, Jinwoo Kim, Tae-Jin Song, Yuyoung Kim
Summary: This study investigates the differences in explanation needs between clinicians and patients in the healthcare domain, and designs corresponding explanation interfaces for each group. The results demonstrate that there are diverse motivations and requirements for seeking explanations among different stakeholders, and the designed interfaces effectively address these needs.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Leonardo Vasconcelos, Jean Zahn, Daniela Trevisan, Jose Viterbo
Summary: In today's world, crowdsourcing initiatives have gained wide adoption. However, sporadic use alone is not enough for success in crowdsourcing initiatives, as active user engagement is crucial. To address this, an 18-card deck was created to provide designers with domain-specific insights on boosting user engagement. Through collaborative online design workshops, valuable information was provided, leading to contributions in design research and practices in crowdsourcing initiatives, particularly in user engagement.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Nikol Figalova, Hans-Joachim Bieg, Julian Elias Reiser, Yuan-Cheng Liu, Martin Baumann, Lewis Chuang, Olga Pollatos
Summary: With increasing automation, drivers' roles transition from active operators to passive system supervisors, affecting their behaviour and cognitive processes. This study investigates attentional resource allocation and subjective cognitive load during different levels of driving automation. The findings suggest that during automated driving, drivers allocate fewer attentional resources to processing environmental information, highlighting the importance of managing drivers' attention and cognitive load for enhancing automation safety and user interface design.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Majid Nasirinejad, Derek Reilly
Summary: Mobile Focus+Context (mF+C) involves using a handheld device as a focus screen for content on an immersive display or mobile projector. In this study, three techniques for linking focus and context were compared, and it was found that all techniques were able to mitigate poor projection quality and performed similarly in terms of time and precision. However, the effectiveness of each technique depended on the task type.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Huiyu Li, Linwei Fan, Chengwei Yang, Yongxia Zhang
Summary: This study evaluates human perception of curvature gain under different virtual path conditions using a novel psychophysical method of limits. The results show that the direction and length of the curved path can impact human perception, and longer pre-order paths can increase the ability to adapt to the post-order path.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Eugene Hwang, Jeongmi Lee
Summary: This study proposes an automatic lecture video editing pipeline based on individual attention patterns, aiming to address the setbacks in producing effective educational videos. The results show that attention-based automatic editing can significantly reduce editing time while maintaining similar video characteristics to professionally edited versions, and have the potential to decrease the cognitive load of learners.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Robin Neuhaus, Ronda Ringfort-Felner, Shadan Sadeghian, Marc Hassenzahl
Summary: Virtual reality has the potential to extend human capabilities beyond reality, but it is unclear whether users perceive augmentation-oriented designs as augmenting and whether the experience is beneficial. Two consecutive experimental vignette studies were conducted to compare reality-oriented designs and augmentation-oriented designs. The findings show that augmentation-oriented designs create a more intensive augmentation experience, which is positively related to positive affect, need fulfillment, usage intention, and hedonic quality. Additionally, a new measure for assessing the subjective experience of augmentation was successfully established.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Moritz Held, Andreea Minculescu, Jochem W. Rieger, Jelmer P. Borst
Summary: In this study, the effects of interventions by adaptive automation systems designed to prevent mind-wandering while driving were predicted. It was found that a simple secondary task can improve driving performance, but if the driving task is simple, people may start mind-wandering, which interferes with driving. The study showed that interventions eliciting mild cognitive load can mitigate the negative effects of mind-wandering on driving performance.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)
Article
Computer Science, Cybernetics
Nannan Xi, Oguz Oz Buruk, Juan Chen, Shiva Jabari, Juho Hamari
Summary: This study investigates the features of wearables that lead to a heightened game experience, finding that integrability to games, wearability, modularity, and sociability are the most important dimensions.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES
(2024)