4.6 Article

Understanding human-robot teams in light of all-human teams: Aspects of team interaction and shared cognition

Journal

Publisher

ACADEMIC PRESS LTD- ELSEVIER SCIENCE LTD
DOI: 10.1016/j.ijhcs.2020.102436

Keywords

Human-robot teaming; Dynamical systems; Interactive team cognition; Shared cognition; Team cognition; Urban search and rescue

Funding

  1. Office of Naval Research [N0014-13-1-0519]

Ask authors/readers for more resources

As robots become more autonomous, their roles shift from being operated and controlled by humans to interactively teaming with humans. The current research focuses on how human operators can effectively team with autonomous urban search and rescue agents in a dynamic and complex task environment. To do so, we empirically examined how shared cognition and restricted language capabilities impacted performance of human-robot dyad search teams using a simulated Minecraft task environment. In order to examine the effects of shared mental models and language the following modified conditions were applied: (1) participants were either able to communicate using natural language or the internal participant's communication was limited to three-word utterances; and (2) shared mental models were manipulated by either the internal participant being made fully aware of the external participant's restricted representation of the environment and inaccurate map or the internal was unaware of these challenges. The primary findings from this study are: (1) teams in the natural language and shared mental model conditions performed better than teams in the limited language and restricted model conditions; (2) when the internal participant was unaware of the challenges of the external, the external perceived higher workload than when there was a shared mental model; (3) teams with natural language and shared mental model demonstrated more predictable behavior than the other teams; (4) some amount of systems' predictability was good but too much predictability was not good. Overall, these results indicate that effective team interaction and shared cognition play an important role in human-robot dyadic teaming performance.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Industrial

Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system: a layered dynamics approach

Jamie C. Gorman, Mustafa Demir, Nancy J. Cooke, David A. Grimm

ERGONOMICS (2019)

Article Computer Science, Artificial Intelligence

Who/What Is My Teammate? Team Composition Considerations in Human-AI Teaming

Nathan J. McNeese, Beau G. Schelble, Lorenzo Barberis Canonico, Mustafa Demir

Summary: This study investigated the characteristics and dynamics of human-AI teams in emergency response management scenarios, finding that mixed human-AI teams outperformed all-human teams, with AI-only teams achieving the highest performance. However, the study also highlighted the negative impact of mixed teams on perceived team cognition.

IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS (2021)

Article Engineering, Industrial

Team Situation Awareness and Conflict: A Study of Human-Machine Teaming

Nathan J. McNeese, Mustafa Demir, Nancy J. Cooke, Manrong She

Summary: This article focuses on team situation awareness (TSA) and team conflict in human-machine teams. The experiment showed that TSA improved in synthetic and experimenter teams but not in control teams; control teams had the most team conflict, and team conflict negatively impacted TSA in the control condition.

JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING (2021)

Article Computer Science, Artificial Intelligence

Exploration of Teammate Trust and Interaction Dynamics in Human-Autonomy Teaming

Mustafa Demir, Nathan J. McNeese, Jaime C. Gorman, Nancy J. Cooke, Christopher W. Myers, David A. Grimm

Summary: This article explores the dynamic changes in team interaction and trust in human-autonomy teams (HATs), finding that team interaction is closely related to the development of trust, trust in the autonomous teammate is only associated with recovery from autonomy failures, and team interaction dynamics are linked to recovery from both automation and autonomy failures.

IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS (2021)

Article Engineering, Industrial

Assessment of Trust in Automation in the Real World: Requirements for New Trust in Automation Measurement Techniques for Use by Practitioners

Nathan Tenhundfeld, Mustafa Demir, Ewart de Visser

Summary: This paper proposes six requirements for future measures of trust assessment in automation, and emphasizes the importance of leveraging existing research and considering the needs of practitioners in order to realize the benefits of trust assessment. It also highlights the challenges of trust assessment outside the laboratory environment.

JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING (2022)

Article Computer Science, Cybernetics

Exploration of the Impact of Interpersonal Communication and Coordination Dynamics on Team Effectiveness in Human-Machine Teams

Mustafa Demir, Myke Cohen, Craig J. Johnson, Erin K. Chiou, Nancy J. Cooke

Summary: This study investigates the interpersonal coordination dynamics between human and machine members in complex task environments, and how it is associated with team performance and shared situation awareness. The results indicate that teams with more flexible coordination dynamics are more adaptive to changes in the task environment. While revisiting the same communication pattern is associated with better team performance, it does not improve shared situation awareness.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION (2023)

Article Engineering, Industrial

Impact of Transparency and Explanations on Trust and Situation Awareness in Human-Robot Teams

Akuadasuo Ezenyilimba, Margaret Wong, Alexander Hehr, Mustafa Demir, Alexandra Wolff, Erin Chiou, Nancy Cooke

Summary: Urban Search and Rescue missions benefit from human-robot teams, where robot explanations and transparency play a vital role in team effectiveness.

JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING (2023)

Article Engineering, Manufacturing

Managing the risks of artificial general intelligence: A human factors and ergonomics perspective

Paul M. M. Salmon, Chris Baber, Catherine Burns, Tony Carden, Nancy Cooke, Missy Cummings, Peter Hancock, Scott McLean, Gemma J. M. Read, Neville A. A. Stanton

Summary: Artificial General Intelligence (AGI) is the next stage of development in Artificial Intelligence (AI), which could bring significant benefits but also pose potential threats. Human Factors and Ergonomics (HFE) play a crucial role in designing safe and ethical AGI, but little evidence suggests its current influence. This article presents perspectives from 10 AI safety researchers on the risks associated with AGI, HFE concepts for AGI design, and the necessary activities for HFE to fulfill its critical role.

HUMAN FACTORS AND ERGONOMICS IN MANUFACTURING & SERVICE INDUSTRIES (2023)

Article Computer Science, Artificial Intelligence

Modeling Team Interaction and Decision-Making in Agile Human-Machine Teams: Quantum and Dynamical Systems Perspective

Mustafa Demir, Mustafa Canan, Myke C. Cohen

Summary: In this study, team agility was defined as the exploration and exploitation of team coordination. The effects of ontic and epistemic uncertainty on decision-making in a dynamic task environment were examined using quantum cognition and nonlinear dynamical systems modeling. The findings suggest that teams in the experimenter condition demonstrated more exploratory behavior, while teams in the control and synthetic conditions showed a preference for exploitative behavior.

IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS (2023)

Review Construction & Building Technology

Human reliability for safe and efficient civil infrastructure operation and maintenance - A review

Zhe Sun, Jinding Xing, Pingbo Tang, Nancy J. Cooke, Ronald L. Boring

DEVELOPMENTS IN THE BUILT ENVIRONMENT (2020)

Article Communication

The Evolution of Human-Autonomy Teams in Remotely Piloted Aircraft Systems Operations

Mustafa Demir, Nathan J. McNeese, Nancy J. Cooke

FRONTIERS IN COMMUNICATION (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Effective Team Interaction for Adaptive Training and Situation Awareness in Human-Autonomy Teaming

Mustafa Demir, Craig Johnson, David Grimm, Nathan J. McNeese, Jamie C. Gorman, Nancy J. Cooke

2019 IEEE INTERNATIONAL CONFERENCE ON COGNITIVE AND COMPUTATIONAL ASPECTS OF SITUATION MANAGEMENT (COGSIMA) (2019)

Review Computer Science, Cybernetics

The Impact of Video Meeting Systems on Psychological User States: a State-of-the-Art Review

Julia Seitz, Ivo Benke, Armin Heinzl, Alexander Maedche

Summary: Video meeting systems are widely used in work and life, but their impact on users' psychological states and outcomes is not well understood. This article provides a comprehensive review of existing research on psychological user states and outcomes, highlighting key findings and suggesting future research directions.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Hey StepByStep! Can you teach me how to use my phone better?

Alberto Monge Roffarello, Luigi De Russis

Summary: This paper presents a novel digital self-control tool called StepByStep, which proactively assists users in learning how to better manage smartphone use and reduce time spent on their devices. Preliminary studies show promising results in helping users change unwanted smartphone habits.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Smile mimicry smoothens human-virtual human interactions

Evania L. Fasya, Esther van den Bos, Dirk K. J. Heylen, Mariska E. Kret

Summary: This study explores the relationship between mimicry, person-perception, and social anxiety levels by having participants interact with virtual humans. The results show that participants, regardless of anxiety levels, mimic the virtual humans' smiles, which is associated with increased liking and trust towards the virtual humans.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Building enriching realities with children: Creating makerspaces that intertwine virtual and physical worlds in pediatric hospitals

Naseem Ahmadpour, Ajit G. Pillai, Sofia Yao, Andrew Weatherall

Summary: Virtual Reality (VR) can be used in pediatric hospitals to create makerspaces that provide children with an enriched experience. Through observation of participants' engagement with VR, we identified three different maker identities and provided design considerations for makerspaces in pediatric settings.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Training, children, and parents: Coach perspectives on wearable sensor data in sub-elite figure skating in the United States

Michael Jones, Mia Caminita, Elizabeth Klemm, Dustin Bruening, Sarah Ridge

Summary: This study conducted interviews with figure skating coaches to explore their perception of using IMU data in training. The findings indicate that coaches play a crucial role as gatekeepers in sharing and interpreting data, considering individual athletes' needs and being cautious when sharing data with parents.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Taxonomy and definition of audio augmented reality (AAR): A grounded theory study

Abhraneil Dam, Arsh Siddiqui, Charles Leclercq, Myounghoon Jeon

Summary: This article investigates the concept of audio augmented reality (AAR) and provides a systematic understanding, classification, and definition for AAR. The research identifies three categories for AAR applications - Environment Connected, Goal Directed, and Context Adapted, each with three subcategories. This taxonomy serves as a guide for the development and evaluation of AAR applications.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Do stakeholder needs differ? - Designing stakeholder-tailored Explainable Artificial Intelligence (XAI) interfaces

Minjung Kim, Saebyeol Kim, Jinwoo Kim, Tae-Jin Song, Yuyoung Kim

Summary: This study investigates the differences in explanation needs between clinicians and patients in the healthcare domain, and designs corresponding explanation interfaces for each group. The results demonstrate that there are diverse motivations and requirements for seeking explanations among different stakeholders, and the designed interfaces effectively address these needs.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Engagement by Design Cards: A tool to involve designers and non-experts in the design of crowdsourcing initiatives

Leonardo Vasconcelos, Jean Zahn, Daniela Trevisan, Jose Viterbo

Summary: In today's world, crowdsourcing initiatives have gained wide adoption. However, sporadic use alone is not enough for success in crowdsourcing initiatives, as active user engagement is crucial. To address this, an 18-card deck was created to provide designers with domain-specific insights on boosting user engagement. Through collaborative online design workshops, valuable information was provided, leading to contributions in design research and practices in crowdsourcing initiatives, particularly in user engagement.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

From Driver to Supervisor: Comparing Cognitive Load and EEG-Based Attentional Resource Allocation Across Automation Levels

Nikol Figalova, Hans-Joachim Bieg, Julian Elias Reiser, Yuan-Cheng Liu, Martin Baumann, Lewis Chuang, Olga Pollatos

Summary: With increasing automation, drivers' roles transition from active operators to passive system supervisors, affecting their behaviour and cognitive processes. This study investigates attentional resource allocation and subjective cognitive load during different levels of driving automation. The findings suggest that during automated driving, drivers allocate fewer attentional resources to processing environmental information, highlighting the importance of managing drivers' attention and cognitive load for enhancing automation safety and user interface design.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

mF plus C: Linking suboptimal projections to detail on handheld devices

Majid Nasirinejad, Derek Reilly

Summary: Mobile Focus+Context (mF+C) involves using a handheld device as a focus screen for content on an immersive display or mobile projector. In this study, three techniques for linking focus and context were compared, and it was found that all techniques were able to mitigate poor projection quality and performed similarly in terms of time and precision. However, the effectiveness of each technique depended on the task type.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Estimating human sensitivity to curving of segmented paths within room-size environment

Huiyu Li, Linwei Fan, Chengwei Yang, Yongxia Zhang

Summary: This study evaluates human perception of curvature gain under different virtual path conditions using a novel psychophysical method of limits. The results show that the direction and length of the curved path can impact human perception, and longer pre-order paths can increase the ability to adapt to the post-order path.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Attention-based automatic editing of virtual lectures for reduced production labor and effective learning experience

Eugene Hwang, Jeongmi Lee

Summary: This study proposes an automatic lecture video editing pipeline based on individual attention patterns, aiming to address the setbacks in producing effective educational videos. The results show that attention-based automatic editing can significantly reduce editing time while maintaining similar video characteristics to professionally edited versions, and have the potential to decrease the cognitive load of learners.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

To mimic reality or to go beyond? Superpowers in virtual reality, the experience of augmentation and its consequences

Robin Neuhaus, Ronda Ringfort-Felner, Shadan Sadeghian, Marc Hassenzahl

Summary: Virtual reality has the potential to extend human capabilities beyond reality, but it is unclear whether users perceive augmentation-oriented designs as augmenting and whether the experience is beneficial. Two consecutive experimental vignette studies were conducted to compare reality-oriented designs and augmentation-oriented designs. The findings show that augmentation-oriented designs create a more intensive augmentation experience, which is positively related to positive affect, need fulfillment, usage intention, and hedonic quality. Additionally, a new measure for assessing the subjective experience of augmentation was successfully established.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Preventing mind-wandering during driving: Predictions on potential interventions using a cognitive model

Moritz Held, Andreea Minculescu, Jochem W. Rieger, Jelmer P. Borst

Summary: In this study, the effects of interventions by adaptive automation systems designed to prevent mind-wandering while driving were predicted. It was found that a simple secondary task can improve driving performance, but if the driving task is simple, people may start mind-wandering, which interferes with driving. The study showed that interventions eliciting mild cognitive load can mitigate the negative effects of mind-wandering on driving performance.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)

Article Computer Science, Cybernetics

Wearable gaming technology: A study on the relationships between wearable features and gameful experiences

Nannan Xi, Oguz Oz Buruk, Juan Chen, Shiva Jabari, Juho Hamari

Summary: This study investigates the features of wearables that lead to a heightened game experience, finding that integrability to games, wearability, modularity, and sociability are the most important dimensions.

INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES (2024)