4.7 Article

Observational Teamwork Assessment for Surgery Construct Validation With Expert Versus Novice Raters

Journal

ANNALS OF SURGERY
Volume 249, Issue 6, Pages 1047-1051

Publisher

LIPPINCOTT WILLIAMS & WILKINS
DOI: 10.1097/SLA.0b013e3181a50220

Keywords

-

Categories

Funding

  1. Department of Health: Patient Safety Research Programme
  2. Engineering and Physical Sciences Research Council (EPSRC)
  3. Economic and Social Research Council Centre for Economic Learning and Social Evolution (ESRC ELSE)
  4. EPSRC [EP/D069718/1] Funding Source: UKRI
  5. Economic and Social Research Council [RES-538-28-1001] Funding Source: researchfish
  6. Engineering and Physical Sciences Research Council [EP/D069718/1] Funding Source: researchfish

Ask authors/readers for more resources

Objective: To test the construct validity of the Observational Teamwork Assessment for Surgery (OTAS) tool. Summary Background Data: Poor teamwork in surgical teams has been implicated in adverse events to patients. The OTAS is a tool that assesses teamwork in real little for the entire surgical team, Existing empirical research on OTAS has yet to explore how expert versus novice tool users use the tool to assess teamwork in the operating room. Methods: Data were collected in 12 elective procedures by ail expert/expert (N = 6) and an expert/novice (N = 6) pair of raters. Five teamwork behaviors (communi cation, coordination, leadership, monitoring, and cooperation) were scored via observation pre, intra, and postoperatively by blind raters. Results: Significant and sizeable correlations were obtained in 12 of 15 behaviors in the expert/expert pair, but only in 3 of 15 behaviors ill the expert/novice pair. Significant differences in mean scores were obtained ill 3 of 15 behaviors in the expert/expert pair, but in I I of 15 behaviors in the expert/novice pair. Total OTAS scores exhibited strong correlations and no significant differences in ratings in the expert/expert pair. In the expert/novice pair no correlations were obtained and there were significant differences in mean scores. The overall size of inconsistency in the scoring was 2% for expert/expert versus 15% for expert/novice. Conclusions: OTAS exhibits adequate construct validity as assessed by consistency in the scoring by expert versus novices-ie, expert raters produce significantly more consistent scoring than novice raters. Further validation should assess the learning curve for novices in OTAS. Relationships between OTAS, measures of technical skill, and behavioral responses to surgical crises should also be quantified.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Letter Surgery

Bridging the Theory-to-Practice Gap in Crisis Management

Petrut Gogalniceanu, Nick Sevdalis, Nizam Mamode

JOURNAL OF THE AMERICAN COLLEGE OF SURGEONS (2023)

Review Anesthesiology

Human factors in anaesthesia: a narrative review

F. E. Kelly, C. Frerk, C. R. Bailey, T. M. Cook, K. Ferguson, R. Flin, K. Fong, P. Groom, C. John, A. R. Lang, T. Meek, K. L. Miller, L. Richmond, N. Sevdalis, M. R. Stacey

Summary: Healthcare relies on high levels of human performance, but this is not always reliable, especially in high-pressure situations. Other safety-critical industries have successfully integrated human factors principles to improve safety, and it is possible to do the same in anaesthesia.

ANAESTHESIA (2023)

Article Anesthesiology

Implementing human factors in anaesthesia: guidance for clinicians, departments and hospitals Guidelines from the Difficult Airway Society and the Association of Anaesthetists

F. E. Kelly, C. Frerk, C. R. Bailey, T. M. Cook, K. Ferguson, R. Flin, K. Fong, P. Groom, C. John, A. R. Lang, T. Meek, K. L. Miller, L. Richmond, N. Sevdalis, M. R. Stacey

Summary: Human factors is a scientific discipline used in safety critical industries to improve safety and worker well-being. The Difficult Airway Society and the Association of Anaesthetists established a Working Party to encourage the adoption of human factors science in anaesthesia. A set of 12 recommendations were formulated, focusing on design, barriers, mitigations, and education and training strategies.

ANAESTHESIA (2023)

Review Health Care Sciences & Services

Implementation strategies for telemental health: a systematic review

Rebecca Appleton, Phoebe Barnett, Norha Vera San Juan, Elizabeth Tuudah, Natasha Lyons, Jennie Parker, Emily Roxburgh, Spyros Spyridonidis, Millie Tamworth, Minnie Worden, Melisa Yilmaz, Nick Sevdalis, Brynmor Lloyd-Evans, Justin J. J. Needle, Sonia Johnson

Summary: The COVID-19 pandemic has led to the rapid adoption of telemental health care, but there are significant variations and barriers in its implementation. This review aimed to identify strategies for effective implementation and evaluate their impact.

BMC HEALTH SERVICES RESEARCH (2023)

Review Health Care Sciences & Services

Conceptual and practical challenges associated with understanding patient safety within community-based mental health services

Phoebe Averill, Charles Vincent, Gurpreet Reen, Claire Henderson, Nick Sevdalis

Summary: Patient safety problems in community-based mental health care have received less research attention compared to physical health care. This study aimed to investigate the conceptual and empirical challenges in understanding patient safety in community-based mental health care. The review found challenges in defining safety, evaluating safety in long-term care journeys, and establishing what constitutes a 'preventable' safety problem in this context.

HEALTH EXPECTATIONS (2023)

Article Psychiatry

Psychological factors associated with reporting side effects following COVID-19 vaccination: A prospective cohort study (CoVAccS-Wave 3)

Louise E. Smith, Julius Sim, Susan M. Sherman, Richard Amlot, Megan Cutts, Hannah Dasch, Nick Sevdalis, G. James Rubin

Summary: The study aimed to investigate symptom reporting after the first and second COVID-19 vaccine doses, attribution of symptoms to the vaccine, and factors associated with symptom reporting. It was found that after the first dose, 74.1% of participants reported at least one injection-site symptom, while 65.0% reported at least one other symptom. After the second dose, 52.9% reported at least one injection-site symptom and 43.7% reported at least one other symptom. Women and younger people were more likely to report symptoms from vaccination.

JOURNAL OF PSYCHOSOMATIC RESEARCH (2023)

Article Medicine, Research & Experimental

Effectiveness and cost-effectiveness of a personalised self-management intervention for living with long COVID: protocol for the LISTEN randomised controlled trial

Claire Potter, Fiona Leggat, Rachel Lowe, Philip Pallmann, Muhammad Riaz, Christy Barlow, Adrian Edwards, Aloysius Niroshan Siriwardena, Nick Sevdalis, Bernadette Sewell, Jackie McRae, Jessica Fish, Maria Ines de Sousa de Abreu, Fiona Jones, Monica Busse

Summary: The LISTEN trial aims to evaluate the effects of personalized self-management support intervention on individuals living with long COVID. The study uses a randomized trial design with the LISTEN intervention group and usual care group. Data will be collected through online self-reported outcome measures. The study will assess the effectiveness and cost-effectiveness of the LISTEN intervention and conduct a detailed process evaluation.

TRIALS (2023)

Article Obstetrics & Gynecology

A survey and stakeholder consultation of Independent Domestic Violence Advisor (IDVA) programmes in English maternity services

Camilla Forbes, Hayley Alderson, Jill Domoney, Alexandra Papamichail, Vashti Berry, Ruth McGovern, Nick Sevdalis, Judith Rankin, Mary Newburn, Andy Healey, Abigail Easter, Margaret Heslin, Gene Feder, Kristian Hudson, Claire A. Wilson, G. J. Melendez-Torres, Louise M. Howard, Kylee Trevillion

Summary: This study aimed to investigate the implementation of healthcare-based Independent Domestic Violence Advisors (hIDVA) programmes in maternity services in England. The results showed that 69% of the surveyed trusts reported having a hIDVA programme, with 55% of them operating within maternity services. Key facilitators for implementation included staff training, communication, co-creation, and support from management. Barriers included lack of private workspace, funding issues, and recruitment challenges for hIDVA staff.

BMC PREGNANCY AND CHILDBIRTH (2023)

Article Psychology, Multidisciplinary

Analysis of communication styles underpinning clinical decision-making in cancer multidisciplinary team meetings

Tayana Soukup, Benjamin W. Lamb, James S. A. Green, Nick Sevdalis, Ged Murtagh

Summary: In cancer care, MDT meetings are crucial, but concerns have been raised regarding their quality. This study analyzes the dynamics of teamwork in MDT meetings, finding that surgeons initiate and respond to interactions the most, speaking 47% of the time. Cancer nurse specialists and coordinators are the least frequent initiators, speaking only 4% and 1% respectively. The study also reveals high interactivity in the meetings, with an initiator-responder ratio of 1:1.63, and an increase in verbal dysfluencies in the second half.

FRONTIERS IN PSYCHOLOGY (2023)

Article Urology & Nephrology

An introduction to quality improvement

Stephanie J. Russ, James Green, Louise de Winter, Ellie Herrington, Archie Hughes-Hallett, Julia M. Taylor, Nick Sevdalis

Summary: In the past 30 years, there has been a significant focus on quality in international healthcare. This is due to the recognition of variations in patient outcomes caused by inconsistent implementation of evidence-based actions during patient care. Healthcare professionals have shown a growing interest in utilizing knowledge and techniques from outside the medical field to improve patient care standards. This article introduces Quality Improvement methodology and concepts to Urology departments in the UK, providing an overview of key principles and organizational support for QI work.

JOURNAL OF CLINICAL UROLOGY (2023)

Article Immunology

Psychosocial factors affecting COVID-19 vaccine uptake in the UK: A prospective cohort study (CoVAccS - Wave 3)

Louise E. Smith, Julius Sim, Megan Cutts, Hannah Dasch, Richard Amlot, Nick Sevdalis, G. James Rubin, Susan M. Sherman

Summary: This study investigated factors associated with COVID-19 vaccine uptake, future vaccination intentions, and changes in beliefs and attitudes. The results showed that 90% of the participants had received two doses of the COVID-19 vaccine, 2.2% had received one dose, and 7.4% had not been vaccinated. Vaccine uptake was associated with intention to be vaccinated, social norms, perceived necessity, and safety of the vaccine. There were changes in participants' perceptions of COVID-19 and vaccine information. Therefore, targeting modifiable beliefs about the safety and effectiveness of vaccination can increase uptake.

VACCINE: X (2023)

Article Medicine, Research & Experimental

Feasibility of implementing a surgical patient safety checklist: prospective cross-sectional evaluation

Kristin Harris, Eirik Softeland, Asgjerd Litlere Moi, Stig Harthug, Mette Ravnoy, Anette Storesund, Elaheh Jurmy, Eli Skeie, Hilde Valen Waehle, Nick Sevdalis, Arvid Steinar Haugen

Summary: This study investigates the feasibility of using the two-part surgical patient safety checklist (PASC) and identifies barriers and drivers for its implementation. The results show that most surgical patients are willing and able to use PASC, but there are also some implementation challenges and facilitating factors.

PILOT AND FEASIBILITY STUDIES (2023)

Article Health Care Sciences & Services

'Beyond places of safety' - a qualitative study exploring the implementation of mental health crisis care innovations across England

Una Foye, Rebecca Appleton, Patrick Nyikavaranda, Natasha Lyons, Ceri Dare, Chris Lynch, Karen Persaud, Nafiso Ahmed, Ruth Stuart, Merle Schlief, Xia Huong, Nick Sevdalis, Luke Sheridan-Rains, Antonio Rojas-Garcia, Martin Stefan, Jeremy Clark, Alan Simpson, Sonia Johnson, Brynmor Lloyd-Evans

Summary: Mental health acute and crisis care consumes a significant portion of mental health budgets worldwide, but is often deemed unsatisfactory and difficult to access. This study aims to understand the factors that aid or hinder the implementation of innovative mental health crisis care projects in England. Findings suggest that bottom-up development, service user involvement, collaborative working, and leadership and management buy-in are key facilitators to implementation, while complexities in crisis care, workforce challenges, and resourcing issues act as barriers.

BMC HEALTH SERVICES RESEARCH (2023)

Article Medicine, Research & Experimental

Feasibility, clinical efficacy, and well-being outcomes of an online singing intervention for postnatal depression in the UK: SHAPER-PNDO, a single-arm clinical trial

Rebecca H. Bind, Kristi Sawyer, Katie Hazelgrove, Lavinia Rebecchini, Celeste Miller, Subeyda Ahmed, Paola Dazzan, Nick Sevdalis, Ioannis Bakolis, Rachel Davis, Maria Baldellou Lopez, Anthony Woods, Nikki Crane, Manonmani Manoharan, Alexandra Burton, Hannah Dye, Tim Osborn, Lorna Greenwood, Rosie Perkins, Daisy Fancourt, Carmine M. Pariante, Carolina Estevao

Summary: This study evaluated the feasibility, clinical efficacy, and well-being outcomes of an online singing intervention for mothers with postnatal depression. The results showed that the online intervention effectively reduced depression, anxiety, and stress, and improved life satisfaction and feelings of worthwhileness.

PILOT AND FEASIBILITY STUDIES (2023)

No Data Available