4.6 Article

The Power of Contribution and Attribution in Assessing Educational Outcomes for Individuals, Teams, and Programs

Journal

ACADEMIC MEDICINE
Volume 95, Issue 7, Pages 1014-1019

Publisher

LIPPINCOTT WILLIAMS & WILKINS
DOI: 10.1097/ACM.0000000000003121

Keywords

-

Ask authors/readers for more resources

Recent discussions have brought attention to the utility of contribution analysis for evaluating the effectiveness and outcomes of medical education programs, especially for complex initiatives such as competency-based medical education. Contribution analysis focuses on the extent to which different entities contribute to an outcome. Given that health care is provided by teams, contribution analysis is well suited to evaluating the outcomes of care delivery. Furthermore, contribution analysis plays an important role in analyzing program-and system-level outcomes that inform program evaluation and program-level improvements for the future. Equally important in health care, however, is the role of the individual. In the overall contribution of a team to an outcome, some aspects of this outcome can be attributed to individual team members. For example, a recently discharged patient with an unplanned return to the emergency department to seek care may not have understood the discharge instructions given by the nurse or may not have received any discharge guidance from the resident physician. In this example, if it is the nurse's responsibility to provide discharge instructions, that activity is attributed to him or her. This and other activities attributed to different individuals (e.g., nurse, resident) combine to contribute to the outcome for the patient. Determining how to tease out such attributions is important for several reasons. First, it is physicians, not teams, that graduate and are granted certification and credentials for medical practice. Second, incentive-based payment models focus on the quality of care provided by an individual. Third, an individual can use data about his or her performance on the team to help drive personal improvement. In this article, the authors explored how attribution and contribution analyses can be used in a complimentary fashion to discern which outcomes can and should be attributed to individuals, which to teams, and which to programs.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Letter Education, Scientific Disciplines

Little words that matter: Advancing LGBTQIA2S+inclusion in academic writing

Nicole Damari, Benjamin Kinnear

MEDICAL EDUCATION (2023)

Article Education, Scientific Disciplines

Utility of a multimodal computer-based assessment format for assessment with a higher degree of reliability and validity

Johan Renes, Cees P. M. van der Vleuten, Carlos F. Collares

Summary: This study compares a novel multimodal test format called Proxy-CBA with the traditional MCQ-CBA and finds that Proxy-CBA has higher reliability and validity, while maintaining similar cognitive load, suggesting its utility as an alternative assessment format.

MEDICAL TEACHER (2023)

Article Health Care Sciences & Services

Investigating physician leadership competencies in rural and remote areas of the province of Aceh, Indonesia

Fury Maulina, Mubasysyir Hasanbasri, Fedde Scheele, Jamiu O. Busari

Summary: This study investigated doctors' perceptions of physician leadership competencies based on their experiences in low-resource rural and remote areas of Indonesia. The findings revealed that good physician leaders in these settings should possess cultural sensitivity skills, a strong character, and creativity and flexibility skills.

BMJ LEADER (2023)

Review Education, Scientific Disciplines

The Effect of Assessments on Student Motivation for Learning and Its Outcomes in Health Professions Education: A Review and Realist Synthesis

Rashmi A. Kusurkar, Cesar Orsini, Sunia Somra, Anthony R. Artino, Hester E. M. Daelmans, Linda J. Schoonmade, Cees van der Vleuten

Summary: The research found that assessments can have both positive and negative effects on student motivation for learning in health professions education. Assessments that stimulate controlled motivation tend to have negative outcomes, while those that stimulate autonomous motivation have positive outcomes. Students often focus on studying for assessments rather than acquiring knowledge relevant to professional practice.

ACADEMIC MEDICINE (2023)

Article Education & Educational Research

Validity evidence and psychometric evaluation of a socially accountable health index for health professions schools

Cassandra Barber, Cees van der Vleuten, Saad Chahine

Summary: This paper demonstrates how open access, pan-national health data can be used to create a reliable health index to assist schools in identifying societal needs and advance social accountability in health professions education. A final 5-factor multidimensional model was developed to help schools understand societal needs.

ADVANCES IN HEALTH SCIENCES EDUCATION (2023)

Article Education & Educational Research

Inequity is woven into the fabric: a discourse analysis of assessment in pediatric residency training

Hannah L. Anderson, Layla Abdulla, Dorene F. Balmer, Marjan Govaerts, Jamiu O. Busari

Summary: This study aims to understand intrinsic inequity in assessment systems by analyzing assessment policies and procedures in residency training, using general pediatrics as a case study. Foucauldian discourse analysis was conducted, revealing that inequity in assessment may not be an isolated aberration but rather an inherent feature of the system.

ADVANCES IN HEALTH SCIENCES EDUCATION (2023)

Article Medicine, General & Internal

The taste of success: how to live and thrive as black scholars in inequitable and racialized professional contexts

Jamiu O. Busari

Summary: Successful black or nonwhite healthcare scholars serve as ideal role models for young, aspiring, and underrepresented healthcare professionals. Unfortunately, many fail to understand the challenges these individuals faced to attain their success. Most black healthcare professionals credit their success to working twice as hard as their white peers. In this article, the author presents a teachable case story to highlight how black scholars can thrive in inequitable professional contexts.

POSTGRADUATE MEDICAL JOURNAL (2023)

Article Education & Educational Research

Between theory and practice: educators' perceptions on assessment quality criteria and its impact on student learning

Lonneke H. H. Schellekens, Wim D. J. Kremer, Marieke F. F. Van der Schaaf, Cees P. M. Van der Vleuten, Harold G. J. Bok

Summary: This study explores how educators perceive and achieve assessment quality, as well as their perceptions of the impact of assessment on student learning. The findings reveal that educators predominantly use traditional criteria to understand and achieve assessment quality, with limited awareness of quality criteria at the course and program levels. Additionally, educators perceive the impact of assessment on student learning in two distinct ways: as a source of information to monitor and direct learning, and as a tool to prompt learning.

FRONTIERS IN EDUCATION (2023)

Article Education, Scientific Disciplines

Competency-based medical education: The spark to ignite healthcare's escape fire

Daniel J. Schumacher, Benjamin Kinnear, Carol Carraccio, Eric Holmboe, Jamiu O. Busari, Cees van der Vleuten, Lorelei Lingard

Summary: High-value care is not often delivered in healthcare, but medical education can provide the spark for change by embracing competency-based medical education (CBME) and centering the patient. The authors argue that medical educators must adopt a new approach, treat CBME as an adaptive challenge, and prioritize genuine engagement and discussion.

MEDICAL TEACHER (2023)

Article Education, Scientific Disciplines

Unpacking the Social Constructs of Discrimination, Othering, and Belonging in Medical Schools

Omolayo Anjorin, Jamiu O. Busari

Summary: In this article, the authors draw on their own lived experiences to provide a critical sociological overview of the challenges faced by racial/ethnic minority students in medical education. They examine the concepts of categorization, othering, and belonging in the context of medical education, and highlight the psychological and academic consequences of overgeneralizing social categories.

TEACHING AND LEARNING IN MEDICINE (2023)

Article Education & Educational Research

An exploratory university-based cross-sectional study of the prevalence and reporting of mistreatment and student-related factors among Thai medical students

Waravudh Naothavorn, Pongtong Puranitee, Winitra Kaewpila, Sutida Sumrithe, Sylvia Heeneman, Walther N. K. A. van Mook, Jamiu O. O. Busari

Summary: This study examined the prevalence and characteristics of mistreatment among medical students in Thailand, as well as the reporting, student-related factors, and consequences of mistreatment. The majority of participants reported experiencing mistreatment, with workplace learning-related bullying being the most common type and attending staff or teachers being the most common source. Only a small number of students reported these instances of mistreatment to others. Students' academic year was significantly related to workplace learning-related bullying, and mistreatment was associated with the risk of depression, burnout, and unprofessional behavior.

BMC MEDICAL EDUCATION (2023)

Article Health Care Sciences & Services

Studies on Reliability and Measurement Error of Measurements in Medicine-From Design to Statistics Explained for Medical Researchers

Lidwine B. Mokkink, Iris Eekhout, Maarten Boers, Cees P. M. van der Vleuten, Henrica C. W. de Vet

Summary: Reliability and measurement error are measurement properties that assess the impact of various sources of variation on individual measurements. Different designs can be used to evaluate reliability and measurement error, based on choices about which sources of variation are manipulated, which are controlled, and whether the entire measurement instrument or only part of it is repeated. This paper explains how these choices affect the calculation of intraclass correlation coefficients and standard errors of measurement using Venn diagrams, and provides recommendations for improving measurement and reporting study essentials.

PATIENT-RELATED OUTCOME MEASURES (2023)

Review Education & Educational Research

How do workplace educators assess student performance at the workplace? A qualitative systematic review

Marlies E. De Vos, Liesbeth K. J. Baartman, Cees P. M. van der Vleuten, Elly De Bruijn

Summary: One aim of vocational education is to educate students to become successful practitioners by developing their capacities. Learning at the workplace requires assessment and close communication between school and work. Workplace assessment is influenced by day-to-day work and relationships, and requires negotiated criteria and collaborative practices.

VOCATIONS AND LEARNING (2023)

Article Education, Scientific Disciplines

TRainee Attributable & Automatable Care Evaluations in Real-time (TRACERs): A Scalable Approach for Linking Education to Patient Care

Jesse Burk-Rafel, Stefanie S. Sebok-Syer, Sally A. Santen, Joshua Jiang, Holly A. Caretta-Weyer, Eduardo Iturrate, Matthew Kelleher, Eric J. Warm, Daniel J. Schumacher, Benjamin Kinnear

Summary: Competency-based medical education focuses on trainees' learning of necessary competencies for effective patient care. However, trainees often lack measures of their clinical performance, which hinders their learning progression evaluation. This article introduces TRACERs, a new type of measure that optimizes automation and trainee attribution, aiming to link education to patient care more effectively.

PERSPECTIVES ON MEDICAL EDUCATION (2023)

Article Education & Educational Research

Designing Formative Assessment That Improves Teaching and Learning: What Can Be Learned from the Design Stories of Experienced Teachers?

Janneke van der Steen, Tamara van Schilt-Mol, Cees van der Vleuten, Desiree Joosten-ten Brinke

Summary: This study investigates the difficulties teachers encounter while designing formative assessment plans and the strategies experienced teachers use to avoid those pitfalls. Through interviews, seven design strategies were identified that help to create effective formative assessment plans. However, experienced teachers still face challenges in decision-making and creating room for improvement. The lessons learned from these strategies can be incorporated into all teachers' design steps for formative assessment plans.

JOURNAL OF FORMATIVE DESIGN IN LEARNING (2023)

No Data Available