4.5 Article

Examiner characteristics and interrater reliability in a communication OSCE

Journal

PATIENT EDUCATION AND COUNSELING
Volume 100, Issue 6, Pages 1230-1234

Publisher

ELSEVIER IRELAND LTD
DOI: 10.1016/j.pec.2017.01.013

Keywords

Communication competence; Assessment; Examiner factors; OSCE

Ask authors/readers for more resources

Objective: To identify inter-individual examiner factors associated with interrater reliability in a summative communication OSCE in the 4th study year. Methods: The OSCE consists of 4 stations assessed with a 4-item 5-point global rating instrument. A bivariate secondary analysis of interrater reliability in relation to 4 examiner factors (gender, profession, OSCE experience, examiner training) was conducted. Intraclass correlation coefficients (ICC) were calculated and compared between examiner dyads of different similarity. Results: 169 pairwise ratings from 19 different examiners in 16 dyads were analysed. Interrater reliability is significantly higher in examiner dyads of same vs. different gender (ICC = 0.76 (95% CI = 0.65-0.83) vs. ICC = 0.41 (95% CI = 0.21-0.57)), in dyads of two clinicians vs. non-clinical/mixed professions (ICC = 0.72 (95% CI = 0.56-0.83) vs. ICC = 0.57 (95% CI = 0.41-0.69)), and in dyads with high vs. low/mixed OSCE experience (ICC = 0.73 (95% CI 0.50-0.87) vs. ICC = 0.56 (95% CI = 0.41-0.69)). Participation in recent examiner training had no influence on ICCs. Conclusion: Better concordance of ratings between clinically active examiners might be a hint for context specificity of good communication. Higher interrater reliability between examiners with same gender may indicate gender-specific communication concepts. Practice implications: Medical faculties introducing summative assessment of communication competence should focus the influence of examiner characteristics on interrater reliability. (C) 2017 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Primary Health Care

General practitioners' attitudes towards patients with poorly controlled type 2 diabetes: a qualitative study

Anja Wollny, Michael Pentzek, Oliver Rudolf Herber, Heinz-Harald Abholz, Jurgen In der Schmitten, Andrea Icks, Stefan Wilm, Elisabeth Gummersbach

BMC FAMILY PRACTICE (2018)

Article Primary Health Care

Prevalence of pain and its associated factors among the oldest-olds in different care settings - results of the AgeQualiDe study

Tina Mallon, Annette Ernst, Christian Brettschneider, Hans-Helmut Koenig, Tobias Luck, Susanne Roehr, Siegfried Weyerer, Jochen Werle, Edelgard Moesch, Dagmar Weeg, Angela Fuchs, Michael Pentzek, Luca Kleineidam, Kathrin Heser, Steffi Riedel-Heller, Wolfgang Maier, Birgitt Wiese, Martin Scherer

BMC FAMILY PRACTICE (2018)

Article Nutrition & Dietetics

Prospective Associations between Single Foods, Alzheimer's Dementia and Memory Decline in the Elderly

Karina Fischer, Debora Melo van Lent, Steffen Wolfsgruber, Leonie Weinhold, Luca Kleineidam, Horst Bickel, Martin Scherer, Marion Eisele, Hendrik van den Bussche, Birgitt Wiese, Hans-Helmut Koenig, Siegfried Weyerer, Michael Pentzek, Susanne Roehr, Wolfgang Maier, Frank Jessen, Matthias Schmid, Steffi G. Riedel-Heller, Michael Wagner

NUTRIENTS (2018)

Article Geriatrics & Gerontology

Is function in instrumental activities of daily living a useful feature in predicting Alzheimer's disease dementia in subjective cognitive decline?

Susanne Roehr, Steffi G. Riedel-Heller, Hanna Kaduszkiewicz, Michael Wagner, Angela Fuchs, Carolin van der Leeden, Birgitt Wiese, Jochen Werle, Horst Bickel, Hans-Helmut Koenig, Steffen Wolfsgruber, Michael Pentzek, Dagmar Weeg, Silke Mamone, Siegfried Weyerer, Christian Brettschneider, Wolfgang Maier, Martin Scherer, Frank Jessen, Tobias Luck

INTERNATIONAL JOURNAL OF GERIATRIC PSYCHIATRY (2019)

Article Neurosciences

Subjective Cognitive Decline May Be a Stronger Predictor of Incident Dementia in Women than in Men

Kathrin Heser, Luca Kleineidam, Birgitt Wiese, Anke Oey, Susanne Roehr, Alexander Pabst, Hanna Kaduszkiewicz, Hendrik van den Bussche, Christian Brettschneider, Hans-Helmut Koenig, Siegfried Weyerer, Jochen Werle, Angela Fuchs, Michael Pentzek, Edelgard Moesch, Horst Bickel, Wolfgang Maier, Martin Scherer, Steffi G. Riedel-Heller, Michael Wagner

JOURNAL OF ALZHEIMERS DISEASE (2019)

Article Endocrinology & Metabolism

Which patients with type 2 diabetes mellitus are perceived as 'difficult' by general practitioners?

Michael Pentzek, Sara Santos, Anja Wollny, Elisabeth Gummersbach, Oliver Rudolf Herber, Juergen In Der Schmitten, Andrea Icks, Heinz-Harald Abholz, Stefan Wilm

PRIMARY CARE DIABETES (2019)

Article Geriatrics & Gerontology

Prevalence and determinants of driving habits in the oldest old: Results of the multicenter prospective AgeCoDe-AgeQualiDe study

Andre Hajek, Christian Brettschneider, Marion Eisele, Hendrik van den Bussche, Birgitt Wiese, Silke Mamone, Siegfried Weyerer, Jochen Werle, Verena Leve, Michael Pentzek, Susanne Roehr, Janine Stein, Horst Bickel, Edelgard Moesch, Kathrin Heser, Michael Wagner, Martin Scherer, Wolfgang Maier, Steffi G. Riedel-Heller, Hans-Helmut Koenig, Heinz-Harald Abholz, Cadja Bachmann, Wolfgang Blank, Sandra Eifflaender-Gorfer, Annette Ernst, Angela Fuchs, Frank Jessen, Hanna Kaduszkiewicz, Teresa Kaufeler, Mirjam Koehler, Alexander Koppara, Diana Lubisch, Tobias Luck, Dagmar Luehmann, Melanie Luppa, Tina Mallon, Manfred Mayer, Jana Prokein, Alfredo Ramirez, Anna Schumacher, Susanne Steinmann, Franziska Tebarth, Carolin van der Leeden, Klaus Weckbecker, Dagmar Weeg, Steffen Wolfsgruber, Thomas Zimmermann

ARCHIVES OF GERONTOLOGY AND GERIATRICS (2019)

Article Psychiatry

Prevalence of Anxiety Symptoms and Their Association With Loss Experience in a Large Cohort Sample of the Oldest-Old. Results of the AgeCoDe/AgeQualiDe Study

Franziska D. Welzel, Janine Stein, Susanne Roehr, Angela Fuchs, Michael Pentzek, Edelgard Moesch, Horst Bickel, Siegfried Weyerer, Jochen Werle, Birgitt Wiese, Anke Oey, Andre Hajek, Hans-Helmut Koenig, Kathrin Heser, Luca Keineidam, Hendrik van den Bussche, Carolin van der Leeden, Wolfgang Maier, Martin Scherer, Michael Wagner, Steffi G. Riedel-Heller

FRONTIERS IN PSYCHIATRY (2019)

Article Primary Health Care

Patient-centered communication and shared decision making to reduce HbA1c levels of patients with poorly controlled type 2 diabetes mellitus - results of the cluster-randomized controlled DEBATE trial

Anja Wollny, Attila Altiner, Anne Daubmann, Eva Drewelow, Christian Helbig, Susanne Loescher, Michael Pentzek, Sara Santos, Karl Wegscheider, Stefan Wilm, Christin Loeffler

BMC FAMILY PRACTICE (2019)

Article Neurosciences

Women Outperform Men in Verbal Episodic Memory Even in Oldest-Old Age: 13-Year Longitudinal Results of the AgeCoDe/AgeQualiDe Study

Johannes Golchert, Susanne Roehr, Tobias Luck, Michael Wagner, Angela Fuchs, Birgitt Wiese, Hendrik van den Bussche, Christian Brettschneider, Jochen Werle, Horst Bickel, Michael Pentzek, Anke Oey, Marion Eisele, Hans-Helmut Koenig, Siegfried Weyerer, Edelgard Moesch, Wolfgang Maier, Martin Scherer, Kathrin Heser, Steffi G. Riedel-Heller

JOURNAL OF ALZHEIMERS DISEASE (2019)

Article Primary Health Care

The value of the GP's clinical judgement in predicting dementia: a multicentre prospective cohort study among patients in general practice

Michael Pentzek, Michael Wagner, Heinz-Harald Abholz, Horst Bickel, Hanna Kaduszkiewicz, Birgitt Wiese, Siegfried Weyerer, Hans-Helmut Koenig, Martin Scherer, Steffi G. Riedel-Heller, Wolfgang Maier, Alexander Koppara, Hendrik van den Bussche, Christian Brettschneider, Cadja Bachmann, Wolfgang Blank, Sandra Eifflaender-Gorfer, Marion Eisele, Annette Ernst, Angela Fuchs, Kathrin Heser, Frank Jessen, Teresa Kaufeler, Mirjam Koehler, Carolin Lange, Diana Lubisch, Tobias Luck, Dagmar Luehmann, Melanie Luppa, Manfred Mayer, Edelgard Moesch, Tina Posselt, Jana Prokein, Susanne Roehr, Anna Schumacher, Janine Stein, Susanne Steinmann, Franziska Tebarth, Klaus Weckbecker, Dagmar Weeg, Jochen Werle, Steffen Wolfsgruber, Thomas Zimmermann

BRITISH JOURNAL OF GENERAL PRACTICE (2019)

Article Geriatrics & Gerontology

Lifestyle Aspects As A Predictor Of Pain Among Oldest-Old Primary Care Patients - A Longitudinal Cohort Study

Tina Mallon, Marion Eisele, Hans-Helmut Koenig, Christian Brettschneider, Susanne Roehr, Alexander Pabst, Siegfried Weyerer, Jochen Werle, Edelgard Moesch, Dagmar Weeg, Angela Fuchs, Michael Pentzek, Kathrin Heser, Birgitt Wiese, Luca Kleineidam, Michael Wagner, Steffi Riedel-Heller, Wolfgang Maier, Martin Scherer

CLINICAL INTERVENTIONS IN AGING (2019)

Article Gerontology

What Is Successful Aging? A Psychometric Validation Study of Different Construct Definitions

Luca Kleineidam, Myriam V. Thoma, Andreas Maercker, Horst Bickel, Edelgard Moesch, Andre Hajek, Hans-Helmut Koenig, Marion Eisele, Tina Mallon, Tobias Luck, Susanne Roehr, Siegfried Weyerer, Jochen Werle, Michael Pentzek, Angela Fuchs, Birgitt Wiese, Silke Mamone, Martin Scherer, Wolfgang Maier, Steffi G. Riedel-Heller, Michael Wagner

GERONTOLOGIST (2019)

Article Psychiatry

Health Insurance in Old Age and Differences in Cognition, Depressive Symptoms and Health-Related Quality of Life

Jens-Oliver Bock, Andre Hajek, Dagmar Luehmann, Annette Ernst, Silke Mamone, Birgitt Wiese, Siegfried Weyerer, Jochen Werle, Michael Pentzek, Angela Fuchs, Janine Stein, Tobias Luck, Horst Bickel, Dagmar Weeg, Michael Wagner, Martin Scherer, Steffi G. Riedel-Heller, Wolfgang Maier, Hans-Helmut Koenig

PSYCHIATRISCHE PRAXIS (2018)

Article Health Policy & Services

Does place of residence have an influence on shared decision making for patients with type 2 diabetes in general practice?

Eva Drewelow, Sara Santos, Anne Hornung, Attila Altiner, Christin Loeffler, Michael Pentzek, Stefan Wilm, Susanne Loescher, Anja Wollny

ZEITSCHRIFT FUR EVIDENZ FORTBILDUNG UND QUALITAET IM GESUNDHEITSWESEN (2018)

Article Public, Environmental & Occupational Health

Exploring health advice by dental professionals in USA: A secondary data analysis of NHANES (2015-2018)

Noora Jawad, Faisal F. Hakeem, Wael Sabbah

Summary: This study aims to examine socioeconomic and ethnic variations in the provision of health advice by dental professionals. The findings indicate the prominent roles of education level, ethnicity, and smoking status in the provision of health advice. The study emphasizes the need for targeted interventions to promote equity and cultural competence in delivering health advice in dental settings.

PATIENT EDUCATION AND COUNSELING (2024)

Review Public, Environmental & Occupational Health

The 'Kidney' model for optimising feedback in undergraduate clinical communication: A meta-ethnographic systematic review

Katherine Miles, Bernadette O'Neill, Shuangyu Li

Summary: This study conducted a meta-ethnography to identify and synthesize guidance for optimizing feedback interactions in undergraduate clinical communication simulations. The findings led to the development of a new Feedback Kidney Model, which can guide medical education and future research on feedback in promoting learning. Incorporating meta-cognitive training and utilizing the model can help improve students' learning and communication with patients through on-site face-to-face feedback.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Implementing bedside handovers in mental health care: Insights from an experience-based co-design

Ellen Van de Velde, Ann Van Hecke, Kristof Eeckloo, Simon Malfait

Summary: This study investigates the suitability of experience-based co-design as a method for designing bedside handover in mental health care, and finds that it is a suitable method for enhancing patient involvement in nursing handovers in a general hospital's mental healthcare unit.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Exploring factors to interpretation of targeted nutrition messages for people living with multiple sclerosis

Yasmine Probst, Maddison Luscombe, Marta Hilfischer, Vivienne Guan, Lauren Houston

Summary: This study explores the interpretation of MS-targeted nutrition messages using semi-structured interviews. The findings reveal that dietary changes made by patients with MS after diagnosis are a coping mechanism to address uncertainty, fear of disease progression, and the risk of relapse. The admiration and skepticism towards extremist MS diets depend on individual vulnerability and support from healthcare professionals. The unique MS journey influences the interpretation of the messages, driven by engagement, practicality, and credibility.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Role of digital health communication, sociodemographic factors, and medical conditions on perceived quality of patient-centered communication

Aisha T. Langford, Kerli Orellana, Nancy Buderer, Katerina Andreadis, Stephen K. Williams

Summary: This study examined the associations between digital health, sociodemographic factors, and medical conditions on patient-centered communication (PCC). The results suggested that age, education level, household income, and history of hypertension were related to the quality of PCC.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

'Symptom-free' when inflammatory bowel disease is in remission: Expectations raised by online resources

Danielle Huisman, Taylor Burrows, Louise Sweeney, Kirsty Bannister, Rona Moss-Morris

Summary: This study found limited information on symptoms during remission of inflammatory bowel disease (IBD) on readily searchable patient websites, which fails to adequately explain the persistence of symptoms during remission for patients.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Why affiliation matters: A conversation analysis of complaints calls to the NHS

Bethan Benwell, Maria Erofeeva, Catrin S. Rhys

Summary: This study examined how language choices made by call handlers affect the progress of complaint calls and the stance of the callers. The findings showed that displaying affiliation at relevant moments in the conversation helps advance the call and de-escalate the complaint, while the absence or misplacement of affiliation may lead to escalation. Early intervention in establishing affiliation with the caller's concerns and reasoning is crucial for de-escalation.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Race differences in patient trust and distrust from audio-recorded cardiology encounters

Sarah V. Hantzmon, Clemontina A. Davenport, Maya N. Das Gupta, Temi A. Adekunle, Sarah E. Gaither, Maren K. Olsen, Sandro O. Pinheiro, Kimberly S. Johnson, Hannah Mahoney, Allison Falls, Lauren Lloyd, Kathryn I. Pollak

Summary: This study examined the impact of racial differences on patient trust and distrust in physician-patient interactions through audio-recorded cardiologist-patient encounters. The results showed that Black patients had lower expressions of trust and a higher level of guardedness compared to White patients. It suggests that White clinicians can improve communication with Black patients to increase expressions of trust.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Youth perspectives on mobile health adherence interventions: A qualitative study guided by the supportive accountability model

Caitlin S. Sayegh, Ellen Iverson, Karen K. Macdonell, Shinyi Wu, Marvin Belzer

Summary: This study applied a Supportive Accountability Model to examine youth's perception of remote human coaching and automated reminders for medication adherence. The findings indicated that both coaching and automated reminders were effective in improving adherence, with coaching being viewed as more potent and engaging. Phone calls enhanced the sense of supportive accountability, but texts were more convenient and flexible. Individual preferences varied.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Conversation starters: Understanding the facilitators and barriers to physician-initiated secure firearm storage conversations

Jennifer Necci Dineen, Mitchell Doucette, Mekaila Carey, Kerri M. Raissian

Summary: This paper aims to understand the facilitators and barriers perceived by general practice physicians in initiating anticipatory guidance around firearm safety. Qualitative interviews were conducted with 18 GPs to explore their perspectives. Barriers to providing secure firearm storage counseling include inadequate screening mechanisms, limited understanding of who is at risk for firearm injury, time pressures, concerns about patient receptivity, and a need for training. Structural issues need to be addressed before focusing on how to have conversations about firearm safety.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

The use of outcome data in patient consultations from the healthcare professionals' and patients' perspectives: A mixed methods study

Henrike J. Westerink, Cato C. Bresser, Mirjam M. Garvelink, Cornelia F. van Udenkraan, Ouisam Zouitni, Hans A. J. Bart, Philip J. van der Wees, Paul B. van der Nat

Summary: This study aims to explore the perspectives and needs of healthcare professionals (HCPs) and patients regarding the use of outcome data in consultations. The findings indicate that HCPs do not routinely use aggregated outcome data in consultations due to various barriers. Patients, however, consider aggregated outcome data important but have different preferences based on their health conditions.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Co-facilitation to foster equity in codesign: Mechanisms underpinning practice

Bronwyn Newman, Mashreka Sarwar, Ashfaq Chauhan, Reema Harrison

Summary: Co-facilitation presents an opportunity to address inequity in codesign, and through our experiences in the CanEngage project, we have identified three mechanisms to promote equity.

PATIENT EDUCATION AND COUNSELING (2024)

Review Public, Environmental & Occupational Health

Group-based patient education via videoconference: A scoping review

Andre Vaagan, Mette Haaland-Overby, Alison Axisa Eriksen, Kari Fredriksen, Vibeke Stenov, Cecilie Varsi, Brynja Ingadottir, Bryan Richard Cleal, Anita Royneberg Alvheim, Karl Fredrik Westermann, Hilde Stromme, Olof Birna Kristjansdottir

Summary: This study summarizes the recent evidence on the feasibility, acceptability, and effectiveness of videoconference group-based patient and caregiver education. The results suggest that this education approach is highly feasible and acceptable, and may improve health outcomes for participants. However, the evidence of effectiveness is limited and the quality of studies varies. Further research is needed to establish the effectiveness of this education approach for different patient and caregiver groups.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

Conversation topics in psychiatric consultations conducted with and without a shared decision-making tool: A qualitative content analysis

Momoka Igarashi, Takayuki Kawaguchi, Takuma Shiozawa, Sosei Yamaguchi

Summary: The study aims to identify conversation topics, who initiated the topics, and differences in topics with and without the use of a shared decision-making (SDM) tool in psychiatric outpatient consultations. The findings show that daily life issues, especially related to work, were the main topics discussed, and the SDM tool seems to facilitate discussion of patients' concerns.

PATIENT EDUCATION AND COUNSELING (2024)

Article Public, Environmental & Occupational Health

What's after COVID-19?: Communication pathways influencing future use of telehealth

Qiwei Luna Wu, Grace Ellen Brannon

Summary: This study explores how patient-centered communication, media, and organizational factors influence patients' intentions to use telehealth. The findings suggest that positive healthcare experiences, organizational support, and quality media designs are associated with telehealth adoption.

PATIENT EDUCATION AND COUNSELING (2024)