4.6 Article

New Tools for Systematic Evaluation of Teaching Qualities of Medical Faculty: Results of an Ongoing Multi-Center Survey

Journal

PLOS ONE
Volume 6, Issue 10, Pages -

Publisher

PUBLIC LIBRARY SCIENCE
DOI: 10.1371/journal.pone.0025983

Keywords

-

Funding

  1. Academic Medical Center, Amsterdam, The Netherlands
  2. Netherlands Organization for Scientific Research (NWO) [916.96.059]

Ask authors/readers for more resources

Background: Tools for the evaluation, improvement and promotion of the teaching excellence of faculty remain elusive in residency settings. This study investigates (i) the reliability and validity of the data yielded by using two new instruments for evaluating the teaching qualities of medical faculty, (ii) the instruments' potential for differentiating between faculty, and (iii) the number of residents' evaluations needed per faculty to reliably use the instruments. Methods and Materials: Multicenter cross-sectional survey among 546 residents and 629 medical faculty representing 29 medical (non-surgical) specialty training programs in the Netherlands. Two instruments-one completed by residents and one by faculty-for measuring teaching qualities of faculty were developed. Statistical analyses included factor analysis, reliability and validity exploration using standard psychometric methods, calculation of the numbers of residents' evaluations needed per faculty to achieve reliable assessments and variance components and threshold analyses. Results: A total of 403 (73.8%) residents completed 3575 evaluations of 570 medical faculty while 494 (78.5%) faculty self-evaluated. In both instruments five composite-scales of faculty teaching qualities were detected with high internal consistency and reliability: learning climate (Cronbach's alpha of 0.85 for residents' instrument, 0.71 for self-evaluation instrument, professional attitude and behavior (0.84/0.75), communication of goals (0.90/0.84), evaluation of residents (0.91/0.81), and feedback (0.91/0.85). Faculty tended to evaluate themselves higher than did the residents. Up to a third of the total variance in various teaching qualities can be attributed to between-faculty differences. Some seven residents' evaluations per faculty are needed for assessments to attain a reliability level of 0.90. Conclusions: The instruments for evaluating teaching qualities of medical faculty appear to yield reliable and valid data. They are feasible for use in medical residencies, can detect between-faculty differences and supply potentially useful information for improving graduate medical education.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Public, Environmental & Occupational Health

Performance of diagnostic coding and laboratory testing results to measure COVID-19 during pregnancy and associations with pregnancy outcomes

Annette K. Regan, Onyebuchi A. Arah, Sheena G. Sullivan

Summary: This study aims to evaluate the accuracy of diagnostic codes in detecting COVID-19 during pregnancy and finds that relying solely on ICD-coded diagnoses may result in missing over one-fifth of cases. The use of multiple sources of COVID-19 diagnostic information can improve the accuracy of epidemiological studies.

PAEDIATRIC AND PERINATAL EPIDEMIOLOGY (2022)

Article Public, Environmental & Occupational Health

Causal Effect of Chronic Pain on Mortality Through Opioid Prescriptions Application of the Front-Door Formula

Kosuke Inoue, Beate Ritz, Onyebuchi A. Arah

Summary: This study found that chronic pain increases the risk of all-cause mortality through opioid prescriptions. This highlights the importance of careful guideline-based chronic pain management to prevent death from possibly inappropriate opioid prescriptions driven by chronic pain.

EPIDEMIOLOGY (2022)

Article Public, Environmental & Occupational Health

Causes of Outcome Learning: a causal inference-inspired machine learning approach to disentangling common combinations of potential causes of a health outcome

Andreas Rieckmann, Piotr Dworzynski, Leila Arras, Sebastian Lapuschkin, Wojciech Samek, Onyebuchi Aniweta Arah, Naja Hulvej Rod, Claus Thorn Ekstrom

Summary: This study presents the Causes of Outcome Learning approach, which aims to discover combinations of exposures that lead to an increased risk of specific health outcomes. The approach involves a computational phase using a non-negative model, risk decomposition, and clustering individuals. Applying this approach enables the identification of complex causes and informs targeted public health interventions.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2022)

Article Education, Scientific Disciplines

Exploring nurses' role in guiding residents' workplace learning: A mixed-method study

Iris Jansen, Milou E. W. M. Silkens, Gerbrich Galema, Hester Vermeulen, Suzanne E. Geerlings, Kiki M. J. M. H. Lombarts, Renee E. Stalmeijer

Summary: This study aimed to understand the guiding role of nurses in residents' workplace learning and explore the perceptions and reasons of residents and nurses regarding this role. The results showed that nurses provided more support and guidance in learning from patient care compared to the perceptions of residents. Additionally, nurses indicated that attending physicians did not always involve them in guiding residents, while residents perceived nurses to be involved.

MEDICAL EDUCATION (2023)

Article Education, Scientific Disciplines

Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine

Alina Smirnova, Saad Chahine, Christina Milani, Abigail Schuh, Stefanie S. Sebok-Syer, Jordan L. Swartz, Jeffrey A. Wilhite, Adina Kalet, Steven J. Durning, Kiki M. J. M. H. Lombarts, Cees P. M. van der Vleuten, Daniel J. Schumacher

Summary: By analyzing electronic health record data, it is possible to use adjusted data to assess residents' clinical performance in pediatric emergency medicine and identify opportunities for quality improvement.

ACADEMIC MEDICINE (2023)

Article Public, Environmental & Occupational Health

Simultaneous adjustment of uncontrolled confounding, selection bias and misclassification in multiple-bias modelling

Paul Brendel, Aracelis Torres, Onyebuchi A. Arah

Summary: Traditional multiple-bias adjustment involves adjusting for biases one at a time, while a novel alternative approach is to simultaneously adjust for all biases using imputation and/or regression weighting. A simulation study showed that using correct bias parameters can yield unbiased effect estimates, and even incorrect specification of bias parameters still resulted in less bias compared to observed biased effects. Simultaneous multi-bias analysis is a useful method to investigate and understand how multiple biases can affect initial effect estimates, enhancing the validity and transparency of real-world evidence obtained from observational, longitudinal studies.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2023)

Article Oncology

Maternal anemia and the risk of childhood cancer: A population-based cohort study in Taiwan

Helen T. Orimoloye, Naveen Qureshi, Pei-Chen Lee, Chia-Kai Wu, Chai Saechao, Noah Federman, Chung-Yi Li, Beate Ritz, Onyebuchi A. Arah, Julia E. Heck

Summary: This study in Taiwan found that maternal anemia during pregnancy is related to childhood cancer. Nutritional anemia increases the risk of childhood cancer, while non-nutritional anemias do not.

PEDIATRIC BLOOD & CANCER (2023)

Article Multidisciplinary Sciences

Health care professionals' perceptions of unprofessional behaviour in the clinical workplace

Kirsten F. A. A. Dabekaussen, Renee A. Scheepers, Erik Heineman, Adam L. Haber, Kiki M. J. M. H. Lombarts, Debbie A. D. C. Jaarsma, Jo Shapiro

Summary: Unprofessional behavior is a common issue in healthcare organizations and has negative impacts on trust, patient safety, the clinical learning environment, and clinician well-being. This study aims to investigate the types, frequency, sources, and targets of unprofessional behavior among healthcare professionals. The findings provide important insights for developing training and remediation initiatives to address specific types of professionalism lapses.

PLOS ONE (2023)

Review Cardiac & Cardiovascular Systems

Work-Related Well-Being Among Dutch Cardiologists-A National Survey

Rosa Bogerd, Milou E. W. M. Silkens, Debby G. Keuken, Rutger J. Hassink, Jose P. S. Henriques, Kiki M. J. M. H. Lombarts

Summary: This study is the first to comprehensively examine the well-being of cardiologists and its determinants, including both positive and negative dimensions. A national, multicenter, self-administered web-based questionnaire was conducted to collect data. The study found that workload, work-home interference, and team atmosphere predicted the negative dimensions of well-being, while autonomy predicted cardiologists' professional fulfillment. Physician-patient interactions, person-job fit, and individual resilience affected both dimensions. Dutch cardiologists scored relatively high on professional fulfillment and average on work exhaustion and interpersonal disengagement.

CURRENT PROBLEMS IN CARDIOLOGY (2023)

Article Public, Environmental & Occupational Health

Maternal vitamin D levels and male reproductive health: a population-based follow-up study

Anne Gaml-Sorensen, Nis Brix, Katia Keglberg Haervig, Christian Lindh, Sandra Sogaard Tottenborg, Karin Sorig Hougaard, Birgit Bjerre Hoyer, Andreas Ernst, Linn Hakonsen Arendt, Pernille Jul Clemmensen, Jens Peter Ellekilde Bonde, Tine Brink Henriksen, Gunnar Toft, Onyebuchi A. A. Arah, Cecilia Host Ramlau-Hansen

Summary: Maternal vitamin D levels during pregnancy may have an impact on reproductive health in male offspring, affecting testes volume and total sperm count. This study found that lower maternal vitamin D levels during pregnancy were associated with decreased testes volume and lower total sperm count in adult sons. The findings were supported by continuous models, spline plots, and instrumental variable analysis. Maternal vitamin D levels above 75 nmol/L during pregnancy may be beneficial for testes function in adult sons.

EUROPEAN JOURNAL OF EPIDEMIOLOGY (2023)

Article Public, Environmental & Occupational Health

The estimated effect of season and vitamin D in the first trimester on pubertal timing in girls and boys: a cohort study and an instrumental variable analysis

Anne Gaml-Sorensen, Nis Brix, Andreas Ernst, Lea Lykke Harrits Lunddorf, Christian Lindh, Gunnar Toft, Tine Brink Henriksen, Onyebuchi A. Arah, Cecilia Host Ramlau-Hansen

Summary: This study investigated whether the season of first trimester or maternal 25-hydroxyvitamin D-3 levels were associated with pubertal timing in children. The results showed that children of mothers who had their first trimester during November-April or had lower 25(OH)D-3 levels had earlier pubertal timing.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2023)

Article Public, Environmental & Occupational Health

Modeling COVID-19 infection dynamics and mitigation strategies for in-person K-6 instruction

Douglas E. Morrison, Roch Nianogo, Vladimir Manuel, Onyebuchi A. Arah, Nathaniel Anderson, Tony Kuo, Moira Inkelas

Summary: An agent-based model was developed to help school districts understand infection dynamics and the impact of preventive measures on outcomes. This model provides insights for policymakers on the effects of different interventions and infection risks on educational outcomes.

FRONTIERS IN PUBLIC HEALTH (2023)

Article Substance Abuse

Puff, Puff, Don't Pass: harm reduction for cannabis use during a viral respiratory pandemic

Ryan D. Assaf, Marjan Javanbakht, Pamina M. Gorbach, Onyebuchi A. Arah, Steven J. Shoptaw, Ziva D. Cooper

Summary: Prior to the COVID-19 pandemic, sharing prepared cannabis and cannabis-related paraphernalia was common. However, this study found that sharing of cannabis decreased during the pandemic, possibly due to risk mitigation strategies to prevent COVID-19 transmission.

HARM REDUCTION JOURNAL (2023)

Article Public, Environmental & Occupational Health

Investigation of the structure and magnitude of time-varying uncontrolled confounding in simulated cohort data analyzed using g-computation

Melissa Soohoo, Onyebuchi A. Arah

Summary: Time-varying uncontrolled confounding can have a substantial impact on observed effect estimates. Given the importance of longitudinal studies in guiding public health, the impact of time-varying uncontrolled confounding should be recognized and evaluated using quantitative bias analysis.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2023)

Article Public, Environmental & Occupational Health

The impact of maternal pertussis vaccination recommendation on infant pertussis incidence and mortality in the USA: an interrupted time series analysis

Catherine Psaras, Annette Regan, Roch Nianogo, Onyebuchi A. Arah, Marissa J. Seamans

Summary: This study examined the impact of the 2011/2012 ACIP pertussis recommendation on pertussis incidence and mortality among US infants. The results suggest that the recommendation may have led to a decrease in pertussis incidence, but had no significant effect on infant pertussis mortality.

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY (2023)

No Data Available