4.6 Article

Enhancing students' learning in problem based learning: validation of a self-assessment scale for active learning and critical thinking

Journal

BMC MEDICAL EDUCATION
Volume 15, Issue -, Pages -

Publisher

BMC
DOI: 10.1186/s12909-015-0422-2

Keywords

-

Funding

  1. Directorate General Higher Education of Indonesia (DIKTI)

Ask authors/readers for more resources

Background: Problem based learning (PBL) is a powerful learning activity but fidelity to intended models may slip and student engagement wane, negatively impacting learning processes, and outcomes. One potential solution to solve this degradation is by encouraging self-assessment in the PBL tutorial. Self-assessment is a central component of the self-regulation of student learning behaviours. There are few measures to investigate self-assessment relevant to PBL processes. We developed a Self-assessment Scale on Active Learning and Critical Thinking (SSACT) to address this gap. We wished to demonstrated evidence of its validity in the context of PBL by exploring its internal structure. Methods: We used a mixed methods approach to scale development. We developed scale items from a qualitative investigation, literature review, and consideration of previous existing tools used for study of the PBL process. Expert review panels evaluated its content; a process of validation subsequently reduced the pool of items. We used structural equation modelling to undertake a confirmatory factor analysis (CFA) of the SSACT and coefficient alpha. Results: The 14 item SSACT consisted of two domains active learning and critical thinking. The factorial validity of SSACT was evidenced by all items loading significantly on their expected factors, a good model fit for the data, and good stability across two independent samples. Each subscale had good internal reliability (>0.8) and strongly correlated with each other. Conclusions: The SSACT has sufficient evidence of its validity to support its use in the PBL process to encourage students to self-assess. The implementation of the SSACT may assist students to improve the quality of their learning in achieving PBL goals such as critical thinking and self-directed learning.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Health Care Sciences & Services

Modeling the effect of social interdependence in interprofessional collaborative learning

Ikuo Shimizu, Teiji Kimura, Robbert Duvivier, Cees van der Vleuten

Summary: This study aimed to investigate the relationship between students' social interdependence in collaborative learning and their readiness for interprofessional practice. The results showed that awareness of objectives positively predicted interprofessional collaboration and identity, while specific roles as health professionals negatively predicted interprofessional roles and identity. Therefore, increasing awareness and reconstructing the curriculum can enhance interprofessional education effectiveness.

JOURNAL OF INTERPROFESSIONAL CARE (2022)

Article Education & Educational Research

Using cultural historical activity theory to reflect on the sociocultural complexities in OSCE examiners' judgements

Wai Yee Amy Wong, Jill Thistlethwaite, Karen Moni, Chris Roberts

Summary: This study applies cultural historical activity theory (CHAT) to explore the sociocultural factors that influence examiners' judgements in a high-stakes objective structured clinical examination (OSCE). It identifies four key factors that influence examiners' judgements and highlights the contradictions created by interactions between different elements such as examiners and rules, providing insights for examiner training to enhance assessment practice.

ADVANCES IN HEALTH SCIENCES EDUCATION (2023)

Article Education, Scientific Disciplines

Utility of a multimodal computer-based assessment format for assessment with a higher degree of reliability and validity

Johan Renes, Cees P. M. van der Vleuten, Carlos F. Collares

Summary: This study compares a novel multimodal test format called Proxy-CBA with the traditional MCQ-CBA and finds that Proxy-CBA has higher reliability and validity, while maintaining similar cognitive load, suggesting its utility as an alternative assessment format.

MEDICAL TEACHER (2023)

Article Education & Educational Research

Entrustable Professional Activities and Learning: The Postgraduate Trainee Perspective

Alice Stephan, Gary Cheung, Cees van der Vleuten

Summary: This study aimed to explore the impact of entrustable professional activities (EPAs) on motivation and learning of psychiatry trainees. The results showed that the impact of EPAs on learning was mediated by the trainee's appraisals of subjective control, value, and the costs of engaging with EPAs. Positive appraisals encouraged focused and structured learning with the supervisor, while negative appraisals led to a superficial approach. The granularity of EPAs, alignment with clinical practice, and the supervisor's conscientiousness were found to influence trainee appraisals and subsequent motivation and learning.

ACADEMIC PSYCHIATRY (2023)

Article Education, Scientific Disciplines

Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine

Alina Smirnova, Saad Chahine, Christina Milani, Abigail Schuh, Stefanie S. Sebok-Syer, Jordan L. Swartz, Jeffrey A. Wilhite, Adina Kalet, Steven J. Durning, Kiki M. J. M. H. Lombarts, Cees P. M. van der Vleuten, Daniel J. Schumacher

Summary: By analyzing electronic health record data, it is possible to use adjusted data to assess residents' clinical performance in pediatric emergency medicine and identify opportunities for quality improvement.

ACADEMIC MEDICINE (2023)

Review Education, Scientific Disciplines

The Effect of Assessments on Student Motivation for Learning and Its Outcomes in Health Professions Education: A Review and Realist Synthesis

Rashmi A. Kusurkar, Cesar Orsini, Sunia Somra, Anthony R. Artino, Hester E. M. Daelmans, Linda J. Schoonmade, Cees van der Vleuten

Summary: The research found that assessments can have both positive and negative effects on student motivation for learning in health professions education. Assessments that stimulate controlled motivation tend to have negative outcomes, while those that stimulate autonomous motivation have positive outcomes. Students often focus on studying for assessments rather than acquiring knowledge relevant to professional practice.

ACADEMIC MEDICINE (2023)

Article Education & Educational Research

Validity evidence and psychometric evaluation of a socially accountable health index for health professions schools

Cassandra Barber, Cees van der Vleuten, Saad Chahine

Summary: This paper demonstrates how open access, pan-national health data can be used to create a reliable health index to assist schools in identifying societal needs and advance social accountability in health professions education. A final 5-factor multidimensional model was developed to help schools understand societal needs.

ADVANCES IN HEALTH SCIENCES EDUCATION (2023)

Article Medicine, General & Internal

Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations

Pedro Grilo Diogo, Vitor Hugo Pereira, Frank Papa, Cees van der Vleuten, Steven J. Durning, Nuno Sousa

Summary: This study analyzes student verbalizations during an Objective Structured Clinical Examination (OSCE) and correlates them with test scores and final medical degree (MD) scores. The results suggest that students with semantically richer and closer to the disease prototype verbalizations perform better academically.

DIAGNOSIS (2023)

Article Education & Educational Research

Between theory and practice: educators' perceptions on assessment quality criteria and its impact on student learning

Lonneke H. H. Schellekens, Wim D. J. Kremer, Marieke F. F. Van der Schaaf, Cees P. M. Van der Vleuten, Harold G. J. Bok

Summary: This study explores how educators perceive and achieve assessment quality, as well as their perceptions of the impact of assessment on student learning. The findings reveal that educators predominantly use traditional criteria to understand and achieve assessment quality, with limited awareness of quality criteria at the course and program levels. Additionally, educators perceive the impact of assessment on student learning in two distinct ways: as a source of information to monitor and direct learning, and as a tool to prompt learning.

FRONTIERS IN EDUCATION (2023)

Article Education, Scientific Disciplines

Marking parties for marking written assessments: A spontaneous community of practice

Emma Vaccari, Joyce Moonen-van Loon, Cees van der Vleuten, Paula Hunt, Bruce McManus

Summary: In this study, the researchers use a focused ethnographic approach to explore how the marking workload can be efficiently tackled. They find that marking parties not only contribute to driving deeper learning among students but also serve various functions in the examination process.

MEDICAL TEACHER (2023)

Article Education, Scientific Disciplines

Competency-based medical education: The spark to ignite healthcare's escape fire

Daniel J. Schumacher, Benjamin Kinnear, Carol Carraccio, Eric Holmboe, Jamiu O. Busari, Cees van der Vleuten, Lorelei Lingard

Summary: High-value care is not often delivered in healthcare, but medical education can provide the spark for change by embracing competency-based medical education (CBME) and centering the patient. The authors argue that medical educators must adopt a new approach, treat CBME as an adaptive challenge, and prioritize genuine engagement and discussion.

MEDICAL TEACHER (2023)

Article Health Care Sciences & Services

Studies on Reliability and Measurement Error of Measurements in Medicine-From Design to Statistics Explained for Medical Researchers

Lidwine B. Mokkink, Iris Eekhout, Maarten Boers, Cees P. M. van der Vleuten, Henrica C. W. de Vet

Summary: Reliability and measurement error are measurement properties that assess the impact of various sources of variation on individual measurements. Different designs can be used to evaluate reliability and measurement error, based on choices about which sources of variation are manipulated, which are controlled, and whether the entire measurement instrument or only part of it is repeated. This paper explains how these choices affect the calculation of intraclass correlation coefficients and standard errors of measurement using Venn diagrams, and provides recommendations for improving measurement and reporting study essentials.

PATIENT-RELATED OUTCOME MEASURES (2023)

Review Education & Educational Research

How do workplace educators assess student performance at the workplace? A qualitative systematic review

Marlies E. De Vos, Liesbeth K. J. Baartman, Cees P. M. van der Vleuten, Elly De Bruijn

Summary: One aim of vocational education is to educate students to become successful practitioners by developing their capacities. Learning at the workplace requires assessment and close communication between school and work. Workplace assessment is influenced by day-to-day work and relationships, and requires negotiated criteria and collaborative practices.

VOCATIONS AND LEARNING (2023)

Article Philosophy

Unpacking the impacts of programmatic approach to assessment system in a medical programme using critical realist perspectives

Priya Khanna, Chris Roberts, Annette Burgess, Stuart Lane, Jane Bleasel

Summary: Traditional assessment approaches are not effective in capturing the nuances of learners' clinical competence. Programmatic assessment, as an alternative approach, embraces subjectivity and holistic decision making in clinical settings. However, introducing programmatic assessment is challenging for faculty and staff due to its major departure from traditional assessment practices. This study applies critical realism and Bhaskar's theory to analyze the underlying conditions and mechanisms triggered by programmatic assessment's implementation.

JOURNAL OF CRITICAL REALISM (2023)

Article Education & Educational Research

Designing Formative Assessment That Improves Teaching and Learning: What Can Be Learned from the Design Stories of Experienced Teachers?

Janneke van der Steen, Tamara van Schilt-Mol, Cees van der Vleuten, Desiree Joosten-ten Brinke

Summary: This study investigates the difficulties teachers encounter while designing formative assessment plans and the strategies experienced teachers use to avoid those pitfalls. Through interviews, seven design strategies were identified that help to create effective formative assessment plans. However, experienced teachers still face challenges in decision-making and creating room for improvement. The lessons learned from these strategies can be incorporated into all teachers' design steps for formative assessment plans.

JOURNAL OF FORMATIVE DESIGN IN LEARNING (2023)

No Data Available