Article
Engineering, Industrial
Christian Lins, Sebastian Fudickar, Andreas Hein
Summary: The OWAS method shows high agreement in assessing arm postures at over 98%, but lower agreement for leg postures (66-97%) and upper body postures (80-96%). There was no significant difference between raters with and without intense prior training in physical therapy, indicating general reliability especially for raters with non-specialized backgrounds but weaknesses in detecting specific postures.
APPLIED ERGONOMICS
(2021)
Article
Nursing
Hien Thi Thu Do, Helen Edwards, Kathleen Finlayson
Summary: This study aimed to validate the construct validity and inter rater reliability of a surgical wound assessment tool. A total of 260 patients who underwent surgery in a hospital in Vietnam were recruited through convenience sampling. The results confirmed that the surgical wound assessment tool had good validity and reliability in monitoring the healing status of surgical wounds.
JOURNAL OF CLINICAL NURSING
(2023)
Article
Environmental Sciences
Daniel W. Smith, Samantha Wind, Igor A. Markov, Stephen Atwii Ongom, Jennifer Davis
Summary: Ensuring the functionality of drinking water supplies in low-and-middle-income countries has always been a challenge. A study on handpump functionality tests in Uganda found that the 10-minute leakage rate had the highest inter-rater reliability, followed by pump capacity. Flowrate, commonly measured manually, had poor inter-rater reliability. Based on the inter-rater reliability results, a fully quantitative procedure and an ordinal scale of physical handpump functionality were proposed.
SCIENCE OF THE TOTAL ENVIRONMENT
(2023)
Article
Education & Educational Research
Ricardo Monge-Rogel, Guillermo Duran-Gonzalez, Monica Panes-Martinez, Luis Gibran Juarez-Hernandez
Summary: This study constructed a tool to evaluate the perception of Digital Learning Resources (DLR) and validated its content validity and reliability through expert judgment and student assessment. The tool is able to assess students' cognitive contribution to DLR and provide clear guidance and understanding.
EDUCATION AND INFORMATION TECHNOLOGIES
(2022)
Article
Education & Educational Research
Zainab Akbar, Rehan Ahmed Khan, Humaira Fayyaz Khan, Rahila Yasmeen
Summary: This study aimed to develop and validate an instrument to measure the micro-learning environment of students, which can provide insights into students' real-life experiences and the disparity between taught, delivered, and learned curricula.
BMC MEDICAL EDUCATION
(2023)
Article
Social Sciences, Interdisciplinary
Magdalena Elnes, Hermundur Sigmundsson
Summary: In this article, the development and validation of a new measure for flow proneness, called the General Flow Proneness Scale, is reported. The scale is quantitatively measure and context independent. Test-retest reliability was demonstrated with a high Intraclass correlation coefficient (ICC) of .956. Further exploration on applicability, internal consistency, and construct validity was done with 228 participants, indicating promising results. Development of the General Flow Proneness Scale, including normalization based on a larger, representative sample, is warranted.
Article
Multidisciplinary Sciences
Chonnanid Limsakul, Kiattisak Sengchuai, Rakkrit Duangsoithong, Nattha Jindapetch, Jermphiphut Jaruenpunyasak
Summary: This study assessed the reliability of electromyography and range of motion measurements obtained using a knee exercise monitoring system. The results showed moderate to excellent inter- and intra-rater agreement for electromyography, but a small agreement bias for range of motion measurements.
Article
Social Sciences, Interdisciplinary
Noor Hidayah Che Lah, Zaidatun Tasir, Nurul Farhana Jumaat
Summary: This study evaluated the Online Social Learning Environment Instrument (OSLEI) using Rasch model analysis among undergraduate students in Malaysia. The results confirmed the reliability and validity of 35 items in the OSLEI for measuring online social learning environments.
Article
Education, Scientific Disciplines
Amir H. Sam, Michael D. Reid, Viral Thakerar, Mark Gurnell, Rachel Westacott, Malcolm W. R. Reed, Celia A. Brown
Summary: The study found that there is high inter-rater agreement among assessors from different regions in the UK when evaluating simulated student performances and expected standards for 'clear fail,' 'borderline,' 'clear pass,' and 'good' levels.
Article
Surgery
Chin-Hung Wei, Shih-Chiang Shen, Yih-Cherng Duh, Kuei-Yen Tsai, Hsin-An Chen, Shih-Wei Huang
Summary: The Moorthy checklist (MC) and laparoscopic skill competency assessment tool (LS-CAT) are reliable tools for evaluating laparoscopic suturing in different backgrounds. LS-CAT is particularly reliable for medical students and trainees. The current assessment model of single measurement by multiple raters provides excellent reliability.
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES
(2022)
Article
Neurosciences
Anna Cristina Aberg, Fredrik Olsson, Hanna Bozkurt Ahman, Olga Tarassova, Anton Arndt, Vilmantas Giedraitis, Lars Berglund, Kjartan Halvorsen
Summary: The new semiautomatic method aided by deep learning for estimating gait parameters from video-recorded TUG tests demonstrated good validity and reliability in the study, providing a suitable approach for quantifying gait in such assessments. The results support further exploration of cognitive-motor interference in dual-task testing.
Article
Education & Educational Research
Tudor Cristea, Chris Snijders, Uwe Matzat, Ad Kleingeld
Summary: Self-regulated learning has been a subject of research interest in online higher education due to its significance. Existing measurements of self-regulated learning either require excessive time and effort from students or are only partially applicable across courses. In this study, clickstream-based scales of four self-regulated learning phases were developed and shown to be portable across courses.
EDUCATION AND INFORMATION TECHNOLOGIES
(2023)
Review
Medicine, General & Internal
Helio Rocha Neto, Ana Lucia R. Moreira, Lucas Hosken, Joshua A. Langfus, Maria Tavares Cavalcanti, Eric Arden Youngstrom, Diogo Telles-Correia
Summary: This study aimed to assess the agreement between standardized and non-standardized diagnostic interviews for schizophrenia and Bipolar Affective Disorder (BD). A systematic review with meta-analysis was conducted, and the results showed fair agreement between SDI and NSDI, although there was high heterogeneity.
Article
Agriculture, Dairy & Animal Science
Laura Van Driessche, Gilles Fecteau, Julie Arsenault, Lea Miana, Younes Chorfi, Marianne Villettaz-Robichaud, Pierre Helie, Sebastien Buczinski
Summary: The study aimed to determine the inter-rater reliability of scoring systems used to detect abomasal lesions in veal calves, comparing macroscopic and histological lesions. Various scoring systems were used to assess 76 abomasa retrieved from veal calves, with lesions classified into erosions, ulcers, and scars. The results showed a variable agreement among raters for the presence or absence of a lesion, with better agreement observed when lesions were combined within certain areas. Poor to moderate agreement was found for the number of lesions. The study highlights the importance of developing a reliable scoring system to effectively assess abomasal lesions in veal calves.
Article
Health Care Sciences & Services
Heeae Seo, Jeongseon Kim, Changseon Yu, Hyoungwon Lim
Summary: Assessing muscle tone is crucial for the diagnosis, prognosis, and treatment planning of developmental disabilities in children. The myotonometer, an assessment tool used in this study, showed good reliability for measuring muscle tone in children with DD. The intra-rater and inter-rater reliability were excellent, indicating that the myotonometer can objectively assess muscle tone and be used in clinical practice.
Article
Public, Environmental & Occupational Health
Natasha Williams, Joseph Ravenell, Andrea E. Duncan, Mark Butler, Girardin Jean-Louis, Adina Kalet
ETHNICITY & DISEASE
(2020)
Article
Education & Educational Research
Jeffrey A. Wilhite, Lisa Altshuler, Sondra Zabar, Colleen Gillespie, Adina Kalet
BMC MEDICAL EDUCATION
(2020)
Article
Computer Science, Interdisciplinary Applications
Teresa M. Ober, Corinne J. Brenner, Alvaro Olsen, Bruce D. Homer, Jan L. Plass
Summary: Indicators of behavioral engagement derived from log data are crucial for understanding variation in interactions with digital cognitive skills training games. Different groups of adolescents were identified based on variables from digital log data collected during game play, showing associations with improvements in inhibitory control. This highlights the importance of using formative metrics and adaptive cognitive interventions to enhance student engagement and performance.
COMPUTERS & EDUCATION
(2021)
Article
Public, Environmental & Occupational Health
Adina Kalet, Tavinder K. Ark, Verna Monson, Hyuksoon S. Song, Lynn Buckvar-Keltz, Victoria Harnik, Sandra Yingling, Rafael Rivera, Linda Tewksbury, Penelope Lusk, Ruth Crowe
Summary: The study validates an approach to measuring professional identity formation by exploring the relationship between the Professional Identity Essay (PIE) stage scores and clinical communication skills. The results show that higher PIE stage scores are associated with improved communication skills across various domains, and that the communication skills of lower socio-economic status students are indirectly impacted by their slightly higher PIE stage scores.
PATIENT EDUCATION AND COUNSELING
(2021)
Article
Public, Environmental & Occupational Health
Stephen P. Wall, Patricio Castillo, Francine Shuchat Shaw, Elizabeth Norman, Natalia Martinez-Lopez, Mairyn Lopez-Rios, Hehidy Paulino, Bruce Homer, Jan L. Plass, Joseph E. Ravenell
Summary: This study aimed to investigate the impact of medical videos and storylines on deceased organ donor registration among clients in Latinx-owned barbershops and beauty salons. Results demonstrated that medical footage, sad, or unresolved storylines did not significantly affect registration and changes in organ donation willingness.
HEALTH EDUCATION & BEHAVIOR
(2022)
Article
Communication
Stephen P. Wall, Patricio Castillo, Francine Shuchat-Shaw, Elizabeth Norman, David Brown, Natalia Martinez-Lopez, Mairyn Lopez-Rios, Azizi A. Seixas, Jan L. Plass, Joseph E. Ravenell
Summary: This study evaluated the impact of different types of videos on organ donor registration among black men and found that targeted or tailored videos can increase the willingness stage of change for organ donation. However, they were not effective in encouraging registration.
JOURNAL OF HEALTH COMMUNICATION
(2022)
Article
Education, Scientific Disciplines
Kinga L. Eliasz, Michael W. Nick, Sondra Zabar, Lynn Buckvar-Keltz, Grace M. Ng, Thomas S. Riles, Adina L. Kalet
Summary: This study assessed the readiness-for-residency of graduating medical students through two assessment frameworks and found that while there were some discrepancies, overall the assessments were able to provide meaningful evaluations of all core EPAs.
TEACHING AND LEARNING IN MEDICINE
(2023)
Article
Psychology, Educational
Jessica E. Brodsky, Zachary Bergson, Ming Chen, Elizabeth O. Hayward, Jan L. Plass, Bruce D. Homer
Summary: This study examined the role of executive functions (EF) in adolescents' advanced theory of mind (aToM). The results showed that flexibility of social cognition varied based on ambiguity and language use, while automaticity of social cognition varied by ambiguity. The role of EF was less conclusive, with shifting and inhibition predicting some measures of flexibility and automaticity. Overall, ambiguity, language, and EF, particularly shifting, influence aToM in adolescence.
Article
Education & Educational Research
Elizabeth McAlpin, Marci Levine, Jan L. Plass
Summary: We investigated the effect of role-play and web-based simulations on learning outcomes for local anesthesia and non-surgical extractions in an oral maxillofacial surgery course for dental students. Role-play simulations achieved higher learning outcomes than web-based simulations, as supported by statistically significant main effects in two studies. The results demonstrate the importance of role-play simulations in enhancing cognitive engagement and learning for novice professionals.
LEARNING AND INSTRUCTION
(2023)
Article
Education & Educational Research
Burcu Izci, Rachel Louise Geesa, Shiyi Chen, Hyuksoon S. Song
Summary: This study investigates the home learning environments of Pre-K through 3rd-grade children and the perceptions, strategies, and attitudes of caregivers regarding home learning during the COVID-19 pandemic. The findings reveal that caregivers provide academic support, supervise children's technology use, and create study areas. The children mainly engage in learning activities in mathematics and language arts, completing homework and participating in activities with caregivers and siblings. The study highlights the importance of caregivers and technology use in improving children's learning at home.
JOURNAL OF RESEARCH IN CHILDHOOD EDUCATION
(2023)
Article
Education, Scientific Disciplines
Lisa Altshuler, Jeffrey A. Wilhite, Khemraj Hardowar, Ruth Crowe, Kathleen Hanley, Adina Kalet, Sondra Zabar, Colleen Gillespie, Tavinder Ark
Summary: By analyzing performance data from 1182 medical students, researchers identified six profiles of clinical communication skill performance. These profiles provided benchmarked guidance for curriculum improvement and coaching strategies. This study emphasizes the importance of tailored communication skills training in medical education.
Article
Education, Scientific Disciplines
Dafna Meitar, Daniel Marom, Penelope Lusk, Adina Kalet
Summary: Efforts to improve medical education must consider the connection between technical aspects and philosophical educational aims. A leadership program based on a five-level topology is proposed to guide transformative changes in medical education. Without a shared understanding of an ideal physician and the educational process, incremental reforms may occur and lead to conflicts in medical education systems.
TEACHING AND LEARNING IN MEDICINE
(2023)
Article
Psychology, Educational
Fabian Albers, Melanie Trypke, Ferdinand Stebner, Joachim Wirth, Jan L. L. Plass
Summary: This study examines the effects of redundancy on learning, comparing the impacts of content redundancy and modal redundancy through experiments. The results show that content redundancy enhances learning outcomes and reduces cognitive load, while modal redundancy has a negative effect on learning outcomes and increases cognitive load. These findings have theoretical implications for distinguishing between content redundancy and modal redundancy, and practical implications for improving the design of multimedia learning materials.
BRITISH JOURNAL OF EDUCATIONAL PSYCHOLOGY
(2023)
Proceedings Paper
Computer Science, Cybernetics
Jan L. Plass, Ken Perlin, Agnieszka Roginska, Chris Hovey, Fabian Frohlich, Aniol Saurina Maso, Alvaro Olsen, Zhenyi He, Robert Pahle, Sounak Ghosh
Summary: This paper discusses the design of effective immersive VR learning experiences. The study applies best practices for learning experience design and takes advantage of the unique affordances of VR to design a set of science learning simulations. The paper describes features related to interaction, collaboration, playfulness, and emotional design, as well as the front-end, client-server communication, and network framework implemented.
SERIOUS GAMES, JCSG 2022
(2022)
