Article
Psychology, Multidisciplinary
Andrea Spoto, Massimo Nucci, Elena Prunetti, Michele Vicovaro
Summary: Content validity refers to the relevance and representativeness of elements in an assessment instrument to the target construct. Existing methods for content validity evaluation focus on item relevance, but lack precise evaluation of item behavior and exhaustiveness with respect to the elements of the target construct. Formal content validity analysis (FCVA) is a new procedure that combines methods from psychological assessment, such as constructing Boolean classification matrices and computing interrater agreement indices. FCVA can be improved through Bayesian procedures (B-FCVA) to enhance the accuracy of interrater agreement indices.
PSYCHOLOGICAL METHODS
(2023)
Article
Biology
David G. Pina, Ivan Buljan, Darko Hren, Ana Marusic
Summary: Research indicates that changes in the organization of peer review for proposals submitted to the European Union's Marie Curie programme had little impact on the outcome, with factors such as grant type or research area playing a more significant role.
Article
Biochemical Research Methods
Jun Chen, Xianyang Zhang
Summary: Due to the sparsity and high dimensionality, microbiome data are often summarized into pairwise distances to capture compositional differences and gain biological insights through analyzing the distance matrix in relation to covariates. This study extends the traditional intraclass correlation coefficient (ICC) to distance measures, proposing a distance-based ICC (dICC) and demonstrating its effectiveness through the application of experimental data.
Article
Computer Science, Interdisciplinary Applications
Mohd Salami Ibrahim, Myat Moe Thwe Aung, San San Oo, Mohd Ihsanuddin Abas, Nur Azree Ferdaus Kamudin
Summary: This method proposes the use of the content validation template (CVT) for validating questionnaire content. The CVT automatically filters out items with poor item-level content validity index (I-CVI) and computes the final dataset for Gwet's chance-corrected Agreement Coefficient 2 (AC(2)) and standard error. Validation tests with existing statistical software validate the accuracy of CVT for different scenarios. Built in Excel, CVT provides researchers with a convenient and robust option for questionnaire content validation that eliminates the need for manual calculations.
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION
(2023)
Article
Multidisciplinary Sciences
Jane Whelan, Helen Marshall, Thomas R. Sullivan
Summary: Cluster randomized trials (cRCT) play a crucial role in assessing vaccine effectiveness by considering indirect effects of vaccination. This study investigated the impact of shared behaviors and characteristics on the ICC in a school-based cRCT evaluating the effectiveness of a meningococcal B vaccine. The findings suggest that adjusting for social behaviors and personal characteristics can significantly reduce the ICC for disease carriage.
Article
Orthopedics
Alfred P. Yoon, William T. Chung, Chien-Wei Wang, Chang-Fu Kuo, Chihung Lin, Kevin C. Chung
Summary: Using CNN assistance improves interobserver agreement and diagnostic sensitivity and specificity for occult scaphoid fractures. However, there is no clinically significant difference observed in diagnostic speed and confidence levels between CNN-assisted and non-assisted image interpretation.
CLINICAL ORTHOPAEDICS AND RELATED RESEARCH
(2023)
Article
Psychology, Mathematical
Michael Kevane, Birgit Koopmann-Holm
Summary: This paper examines the reliability and validity of classification images of faces using the reverse correlation approach, focusing on trial order effects, compliance, and reliability effects, as well as the degree of contextual contrast of image pairs. Through analysis of data from 12 studies, the study presents solutions and methods for these issues, providing R scripts for easy implementation in related research.
BEHAVIOR RESEARCH METHODS
(2021)
Review
Radiology, Nuclear Medicine & Medical Imaging
Cindy Xue, Jing Yuan, Gladys G. Lo, Amy T. Y. Chang, Darren M. C. Poon, Oi Lei Wong, Yihang Zhou, Winnie C. W. Chu
Summary: Radiomics research has been rapidly growing in recent years, with concerns on reliability raised. This systematic review focused on the use of the intraclass correlation coefficient (ICC) as a reliability metric in radiomics studies. The review found that while feature reliability to image segmentation is extensively studied, image acquisition introduces more variability than image segmentation, particularly in MRI studies.
QUANTITATIVE IMAGING IN MEDICINE AND SURGERY
(2021)
Article
Psychology, Multidisciplinary
Debby ten Hove, Terrence D. Jorgensen, L. Andries van der Ark
Summary: This study provides updated guidelines on selecting an ICC for interrater reliability (IRR), applicable to both complete and incomplete observational designs. The study challenges the conventional wisdom about ICCs for IRR by claiming that raters should seldom (if ever) be considered fixed and explains how to interpret ICCs in unbalanced and incomplete designs.
PSYCHOLOGICAL METHODS
(2022)
Article
Health Care Sciences & Services
Ariane M. Mbekwe Yepnang, Agnes Caille, Sandra M. Eldridge, Bruno Giraudeau
Summary: In cluster randomised trials, reporting the measure of intracluster correlation for each primary outcome is important for calculating sample size and interpreting trial results in future studies. The intracluster correlation, especially for binary outcomes, is affected by the prevalence of the outcome, which raises concerns about its use in different prevalence settings. Various measures like variance partition coefficient and tetrachoric correlation coefficient have been proposed for clustered binary data settings to address this issue.
STATISTICAL METHODS IN MEDICAL RESEARCH
(2021)
Article
Audiology & Speech-Language Pathology
Rachel Reetzke, Danika Pfeiffer, Luther G. Kalb, Calliope Holingue, Carrie Zetlmeisl, Ji Su Hong, Rebecca Landa
Summary: In a study comparing parent and speech-language pathologist (SLP) ratings of challenging behaviors and social communication skills in preschool children with ASD, it was found that there was significant disagreement between parents and SLPs in challenging behavior ratings, but moderate to good agreement in social communication ratings.
JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH
(2021)
Article
Statistics & Probability
Daniela Marella, Giuseppe Bove
Summary: This paper proposes measures of interrater absolute agreement for quantitative measurements based on the standard deviation. These measures overcome the limitations of existing methods and allow for measuring the agreement on single targets. The sampling properties of the proposed measures are investigated for normal and non-normal data, and the accuracy and practical utility of the new indices are demonstrated using simulated data. Lastly, an application to assess the consistency of measurements in evaluating lung cancer tumor size by radiologists is presented.
ASTA-ADVANCES IN STATISTICAL ANALYSIS
(2023)
Article
Statistics & Probability
Rashid S. Almehrizi, Mahmoud Emam
Summary: This article introduces the estimation methods of intraclass correlation coefficients commonly used in behavioral measurement, biometric, and psychometric. It proposes the asymptotic standard errors of absolute agreement ICC and relative consistency ICC for the two-way model. Monte Carlo simulations verify the accuracy of the proposed methods under different test conditions.
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION
(2023)
Article
Psychology, Developmental
Richard Vuijk, Mathijs Deen, Arnoud Arntz, Hilde M. Geurts
Summary: This study conducted a psychometric evaluation of a new diagnostic instrument for ASD, NIDA, in adult males in the Netherlands, showing high interrater agreement, promising convergent validity, and adequate concurrent criterion-related validity. These findings can serve as a foundation for future psychometric studies of NIDA in a more diverse population.
JOURNAL OF AUTISM AND DEVELOPMENTAL DISORDERS
(2022)
Article
Mathematics, Interdisciplinary Applications
Rutger Van Oest
Summary: This study examines the influence of a weighting scheme that penalizes rater disagreements on a broad class of chance-corrected weighted agreement coefficients. The power parameter is used to define the weighting scheme, and the relationship between the parameter and the coefficient value is explored through derivatives and component decomposition. Accurate estimates of coefficient values for unreported power parameter values can be obtained using these derivatives.
Review
Nursing
Alannah L. Cooper, Janie A. Brown, Gavin D. Leslie
Summary: Nurse resilience is a complex and dynamic process, with high levels of resilience associated with reduced psychological harm and increased well-being. Research has predominantly focused on individual factors affecting resilience, with minimal exploration of external factors such as work environment.
JOURNAL OF ADVANCED NURSING
(2021)
Article
Nursing
Alannah L. Cooper, Janie A. Brown, Siobhan P. Eccles, Narelle Cooper, Matthew A. Albrecht
Summary: The study measured the time spent on clinical documentation and the perceptions of nurses and midwives, finding that documentation occupied a significant amount of time with issues of duplication and redundancy. It is suggested to reduce the time spent on documentation to free up more time for patient care and improve nurses' job satisfaction.
JOURNAL OF CLINICAL NURSING
(2021)
Article
Nursing
Clare Harvey, Amy-Louise Byrne, Eileen Willis, Janie Brown, Adele Baldwin, Adjunct Desley Hegney, Janine Palmer, David Heard, David Brain, Brody Heritage, Bridget Ferguson, Jenni Judd, Sandy Mclellan, Rachel Forrest, Shona Thompson
Summary: Nurse navigators play a crucial role in rebuilding patient trust in the healthcare system and fostering collaboration between patients and healthcare teams. By providing authentic and holistic care, they can effectively reduce the likelihood of patient hospitalization.
Article
Endocrinology & Metabolism
Marian C. Brennan, Janie A. Brown, Gavin D. Leslie, Nikos Ntoumanis
Summary: This study used mixed methods to evaluate a group self-management education intervention for type 1 diabetes barriers to physical activity. Interviews and focus groups were conducted to assess the acceptability of study resources and procedures, as well as the perceived effectiveness of the intervention on participant outcomes. The results showed that study procedures were widely accepted, group education was preferred, but there were mixed feelings towards the private social media group.
CANADIAN JOURNAL OF DIABETES
(2022)
Article
Nursing
Kim Usher, Anthea Fagan, Janie A. Brown, Carey Mather, Annette Marlow, Tamara Power, Thea van de Mortel, Caryn West, Marie Hutchinson, Lin Zhao, Victoria Terry, Cindy Woods, Jackie Lea
Summary: Australian nursing students face significant financial challenges during mandatory work-integrated learning, which may result in some students unable to complete their placements, affecting the future healthcare workforce.
Article
Astronomy & Astrophysics
S. Hutschenreuter, C. S. Anderson, S. Betti, G. C. Bower, J-A Brown, M. Brueggen, E. Carretti, T. Clarke, A. Clegg, A. Costa, S. Croft, C. Eck, B. M. Gaensler, F. de Gasperin, M. Haverkorn, G. Heald, C. L. H. Hull, M. Inoue, M. Johnston-Hollitt, J. Kaczmarek, C. Law, Y. K. Ma, D. MacMahon, S. A. Mao, C. Riseley, S. Roy, R. Shanahan, T. Shimwell, J. Stil, C. Sobey, S. P. O'Sullivan, C. Tasse, V. Vacca, T. Vernstrom, P. K. G. Williams, M. Wright, T. A. Ensslin
Summary: This work updates the reconstruction of the Galactic Faraday rotation sky using the latest Faraday rotation data sets. The results show a thinner and more pronounced Galactic disc with small-scale structures exceeding several thousand rad m(-2). The improved resolution and handling of noisy and incomplete data contribute to these findings.
ASTRONOMY & ASTROPHYSICS
(2022)
Article
Nursing
Alannah L. Cooper, Jacqueline Mazzer, Dipna Martin-Robins, Janie A. Brown
Summary: This study aimed to understand the need for palliative care among adult inpatients, with results showing a high proportion of patients who were suitable for palliative care but were not receiving it.
JOURNAL OF CLINICAL NURSING
(2022)
Article
Nursing
Eric Lim, Fatch Kalembo, Anna Bosco, Irene Ngune, Bola Adebayo, Janie Brown
Summary: This study aimed to explore the experiences of international nursing students and potential strategies for improving their learning experiences during clinical placements, as viewed by clinical facilitators. The findings revealed the challenges faced by international nursing students and proposed strategies for improving their experiences. Future research can focus on supporting clinical facilitators to implement these strategies and facilitate positive learning experiences for international nursing students during clinical placements.
Article
Medicine, General & Internal
Janie Brown, Helen Myers, Derek Eng, Lucy Kilshaw, Jillian Abraham, Grace Buchanan, Liz Eggimann, Michelle Kelly
Summary: This study evaluates the impact of a communication skills training program on patient, family/carer, and clinician outcomes through a multisite, longitudinal mixed-methods study. The research includes online surveys and interviews, assessing the workshops' effect on satisfaction, confidence, and integration of best practice communication skills.
Article
Nursing
Alannah L. Cooper, Gavin D. Leslie, Janie A. Brown
Summary: This study aimed to explore how external factors influence nurse resilience and incorporate this knowledge into an updated definition of nurse resilience. Analysis of the data revealed that factors such as work conditions, organizational philosophy, manager performance, and team dynamics can affect nurse resilience.
INTERNATIONAL JOURNAL OF MENTAL HEALTH NURSING
(2022)
Article
Nursing
Lesley Kuliukas, Janie Brown, Anna Bosco, Zoe Bradfield
Summary: This study aimed to explore the views of midwifery students, academics, and senior academic managers on the continuity approach and team-teaching approach in midwifery education. The findings showed that the continuity approach provided relationship building, consistency of advice, and assessment expectations, while the team-teaching approach offered a variety of teaching styles and midwifery experiences. It was concluded that the continuity approach emphasized relationship building, consistency, and trust, while the team-teaching approach was considered a more sustainable workload model.
Article
Public, Environmental & Occupational Health
Janie Alison Brown, Elaine Watson, Tamra Rogers
Summary: This study explored the impact of repeated exposure to personal threats on the well-being of hospital security guards. The findings highlighted the importance of well-being, effective communication, physical safety, compassion, and training in supporting the guards' mental health.
INTERNATIONAL JOURNAL OF WORKPLACE HEALTH MANAGEMENT
(2022)
Article
Education, Scientific Disciplines
Janie Brown, Susan Slatyer, Samantha Jakimowicz, Jill Maben, Pauline Calleja, Helen Donovan, Lynette Cusack, Dawn Cameron, Vicki Cope, Tracy Levett-Jones, Moira Williamson, Karen Klockner, Alison Walsh, Melissa Arnold-Chamney, Olivia Hollingdrake, Debra Thoms, Ravani Duggan
Summary: This qualitative study explored the challenges faced by health academics (nurses, midwives, and paramedics) during the COVID-19 pandemic and the strategies they employed. Findings highlighted issues such as work stress, anxiety, uncertainty of remote work, and changes in teaching practices, with strategies including setting workday routines and maintaining regular online contact with colleagues. The study emphasized the need for continued adaptation to post-COVID changes in education delivery for academic staff in nursing, midwifery, and paramedics.
NURSE EDUCATION TODAY
(2022)
Article
Public, Environmental & Occupational Health
Janie A. Brown, Clare L. Harvey, Amy-Louise Byrne, Desley G. Hegney
Summary: This study explores the levels of resilience, well-being, burnout, and turnover intent among navigators, and finds no significant changes over a three-year period. The qualitative data suggests that adaptive coping mechanisms, such as support, self-care, and leaving the position, are important in maintaining well-being. Recommendations for nurses in similar roles include work-based programs targeting support, good leadership, and examining the impact on turnover intent.
PUBLIC HEALTH NURSING
(2023)
Article
Nursing
Alannah L. Cooper, Matthew A. Albrecht, Suzanne Kelly, Siobhan P. Eccles, Janie A. Brown
Summary: The aim of this study was to evaluate the impact of a co-designed intervention on reducing clinical documentation time and increasing direct patient care time. The results showed that the intervention led to an increase in completed task episodes and a decrease in documentation time. However, there was only a slight increase in time spent on direct patient care. This study is important for alleviating the burden of clinical documentation for nurses and midwives and creating more time for direct patient care.
JOURNAL OF ADVANCED NURSING
(2023)