Article
Chemistry, Multidisciplinary
Stefan Markulik, Jozef Petrik, Marek Solc, Peter Blasko, Pavol Palfy, Lenka Girmanova
Summary: This article discusses the corrective measures needed in the measurement system, and proposes two possible solutions. One is to identify the optimal pair of metrological appraisers, and the other is to improve the work with the measuring instrument. By implementing the corresponding corrective measures, the value of the capability indices increases and the number of shafts out of tolerance decreases.
APPLIED SCIENCES-BASEL
(2022)
Article
Nutrition & Dietetics
Alessandra da Silva Pereira, Ana C. F. da Silva, Flavia F. Bezerra, Marta Citelli, Jose F. Nogueira Neto, Ines R. R. de Castro
Summary: The study assessed the reproducibility and validity of dried blood spot (DBS) method for diagnosing Vitamin A deficiency (VAD) and anemia in preschool children. The results indicate that DBS is suitable for diagnosing VAD in children, but not for anemia.
JOURNAL OF NUTRITION
(2021)
Article
Microbiology
Oluwaseun Bunmi Awosolu, Zary Shariman Yahaya, Meor Termizi Farah Haziqah, Titus Adeniyi Olusi
Summary: This study evaluated the performance of different methods for detecting falciparum malaria in Akure, Nigeria. The results showed that rapid diagnostic tests and microscopy are still sensitive and accurate methods for diagnosing falciparum malaria in the study area.
Article
Education & Educational Research
Tianfei Yu, Lei Yang, Xinjie Jiang, Shuli Shao, Wei Sha, Ming Li
Summary: The article discusses the statistical methods used in Richelle's article for agreement analysis. The authors investigated the attitudes of medical students towards substance use during pregnancy and identified influencing factors. It was found that the agreement measurement using Cohen's kappa was questionable and it is recommended to use weighted kappa instead when dealing with three categories.
BMC MEDICAL EDUCATION
(2023)
Article
Mathematics, Interdisciplinary Applications
Jonas Moss
Summary: Researchers propose a method called guessing models to handle multiple measures of agreement in rating consistency among judges. Each guessing model has an associated knowledge coefficient, which is equal to the multi-rater Cohen's kappa, Fleiss' kappa, Brennan-Prediger coefficient, or other less-established measures of agreement under certain assumptions. Several sample estimators of the knowledge coefficient are provided, valid under different assumptions, along with their asymptotic distributions. After a sensitivity analysis and simulation study of confidence intervals, the Brennan-Prediger coefficient is found to outperform others, providing better coverage under unfavorable circumstances.
Article
Mathematical & Computational Biology
Katelyn A. McKenzie, Jonathan D. Mahnken
Summary: Cohen's and Fleiss's kappa are popular estimators for assessing agreement among raters. However, they have limitations and their estimates may be inflated. This manuscript proposes a model-based estimator for kappa that accommodates multiple raters and covariates, and a simulation framework for dependent Bernoulli observations. Simulations show the superiority of the proposed method over Cohen's and Fleiss's kappa, leading to improved inferences.
STATISTICS IN MEDICINE
(2023)
Letter
Parasitology
Ming Li, Tianfei Yu
Summary: This study compared different detection methods for identifying different life stages of Plasmodium vivax and found issues with the consistency of the current gold standard method. It is recommended to use more appropriate statistical methods to support scientific conclusions in future research.
PARASITES & VECTORS
(2022)
Article
Psychology, Mathematical
Lee Friedman, Vladyslav Prokopenko, Shagen Djanian, Dmytro Katrychuk, Oleg Komogortsev
Summary: This report compares three datasets of human manual classification and analyzes the influence of eye-tracker quality, use of head restraint, characteristics of the recorded subjects, availability of detailed scoring rules, and characteristics and training of the raters on human classification reliability.
BEHAVIOR RESEARCH METHODS
(2022)
Article
Oncology
Ming Li, Qian Gao, Tianfei Yu
Summary: This article analyzes the controversy surrounding the Kappa statistic and methodological issues concerning the assessment of inter-rater reliability (IRR). It highlights the importance of selecting appropriate statistics and accurately reporting the results.
Article
Psychology, Multidisciplinary
Xiaofeng Steven Liu
Summary: Cohen's d has a positive bias and the traditional bias correction method based on strict distribution assumption may not always work for small studies with limited data. Non-parametric bootstrapping, which is not limited by distribution assumption, can be used to remove the bias in Cohen's d. A real example is provided to demonstrate the implementation of bootstrap bias estimation and the removal of sizable bias in Cohen's d.
JOURNAL OF GENERAL PSYCHOLOGY
(2023)
Letter
Computer Science, Interdisciplinary Applications
Ming Li, Qian Gao, Tianfei Yu
Summary: The study evaluated the h(fa)-index, which takes into account the relative contribution of each author, using data from senior hospital physicians. The authors used Cohen's kappa statistic to assess the agreement between the h-index and the h(fa)-index. The results of the two metrics were found to be disputed, suggesting the need for the use of an appropriate statistical approach, such as the weighted Cohen's kappa statistic, in this study.
Article
Computer Science, Interdisciplinary Applications
A. Martin Andres, M. Alvarez Hernandez
Summary: This article introduces the extension of the delta coefficient from two raters to multiple raters, known as the multi-rater delta coefficient. It can be expressed in the kappa format and has the advantages of measuring the degree of agreement, unaffected by marginal imbalance.
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION
(2022)
Article
Surgery
Zachary M. Bauman, Bryant Menke, W. T. Hillman Terzian, Ashley Raposo-Hadley, Kevin Cahoy, Bennett J. Berning, Samuel Cemaj, Andrew Kamien, Charity H. Evans, Emily Cantrell
Summary: This retrospective study found poor agreement between ultrasonography, computed tomography, and magnetic resonance imaging and the final pathology report for gallbladder disease. Therefore, urgent surgical intervention should be considered for patients presenting with symptoms of gallbladder disease, regardless of imaging results.
AMERICAN JOURNAL OF SURGERY
(2022)
Article
Education & Educational Research
Jing Qiu Sun
Summary: The primary goal of this paper was to analyze and find interactive piano learning systems using the Suzuki method. The sample consisted of 200 students from the Zhejiang Conservatory of Music. The study found some differences between the control and experimental groups before implementing the training program, but after one year of study, students in both groups showed improvement.
EDUCATION AND INFORMATION TECHNOLOGIES
(2023)
Review
Biochemistry & Molecular Biology
Christophe Gauld, Regis Lopez, Pierre Philip, Jacques Taillard, Charles M. Morin, Pierre Alexis Geoffroy, Jean-Arthur Micoulaud-Franchi
Summary: The aim of this article is to provide a systematic review of reliability studies of sleep-wake disorder diagnostic criteria in sleep medicine. The review found that the diagnostic criteria for insomnia disorder and parasomnia disorder were the most studied, and all sleep-wake disorders showed substantial agreement in reliability based on Cohen's kappa coefficient.
Article
Mathematical & Computational Biology
Sophie Vanbelle, Emmanuel Lesaffre
Article
Medicine, Research & Experimental
Rob J. C. G. Verdonschot, Laura Baijens, Sophie Vanbelle, Michelle Florie, Bernd Kremer, Carsten Leue
Article
Otorhinolaryngology
Walmari Pilz, Sophie Vanbelle, Bernd Kremer, Michel R. van Hooren, Tine van Becelaere, Nel Roodenburg, Laura W. J. Baijens
Article
Dentistry, Oral Surgery & Medicine
Mauricio Baeza, Mauricio Garrido, Patricia Hernandez-Rios, Andrea Dezerega, Jocelyn Garcia-Sesnich, Franz Strauss, Juan Pablo Aitken, Emmanuel Lesaffre, Sophie Vanbelle, Jorge Gamonal, Romina Brignardello-Petersen, Taina Tervahartiala, Timo Sorsa, Marcela Hernandez
JOURNAL OF CLINICAL PERIODONTOLOGY
(2016)
Article
Health Care Sciences & Services
Sophie Vanbelle, Emmanuel Lesaffre
STATISTICAL METHODS IN MEDICAL RESEARCH
(2018)
Article
Rehabilitation
Janneke Annegarn, Martijn A. Spruit, Nicole H. M. K. Uszko-Lencer, Sophie Vanbelle, Hans H. C. M. Savelberg, Annemie M. W. J. Schols, Emiel F. M. Wouters, Kenneth Meijer
ARCHIVES OF PHYSICAL MEDICINE AND REHABILITATION
(2011)
Article
Primary Health Care
Caroline Eubelen, Fannette Brendel, Jean-Luc Belche, Anne Freyens, Sophie Vanbelle, Didier Giet
BMC FAMILY PRACTICE
(2011)
Article
Psychiatry
Marianne Destoop, Filip van den Eede, Marc Ansseau, Adelin Albert, Sophie Vanbelle, Annick Mignon, Patricia Slachmuylders, Bernard Sabbe
INTERNATIONAL JOURNAL OF PSYCHIATRY IN CLINICAL PRACTICE
(2013)
Article
Pharmacology & Pharmacy
S. Schuller, N. Van Israel, S. Vanbelle, C. Clercx, K. McEntee
JOURNAL OF VETERINARY PHARMACOLOGY AND THERAPEUTICS
(2011)
Article
Pharmacology & Pharmacy
M. Bimazubute, C. Cambier, K. Baert, S. Vanbelle, P. Chiap, P. Gustin
JOURNAL OF VETERINARY PHARMACOLOGY AND THERAPEUTICS
(2011)
Article
Medicine, Research & Experimental
Laura W. J. Baijens, Rob Verdonschot, Sophie Vanbelle, Sonja Basic, Bernd Kremer, Raymond van de Berg, Carsten Leue
Article
Mathematics, Interdisciplinary Applications
Sophie Vanbelle
Article
Mathematical & Computational Biology
Sophie Vanbelle, Timothy Mutsvari, Dominique Declerck, Emmanuel Lesaffre
STATISTICS IN MEDICINE
(2012)
Article
Mathematical & Computational Biology
Sophie Vanbelle
BIOMETRICAL JOURNAL
(2017)
Article
Nutrition & Dietetics
Joel Pincemail, Sophie Vanbelle, Fabien Degrune, Jean-Paul Cheramy-Bien, Corinne Charlier, Jean-Paul Chapelle, Didier Giet, George Collette, Adelin Albert, Jean-Olivier Defraigne
JOURNAL OF NUTRITION AND METABOLISM
(2011)