4.7 Article

A graphical method for assessing agreement with the mean between multiple observers using continuous measures

Journal

INTERNATIONAL JOURNAL OF EPIDEMIOLOGY
Volume 40, Issue 5, Pages 1308-1313

Publisher

OXFORD UNIV PRESS
DOI: 10.1093/ije/dyr109

Keywords

Accuracy; precision; reliability; reproducibility; agreement

Ask authors/readers for more resources

Methods We aimed to develop a simple graphical method to assess agreement between multiple observers using continuous measurements. The Bland-Altman graphical method for assessing agreement between two observers using continuous measures was modified and extended to accommodate multiple observers. Mathematical formulae are derived and real data examples used to illustrate the proposed method. Results The examples show that the proposed graphical method of assessing agreement provides clinically useful information. This information includes estimates of the limits of agreement with the mean and a visual means for determining these limits over the range of measurements. In a data example that included five readers' measurements of 40 lung lesions, the intra-class correlation (ICC) was 0.84 indicating readers can reliably measure the lesions. However, the estimated limits of agreement with the mean were -1.1 to 1.1 cm implying that the readers' measurements can plausibly differ from the mean estimated tumour size by more than 1 cm. This is a clinically significant difference according to the study authors. In addition, a plot of the limits of agreement with the mean by mean tumour size shows heterogeneous agreement presumably due to the varying degrees of definition at the edge of the lesions. Conclusions The proposed graphical method of assessing agreement can be used alongside other measures such as ICC for reporting on reproducibility in studies of multiple observers making continuous measurements.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Psychiatry

Generational differences in the prevalence of postpartum depression among young Australians: a comparison of two cohorts born 17 years apart

Sifan Cao, Mark Jones, Leigh Tooth, Gita Devi Mishra

Summary: The prevalence of postpartum depression has increased in recent generations, with the higher rates mainly attributed to a significant increase in depressive symptoms. Strategies focusing on managing pre-existing depression may help in preventing postpartum depression in the current young generation, emphasizing the need for further research in prevention approaches.

ARCHIVES OF WOMENS MENTAL HEALTH (2022)

Article Audiology & Speech-Language Pathology

Conversational speech of school-age children after syllable-timed speech treatment for stuttering

Lisa Brown, Linda Wilson, Ann Packman, Mark Halaki, Cheryl Andrews, Sue O'Brian, Mark Onslow, Ross G. Menzies

Summary: The laboratory study investigated the effects of syllable-timed speech (STS) intervention on stuttering reduction in school-aged children. The study found that STS was primarily responsible for the significant reductions in stuttering, without compromising articulation rate and language use. Further evidence-based interventions for stuttering in this age group are needed, and further development of STS interventions is warranted.

INTERNATIONAL JOURNAL OF SPEECH-LANGUAGE PATHOLOGY (2022)

Article Primary Health Care

A Brief Shared Decision-Making Intervention for Acute Respiratory Infections on Antibiotic Dispensing Rates in Primary Care: A Cluster Randomized Trial

Tammy C. Hoffmann, Mark Jones, Paul Glasziou, Elaine Beller, Lyndal Trevena, Chris Del Mar

Summary: This study aimed to reduce antibiotic dispensing rate and improve GPs' knowledge of antibiotic benefit-harm evidence through the use of decision aids and training. The results showed that while the intervention led to a significant increase in knowledge, it did not significantly decrease antibiotic dispensing rate.

ANNALS OF FAMILY MEDICINE (2022)

Article Emergency Medicine

'I was prepared to become infected as a frontline medical staff': A survey of Australian emergency department staff experiences during COVID-19

Anna Mae Scott, Amanda Murray, Mark Jones, Gerben Keijzers, Paul Glasziou

Summary: Australian hospital healthcare staff felt prepared and well-informed during the COVID-19 pandemic, but still experienced significant stress, infection concerns, and emotional challenges that should be addressed for future planning.

EMERGENCY MEDICINE AUSTRALASIA (2022)

Article Audiology & Speech-Language Pathology

Comparison of Stuttering Severity and Anxiety Standard and Phone Calls

Sue O'Brian, Mark Onslow, Mark Jones, Robyn Lowe, Ann Packman, Ross Menzies

Summary: This study aimed to investigate the effects of standard and challenge phone calls on syllable stuttering and anxiety, as well as the relationship between the two. The results showed that there were slight increases in syllable stuttering and anxiety during challenge phone calls. There was a significant association between syllable stuttering and anxiety. The study concludes that controlling the nature of phone calls in clinical trials has statistical merit.

JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH (2022)

Article Economics

Health Services Use and Expenditures among Middle-Aged and Elderly Residents with Hypertension Comorbidity: A Longitudinal Study in Jiangsu Province, China

Xiaolin Xu, Shenglan Tang, Weixi Jiang, Yaoguang Zhang, Ling Xu, Mark Jones, Lijing L. Yan

Summary: This study investigates the health services use and expenditures among community-dwelling residents with hypertension comorbidity in China. It found that individuals with hypertension comorbidity have significantly higher odds of health services use and expenditures compared to those without any condition, highlighting the importance of integrated care for this population.

CHINESE ECONOMY (2022)

Article Health Care Sciences & Services

A novel methodological framework was described for detecting and quantifying overdiagnosis

Katy Bell, Jenny Doust, Sharon Sanders, Rachelle Buchbinder, Paul Glasziou, Les Irwig, Mark Jones, Ray Moynihan, Luise Kazda, Alexandra Barratt

Summary: A methodological framework for quantifying overdiagnosis in noncancer conditions, including gestational diabetes mellitus, has been developed and demonstrated.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2022)

Review Medicine, General & Internal

Evaluating the Association Between Low-Density Lipoprotein Cholesterol Reduction and Relative and Absolute Effects of Statin Treatment A Systematic Review and Meta-analysis

Paula Byrne, Maryanne Demasi, Mark Jones, Susan M. Smith, Kirsty K. O'Brien, Robert DuBroff

Summary: This study aimed to assess the association between absolute reductions in LDL-C levels with treatment with statins and all-cause mortality, myocardial infarction, and stroke. The results showed that the absolute risk reductions of treatment with statins in terms of all-cause mortality, myocardial infarction, and stroke are modest compared with the relative risk reductions, and the presence of significant heterogeneity reduces the certainty of the evidence.

JAMA INTERNAL MEDICINE (2022)

Article Endocrinology & Metabolism

Association Between a Low-Carbohydrate Diet, Glycemic Control, and Quality of Life in Australian Adults Living With Type 1 Diabetes: A Pilot Study

Janine Paul, Rati Jani, Mark Jones, Peter Davoren, Catherine Knight-Agarwal

Summary: This study examined the association between a low-carbohydrate diet (LCD), glycemic control, and quality of life (QoL) in Australian adults with type 1 diabetes. The results showed that an LCD significantly improved glycemic control without negatively affecting QoL. Participant perceptions regarding the variables were mixed.

ENDOCRINE PRACTICE (2022)

Article Medicine, General & Internal

Effect of Nitric Oxide via Cardiopulmonary Bypass on Ventilator-Free Days in Young Children Undergoing Congenital Heart Disease Surgery The NITRIC Randomized Clinical Trial

Luregn J. Schlapbach, Kristen S. Gibbons, Stephen B. Horton, Kerry Johnson, Debbie A. Long, David H. F. Buckley, Simon Erickson, Marino Festa, Yves d'Udekem, Nelson Alphonso, David S. Winlaw, Carmel Delzoppo, Kim van Loon, Mark Jones, Paul J. Young, Warwick Butt, Andreas Schibler

Summary: The administration of nitric oxide into the gas flow of the cardiopulmonary bypass oxygenator does not significantly reduce ventilator-free days in children undergoing heart surgery. These findings suggest that the use of nitric oxide delivered into the cardiopulmonary bypass oxygenator may not be beneficial in improving respiratory recovery in these patients.

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION (2022)

Article Audiology & Speech-Language Pathology

The Complexity of Stuttering Behavior in Adults and Adolescents: Relationship to Age, Severity, Mental Health, Impact of Stuttering, and Behavioral Treatment Outcome

Sue O'Brian, Mark Jones, Ann Packman, Mark Onslow, Ross Menzies, Robyn Lowe, Angela Cream, Anna Hearne, Sally Hewat, Elisabeth Harrison, Susan Block, Anne Briem

Summary: This study investigates the complexity of stuttering behavior in relation to various factors such as age, treatment outcomes, severity, anxiety-related mental health, impact, and gender. A taxonomy was developed and used by experienced judges to analyze the complexity of stuttering behavior in adults and adolescents. The results suggest that the complexity of stuttering behavior does not change with treatment but does change with age. Complexity is associated with clinician severity scores but not with percentage of syllables stuttered or self-reported severity. It is not associated with gender, anxiety, or impact.

JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH (2022)

Article Audiology & Speech-Language Pathology

Lidcombe Program translation to community clinics in Australia and England

Sue O'Brian, Rosemarie Hayhow, Mark Jones, Ann Packman, Lisa Iverach, Mark Onslow, Ross Menzies

Summary: This study aimed to investigate whether community clinicians from Australia and England can achieve the outcome benchmarks established in randomized trials for the Lidcombe Program. The results showed that community clinicians in both countries achieved similar outcomes to those from randomized controlled trials. However, therapist drift emerged as an issue in community translation.

INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS (2023)

Article Biochemistry & Molecular Biology

Interrelationships among platelet-activating factor and lipoprotein-associated phospholipase A2 activity and traditional cardiovascular risk factors

Carolyn J. English, Anna E. Lohning, Hannah L. Mayr, Mark Jones, Dianne P. Reidlinger

Summary: Traditionally, cardiovascular disease (CVD) risk has been assessed through blood lipids and the inflammatory marker C-reactive protein (hsCRP). However, recent research has shown that the pro-inflammatory markers platelet-activating factor (PAF) and lipoprotein-associated phospholipase A(2) (Lp-PLA(2)) can also indicate vascular damage in the absence of traditional risk factors. This study investigated the relationship between PAF, Lp-PLA(2), hsCRP, and traditional risk factors for CVD among 100 adults. The results showed that PAF, Lp-PLA(2), and hsCRP were independently correlated with various CVD risk factors, suggesting their involvement in different atherogenic pathways.

BIOFACTORS (2023)

No Data Available