4.6 Article

A randomized trial of fellowships for early career researchers finds a high reliability in funding decisions

Journal

JOURNAL OF CLINICAL EPIDEMIOLOGY
Volume 69, Issue -, Pages 147-151

Publisher

ELSEVIER SCIENCE INC
DOI: 10.1016/j.jclinepi.2015.04.010

Keywords

Funding; Peer review; Reliability; Research; Fellowship; Career

Funding

  1. National Health and Medical Research Council (NHMRC) [1023735]

Ask authors/readers for more resources

Objectives: Funding for early career researchers in Australia's largest medical research funding scheme is determined by a competitive peer-review process using a panel of four reviewers. The purpose of this experiment was to appraise the reliability of funding by duplicating applications that were considered by separate grant review panels. Study Design and Methods: Sixty duplicate applications were considered by two independent grant review panels that were awarding funding for Australia's National Health and Medical Research Council. Panel members were blinded to which applications were included in the experiment and to whether it was the original or duplicate application. Scores were compared across panels using Bland-Altman plots to determine measures of agreement, including whether agreement would have impacted on actual funding. Results: Twenty-three percent of the applicants were funded by both panels and 60 percent were not funded by both, giving an overall agreement of 83 percent [95% confidence interval (CI): 73%, 92%]. The chance-adjusted agreement was 0.75 (95% CI: 0.58, 0.92). Conclusion: There was a comparatively high level of agreement when compared with other types of funding schemes. Further experimental research could be used to determine if this higher agreement is due to nature of the application, the composition of the assessment panel, or the characteristics of the applicants. (C) 2016 Elsevier Inc. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Ethics

No Country Bureaucratised its way to Excellence: A Content Analysis of Comments on a Petition to Streamline Australian Research Ethics and Governance Processes

Anna M. Scott, E. Ann Bryant, Jennifer A. Byrne, Natalie Taylor, Adrian G. Barnett

Summary: The analysis of the petition comments revealed that signatories were primarily concerned with changes to the research ethics and governance system, the drawbacks of the existing system, suggestions for improvements, anticipated impacts of changes, and miscellaneous issues.

JOURNAL OF EMPIRICAL RESEARCH ON HUMAN RESEARCH ETHICS (2022)

Article Obstetrics & Gynecology

Gestational diabetes screening from the perspective of consumers: Insights from early in the COVID-19 pandemic and opportunities to optimise experiences

Emma Shipton, Nina Meloncelli, Michael D'Emden, H. David McIntyre, Leonie Callaway, Adrian Barnett, Susan de Jersey

Summary: This qualitative study aimed to explore women's perspectives and understanding of gestational diabetes mellitus (GDM) screening and diagnosis, comparing the modified COVID-19 recommendations to the standard practices. The results showed that women preferred the modified GDM screening recommendations put in place due to the COVID-19 pandemic. They also expressed a strong need for clear communication from health professionals and the opportunity to be active participants in decision making.

AUSTRALIAN & NEW ZEALAND JOURNAL OF OBSTETRICS & GYNAECOLOGY (2023)

Article Pediatrics

Timing of submissions to The Journal of Paediatrics and Child Health: Associations with the COVID-19 pandemic and editorial decisions

Richard G. McGee, Lara E. Graves, Adrian Barnett

Summary: This study examined the effects of the COVID-19 pandemic on the timing of manuscript submissions to The Journal of Paediatrics and Child Health (JPCH), and found that the pandemic had limited impact on submission timing but submission timing influenced the likelihood of a positive editorial decision.

JOURNAL OF PAEDIATRICS AND CHILD HEALTH (2023)

Article Sport Sciences

The bias for statistical significance in sport and exercise medicine

David N. Borg, Adrian G. Barnett, Aaron R. Caldwell, Nicole M. White, Ian B. Stewart

Summary: This study aimed to examine the bias for statistical significance using published confidence intervals in sport and exercise medicine research. The abstracts of 48,390 articles published in 18 sports and exercise medicine journals between 2002 and 2022 were analyzed. The results revealed a bias for statistical significance and an excess of published research with statistically significant results just below the standard significance threshold of 0.05.

JOURNAL OF SCIENCE AND MEDICINE IN SPORT (2023)

Review Cardiac & Cardiovascular Systems

Morbid obesity's impact on COVID-19 patients requiring venovenous extracorporeal membrane oxygenation: The covid-19 critical care consortium database review

Jeffrey Javidfar, Akram M. Zaaqoq, Ahmed Labib, Adrian G. Barnett, J. W. Awori Hayanga, Greg Eschun, Michael H. Yamashita, Jeffrey P. Jacobs, Silver Heinsar, Jacky Y. Suen, John F. Fraser, Gianluigi Li Bassi, Rakesh C. Arora, Giles J. Peek

Summary: Obesity is linked to a worse prognosis in COVID-19 patients with ARDS. It remains unclear how morbid obesity directly affects patients treated with V-V ECMO.

PERFUSION-UK (2023)

Article Medicine, General & Internal

The COVID-19 pandemic and health-related quality of life across 13 high- and low-middle-income countries: A cross-sectional analysis

Mara Violato, Jack Pollard, Andrew M. Lloyd, Laurence S. J. Roope, Raymond Duch, Matias Fuentes Becerra, Philip Clarke

Summary: This study aimed to assess the association between the COVID-19 pandemic and changes in health-related quality of life (HRQoL) in the general population. The study found that the COVID-19 pandemic was associated with a significant reduction in HRQoL for more than one-third of respondents, especially among younger people and females. Overall, there was an 8% reduction in perceived HRQoL, and the health burden due to morbidity was considerably higher than that due to COVID-19-related mortality.

PLOS MEDICINE (2023)

Article Medical Ethics

Is requiring Research Integrity Advisors a useful policy for improving research integrity? A census of advisors in Australia

Adrian G. Barnett, David N. Borg, Paul Glasziou, Emma Beckett

Summary: Research Integrity Advisors in Australia provide impartial guidance to researchers and are an important part of creating a safe environment for discussing research integrity issues and resolving them. A census revealed that there are 739 advisors nationally, with an overall positive attitude towards the role. However, some advisors lack proper training and institutional support, indicating a need for improvement.

ACCOUNTABILITY IN RESEARCH-ETHICS INTEGRITY AND POLICY (2023)

Article Health Care Sciences & Services

A discrete choice experiment to elicit preferences for a liver screening programme in Queensland, Australia: a mixed methods study to select attributes and levels

Michelle J. Allen, Rachael Doran, David Brain, Elizabeth E. Powell, James O'Beirne, Patricia C. Valery, Adrian Barnett, Ruvini Hettiarachchi, Ingrid J. Hickman, Sanjeewa Kularatna

Summary: This study aimed to identify the attributes and levels for preference research on chronic liver disease screening programs to understand patient preferences.

BMC HEALTH SERVICES RESEARCH (2023)

Article Endocrinology & Metabolism

Trends in all-cause mortality among adults with diagnosed type 2 diabetes in West Malaysia: 2010-2019

Lee-Ling Lim, Alia Abdul Aziz, Helen Dakin, John Buckell, Yuan-Liang Woon, Laurence Roope, Arunah Chandran, Feisul I. Mustapha, Edward W. Gregg, Philip M. Clarke

Summary: We examined the 10-year all-cause mortality trends in the diagnosed type 2 diabetes population in West Malaysia. The overall mortality rates remained unchanged, but there were increases in certain age and gender groups. Higher mortality rates were observed in individuals with longer disease duration, prior cardiovascular disease, and of Malay/native ethnicity. The standardized mortality ratios were higher in younger age groups and showed an increasing trend in those with longer disease duration or prior cardiovascular disease.

DIABETES RESEARCH AND CLINICAL PRACTICE (2023)

Article Health Care Sciences & Services

Vital signs-based deterioration prediction model assumptions can lead to losses in prediction performance

Robin Blythe, Rex Parsons, Adrian G. Barnett, Steven M. McPhail, Nicole M. White

Summary: This study investigated the impact of repeated measures and missing data on the development of clinical deterioration prediction models using electronic medical record data from five Australian hospitals. The results showed that the variability of vital signs and patient consciousness were associated with missing data. Summary statistics and imputation methods improved model discrimination, but the clinical significance of these differences is questionable.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2023)

Article Medicine, General & Internal

Gestational diabetes mellitus screening and diagnosis criteria before and during the COVID-19 pandemic: a retrospective pre-post study

Nina J. L. Meloncelli, Adrian G. Barnett, Cate M. Cameron, David Mcintyre, Leonie K. Callaway, Michael C. d'Emden, Susan J. de Jersey

Summary: The study aimed to determine whether excluding gestational diabetes mellitus (GDM) based on fasting venous plasma glucose (FVPG) assessment during the COVID-19 pandemic in 2020 had similar perinatal outcomes compared to excluding GDM using the standard oral glucose tolerance test (OGTT) procedure in the previous year. The results showed that the frequencies of most perinatal outcomes were similar for women without GDM in 2019 and those for whom it was excluded in 2020 based on FVPG values. However, there was an increase in the risk of caesarean delivery in 2020 compared to 2019. The probabilities of several outcomes, such as respiratory distress, neonatal intensive care or special nursery admission, and large for gestational age babies, were slightly higher for women without GDM in 2020 compared to women without GDM in 2019.

MEDICAL JOURNAL OF AUSTRALIA (2023)

Article Multidisciplinary Sciences

A protocol for a pilot randomised controlled trial of an Early Psychiatric Assessment, Referral, and Intervention Study (EPARIS) for intensive care patients

Dylan Flaws, Chelsea Allen, Stuart Baker, Adrian Barnett, Olivia Metcalf, Hamish Pollock, Mahesh Ramanan, Alexis Tabah, Tracey Varker

Summary: This study aims to evaluate the feasibility and acceptability of incorporating a psychiatric review into an existing post-ICU follow-up process. The study will run for 12 months, recruiting 30 participants at Redcliffe Hospital. Participants will be allocated to intervention or control, with the intervention group receiving psychiatric assessment and treatment. The study will assess the effectiveness of the intervention and inform future research.

PLOS ONE (2023)

Letter Medicine, General & Internal

Retract or be damned: the bystander effect is worsening the situation

Adrian Barnett, Jennifer Byrne

BMJ-BRITISH MEDICAL JOURNAL (2023)

Editorial Material Public, Environmental & Occupational Health

Response to critique of: 'Understanding the impact of lockdowns on short-term excess mortality in Australia' by Gigi Foster and Sanjeev Sabhlok

Philip Clarke, Andrew Leigh

BMJ GLOBAL HEALTH (2023)

Review Health Policy & Services

Cost-effectiveness of left atrial appendage closure for stroke prevention in atrial fibrillation: a systematic review appraising the methodological quality

Sumudu A. Hewage, Rini Noviyani, David Brain, Pakhi Sharma, William Parsonage, Steven M. Mcphail, Adrian Barnett, Sanjeewa Kularatna

Summary: This study assessed the methodological quality of economic evaluations on stroke prevention strategies for atrial fibrillation patients. The results showed that LAAC is a cost-effective strategy for preventing stroke in atrial fibrillation patients. However, the study identified shortcomings in the methodological quality, which raise concerns about the reliability and validity of the results.

COST EFFECTIVENESS AND RESOURCE ALLOCATION (2023)

No Data Available