4.6 Review

Individual Participant Data (IPD) Meta-analyses of Diagnostic and Prognostic Modeling Studies: Guidance on Their Use

期刊

PLOS MEDICINE
卷 12, 期 10, 页码 -

出版社

PUBLIC LIBRARY SCIENCE
DOI: 10.1371/journal.pmed.1001886

关键词

-

资金

  1. Netherlands Organization for Scientific Research [9120.8004, 918.10.615, 916.11.126]
  2. MRC Network of Hubs for Trials Methodology Research [MR/L004933/1-R20]
  3. MRC Partnership Grant for the PROGnosis RESearch Strategy (PROGRESS) group [G0902393]
  4. Medical Research Council [G0902393, MR/L004933/1] Funding Source: researchfish
  5. MRC [G0902393, MR/L004933/1] Funding Source: UKRI

向作者/读者索取更多资源

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Review Health Care Sciences & Services

An Overview of Stakeholders, Methods, Topics, and Challenges in Participatory Approaches Used in the Development of Medical Devices: A Scoping Review

Kas Woudstra, Rob Reuzel, Maroeska Rovers, Marcia Tummers

Summary: This study provides an overview of participatory approaches in the development of medical devices, categorizing them into collaboration, involvement, and consultation levels. Patients and healthcare professionals are commonly engaged, with workshops and interviews being the most frequently used methods. Challenges include issues related to sampling, analysis, social dynamics, feasibility, and topic scope.

INTERNATIONAL JOURNAL OF HEALTH POLICY AND MANAGEMENT (2023)

Article Health Care Sciences & Services

The value of reducing arthroscopic partial meniscectomy in the treatment of degenerative meniscus tears: a budget impact analysis

Evelien B. B. van Well, Stan R. W. Wijn, Gerjon Hannink, Janneke P. C. Grutters, Maroeska M. M. Rovers

Summary: Numerous studies have shown that arthroscopic partial meniscectomy (APM) is not (cost-) effective in patients with symptoms attributed to a degenerative meniscus tear. The study found that not performing APM to treat degenerative meniscus tears in the Netherlands can significantly reduce healthcare expenditures by €54 million. Therefore, it is recommended to further reduce the use of APM for this condition.

INTERNATIONAL JOURNAL OF TECHNOLOGY ASSESSMENT IN HEALTH CARE (2023)

Review Health Care Sciences & Services

Minimal reporting improvement after peer review in reports of COVID-19 prediction models: systematic review

Mohammed T. Hudda, Lucinda Archer, Maarten van Smeden, Karel G. M. Moons, Gary S. Collins, Ewout W. Steyerberg, Charlotte Wahlich, Johannes B. Reitsma, Richard D. Riley, Ben Van Calster, Laure Wynants

Summary: The study aims to assess the improvement in reporting completeness of COVID-19 prediction models after peer review. The findings suggest that the reporting quality of preprints is poor and did not improve significantly after peer review, indicating that peer review had minimal effect on the completeness of reporting during the COVID-19 pandemic.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2023)

Review Health Care Sciences & Services

Systematic review identifies the design and methodological conduct of studies on machine learning-based prediction models

Constanza L. Andaur Navarro, Johanna A. A. Damen, Maarten van Smeden, Toshihiko Takada, Steven W. J. Nijman, Paula Dhiman, Jie Ma, Gary S. Collins, Ram Bajpai, Richard D. Riley, Karel G. M. Moons, Lotty Hooft

Summary: This study aimed to summarize the research design, modeling strategies, and performance measures of clinical prediction models developed using machine learning techniques. A total of 152 studies were included, and it was found that most studies only reported the development of the models, without reporting sample size calculation, handling of missing values, and internal validation. Therefore, further improvement is needed in the methodological conduct and reporting standards of studies on machine learning-based prediction models.

JOURNAL OF CLINICAL EPIDEMIOLOGY (2023)

Article Mathematical & Computational Biology

Measuring the performance of prediction models to personalize treatment choice

Orestis Efthimiou, Jeroen Hoogland, Thomas P. A. Debray, Michael Seo, Toshiaki A. Furukawa, Matthias Egger, Ian R. White

Summary: When individual patient data from a randomized trial are available, statistical and machine learning methods can be used to develop models for predicting treatment effects and guide personalized treatment choices. This article proposes measures to evaluate personalized treatment effect predictions, including discrimination and calibration. The methods are applicable to different outcome types and prediction models.

STATISTICS IN MEDICINE (2023)

Article Mathematical & Computational Biology

Propensity-based standardization to enhance the validation and interpretation of prediction model discrimination for a target population

Valentijn M. T. de Jong, Jeroen Hoogland, Karel G. M. Moons, Richard D. Riley, Tri-Long Nguyen, Thomas P. A. Debray

Summary: External validation of prediction models requires careful interpretation, as discrimination depends on both sample characteristics and generalizability of predictor coefficients. To resolve differences in discriminative ability across validation samples, we propose propensity-weighted measures of discrimination. Our methods account for case-mix differences and allow for fair comparisons of discriminative ability in the target population of interest, providing valuable insights for model updating strategies.

STATISTICS IN MEDICINE (2023)

Article Mathematical & Computational Biology

Developing prediction models to estimate the risk of two survival outcomes both occurring: A comparison of techniques

Alexander Pate, Matthew Sperrin, Richard D. Riley, Jamie C. Sergeant, Tjeerd Van Staa, Niels Peek, Mamas A. Mamas, Gregory Y. H. Lip, Martin O'Flaherty, Iain Buchan, Glen P. Martin

Summary: This study focuses on predicting the time until two survival outcomes have occurred and compares different analytical methods for multi-morbidity prognosis. The performance of these methods is evaluated through simulated data and a clinical example.

STATISTICS IN MEDICINE (2023)

Article Medicine, General & Internal

Maternal and child outcomes for pregnant women with pre-existing multiple long-term conditions: protocol for an observational study in the UK

Siang Ing Lee, Holly Hope, Dermot O'Reilly, Lisa Kent, Gillian Santorelli, Anuradhaa Subramanian, Ngawai Moss, Amaya Azcoaga-Lorenzo, Adeniyi Francis Fagbamigbe, Catherine Nelson-Piercy, Christopher Yau, Colin McCowan, Jonathan Ian Kennedy, Katherine Phillips, Megha Singh, Mohamed Mhereeg, Neil Cockburn, Peter Brocklehurst, Rachel Plachcinski, Richard D. Riley, Shakila Thangaratinam, Sinead Brophy, Sudasing Pathirannehelage Buddhika Hemali Sudasinghe, Utkarsh Agrawal, Zoe Vowles, Kathryn Mary Abel, Krishnarajah Nirantharakumar, Mairead Black, Kelly-Ann Eastwood, MuM PreDiCT

Summary: This observational study aims to compare maternal and child outcomes for pregnant women with multiple long-term conditions to those without multiple long-term conditions. Data from routine health records in the UK and the Born in Bradford birth cohort will be used to examine the association of multiple long-term conditions with various outcomes. The results will be published in peer-reviewed journals and presented at conferences.

BMJ OPEN (2023)

Article Pediatrics

Development of treatment-decision algorithms for children evaluated for pulmonary tuberculosis: an individual participant data meta-analysis

Kenneth S. Gunasekera, Olivier Marcy, Johanna Munoz, Elisa Lopez-Varela, Moorine P. Sekadde, Molly F. Franke, Maryline Bonnet, Shakil Ahmed, Farhana Amanullah, Aliya Anwar, Orvalho Augusto, Rafaela Baroni Aurilio, Sayera Banu, Iraj Batool, Annemieke Brands, Kevin P. Cain, Lucia Carratala-Castro, Maxine Caws, Eleanor S. Click, Lisa M. Cranmer, Alberto L. Garcia-Basteiro, Anneke C. Hesseling, Julie Huynh, Senjuti Kabir, Leonid Lecca, Anna Mandalakas, Farai Mavhunga, AyeAye Myint, Kyaw Myo, Dorah Nampijja, Mark P. Nicol, Patrick Orikiriza, Megan Palmer, Clemax Couto Sant'Anna, Sara Ahmed Siddiqui, Jonathan P. Smith, Rinn Song, Nguyen Thuy Thuong Thuong, Vibol Ung, Marieke M. van der Zalm, Sabine Verkuijl, Kerri Viney, Elisabetta G. Walters, Joshua L. Warren, Heather J. Zar, Ben J. Marais, Stephen M. Graham, Thomas P. A. Debray, Ted Cohen, James A. Seddon

Summary: This study evaluated the performance of current diagnostic algorithms for pediatric tuberculosis and developed evidence-based algorithms using prediction modeling to assist in treatment decision-making. The existing treatment-decision algorithms had highly variable diagnostic performance. The scoring system derived from the prediction model that included clinical and chest x-ray features had higher sensitivity and lower specificity, while the scoring system derived from clinical features only also accurately diagnosed tuberculosis to some extent.

LANCET CHILD & ADOLESCENT HEALTH (2023)

Article Mathematical & Computational Biology

Regularized parametric survival modeling to improve risk prediction models

J. Hoogland, T. P. A. Debray, M. J. Crowther, R. D. Riley, J. Inthout, J. B. Reitsma, A. H. Zwinderman

Summary: This study proposes a method that combines flexible parametric survival modeling and regularization to improve risk prediction models for time-to-event data. By introducing different penalty terms, the models can be regularized to enhance prediction accuracy and model performance.

BIOMETRICAL JOURNAL (2023)

Article Infectious Diseases

Effect of prophylactic amoxicillin on tonsillar bacterial pathogens after (adeno)tonsillectomy in children

Denis R. Katundu, Desderius Chussi, Christa E. van der Gaast-de Jongh, Maroeska M. Rovers, Marien I. de Jonge, Gerjon Hannink, Niels van Heerbeek

Summary: Despite the lack of effectiveness, prophylactic antibiotics are still frequently used in children after tonsillectomy. This study investigated the effect of prophylactic amoxicillin and found no significant difference compared to placebo in terms of tonsillitis.

INTERNATIONAL JOURNAL OF INFECTIOUS DISEASES (2023)

Article Mathematical & Computational Biology

Using temporal recalibration to improve the calibration of risk prediction models in competing risk settings when there are trends in survival over time

Sarah Booth, Sarwar I. Mozumder, Lucinda Archer, Joie Ensor, Richard D. Riley, Paul C. Lambert, Mark J. Rutherford

Summary: This article introduces a method called temporal recalibration to improve the calibration of prognostic models for new patients by accounting for trends in survival over time. The method involves estimating predictor effects using the full dataset and re-estimating the baseline using a subset of the most recent data. The authors demonstrate the application of temporal recalibration in the context of colon cancer survival and discuss considerations for applying this method.

STATISTICS IN MEDICINE (2023)

Article Mathematical & Computational Biology

Two-stage or not two-stage? That is the question for IPD meta-analysis projects

Richard D. Riley, Joie Ensor, Miriam Hattle, Katerina Papadimitropoulou, Tim P. Morris

Summary: Individual participant data meta-analysis (IPDMA) projects involve collecting, checking, harmonizing, and synthesizing raw data from multiple studies. Researchers can choose between a two-stage or one-stage approach to conduct the meta-analysis. The best approach depends on factors such as the size of the studies and the specific modeling assumptions and estimation methods used. Clearer guidance is provided to help researchers make informed decisions.

RESEARCH SYNTHESIS METHODS (2023)

Article Mathematical & Computational Biology

Calculating the power of a planned individual participant data meta-analysis of randomised trials to examine a treatment-covariate interaction with a time-to-event outcome

Richard D. Riley, Gary S. Collins, Miriam Hattle, Rebecca Whittle, Joie Ensor

Summary: Before starting an IPDMA project, researchers should assess the power of their planned IPDMA based on the available studies and their characteristics. In this article, we propose a method to estimate the power of an IPDMA focusing on treatment-covariate interactions in randomised trials with time-to-event outcomes. The method involves extracting aggregate data, specifying the interaction size, calculating the variance of the interaction estimate, and determining the power based on a two-sided Wald test. Stata and R code are provided for implementation.

RESEARCH SYNTHESIS METHODS (2023)

Article Health Care Sciences & Services

Handling related publications reporting real-world evidence in network meta-analysis: a case study in multiple sclerosis

Marissa Betts, Kyle Fahrbach, Binod Neupane, Mahmoud Slim, Maria Pia Sormani, Gary Cutter, Thomas P. A. Debray, Marvin Rock

Summary: This study evaluates eight approaches for handling overlapping publications in network meta-analyses of real-world evidence (RWE) studies and recommends establishing an a priori hierarchy for selection.

JOURNAL OF COMPARATIVE EFFECTIVENESS RESEARCH (2023)

暂无数据