Over‐optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results
Published 2021 View Full Article
- Home
- Publications
- Publication Search
- Publication Details
Title
Over‐optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results
Authors
Keywords
-
Journal
Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery
Volume -, Issue -, Pages -
Publisher
Wiley
Online
2021-12-14
DOI
10.1002/widm.1441
References
Ask authors/readers for more resources
Related references
Note: Only part of the references are listed.- The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines
- (2021) Sabine Hoffmann et al. Royal Society Open Science
- A blind and independent benchmark study for detecting differeally methylated regions in plants
- (2020) Clemens Kreutz et al. BIOINFORMATICS
- Large-scale benchmark study of survival prediction methods using multi-omics data
- (2020) Moritz Herrmann et al. BRIEFINGS IN BIOINFORMATICS
- Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets
- (2020) Zhenxing Wu et al. BRIEFINGS IN BIOINFORMATICS
- Using simulation studies to evaluate statistical methods
- (2019) Tim P. Morris et al. STATISTICS IN MEDICINE
- Identifying accurate metagenome and amplicon software via a meta-analysis of sequence to taxonomy benchmarking studies
- (2019) Paul P. Gardner et al. PeerJ
- Systematic benchmarking of omics computational tools
- (2019) Serghei Mangul et al. Nature Communications
- Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis if We Don’t Expect Replication
- (2019) Valentin Amrhein et al. AMERICAN STATISTICIAN
- Method evaluation, parameterization, and result validation in unsupervised data mining: A critical survey
- (2019) Albrecht Zimmermann Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery
- Survey and Cross-benchmark Comparison of Remaining Time Prediction Methods in Business Process Monitoring
- (2019) Ilya Verenich et al. ACM Transactions on Intelligent Systems and Technology
- The c-index is not proper for the evaluation of $t$-year predicted risks
- (2018) Paul Blanche et al. BIOSTATISTICS
- Benchmarking regression algorithms for income prediction modeling
- (2016) Azamat Kibekbaev et al. INFORMATION SYSTEMS
- A Statistical Framework for Hypothesis Testing in Real Data Comparison Studies
- (2015) Anne-Laure Boulesteix et al. AMERICAN STATISTICIAN
- Factors affecting the accuracy of a class prediction model in gene expression data
- (2015) Putri W. Novianti et al. BMC BIOINFORMATICS
- Analyzing the BBOB Results by Means of Benchmarking Concepts
- (2015) O. Mersmann et al. EVOLUTIONARY COMPUTATION
- Testing and Validation of Computational Methods for Mass Spectrometry
- (2015) Laurent Gatto et al. JOURNAL OF PROTEOME RESEARCH
- How scientists fool themselves – and how they can stop
- (2015) Regina Nuzzo NATURE
- The Extent and Consequences of P-Hacking in Science
- (2015) Megan L. Head et al. PLOS BIOLOGY
- Ten Simple Rules for Reducing Overoptimistic Reporting in Methodological Computational Research
- (2015) Anne-Laure Boulesteix PLoS Computational Biology
- Gifi Methods for Optimal Scaling inR: The Packagehomals
- (2015) Jan de Leeuw et al. Journal of Statistical Software
- Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
- (2014) John P.A. Ioannidis et al. TRENDS IN COGNITIVE SCIENCES
- Benchmarking local classification methods
- (2013) Bernd Bischl et al. COMPUTATIONAL STATISTICS
- (Psycho-)analysis of benchmark experiments: A formal framework for investigating the relationship between data sets and learning algorithms
- (2013) Manuel J.A. Eugster et al. COMPUTATIONAL STATISTICS & DATA ANALYSIS
- A Plea for Neutral Comparison Studies in Computational Sciences
- (2013) Anne-Laure Boulesteix et al. PLoS One
- Registered Reports: A new publishing initiative at Cortex
- (2012) Christopher D. Chambers CORTEX
- Learner excellence biased by data set selection: A case for data characterisation and artificial data sets
- (2012) Núria Macià et al. PATTERN RECOGNITION
- The self-assessment trap: can we all be better than average?
- (2011) R. Norel et al. Molecular Systems Biology
- On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data
- (2011) Hajime Uno et al. STATISTICS IN MEDICINE
- Over-optimism in bioinformatics: an illustration
- (2010) M. Jelizarow et al. BIOINFORMATICS
- Reporting bias when using real data sets to analyze classification performance
- (2009) M. R. Yousefi et al. BIOINFORMATICS
Publish scientific posters with Peeref
Peeref publishes scientific posters from all research disciplines. Our Diamond Open Access policy means free access to content and no publication fees for authors.
Learn MoreAsk a Question. Answer a Question.
Quickly pose questions to the entire community. Debate answers and get clarity on the most important issues facing researchers.
Get Started