Publication bias impacts on effect size, statistical power, and magnitude (Type M) and sign (Type S) errors in ecology and evolutionary biology

Build up big-team science

(2022) Nicholas A. Coles et al.   NATURE

Meta-analysis reveals an extreme “decline effect” in the impacts of ocean acidification on fish behavior

(2022) Jeff C. Clements et al.   PLOS BIOLOGY

Decline effects are rare in ecology

(2022) Laura Costello et al.   ECOLOGY

Why and how we should join the shift from significance testing to estimation

(2022) Daniel Berner et al.   JOURNAL OF EVOLUTIONARY BIOLOGY

Estimating the change in meta-analytic effect size estimates after the application of publication bias adjustment methods.

(2022) Martina Sladekova et al.   PSYCHOLOGICAL METHODS

Preferred reporting items for systematic reviews and meta‐analyses in ecology and evolutionary biology: a PRISMA extension

(2021) Rose E. O'Dea et al.   BIOLOGICAL REVIEWS

Towards open, reliable, and transparent ecology and evolutionary biology

(2021) Rose E. O’Dea et al.   BMC BIOLOGY

The significance filter, the winner's curse and the need to shrink

(2021) Erik W. Zwet et al.   STATISTICA NEERLANDICA

Low statistical power and overestimated anthropogenic impacts, exacerbated by publication bias, dominate field studies in global change biology

(2021) Yefeng Yang et al.   GLOBAL CHANGE BIOLOGY

Methods for testing publication bias in ecological and evolutionary meta‐analyses

(2021) Shinichi Nakagawa et al.   Methods in Ecology and Evolution

Avoid Cohen’s ‘Small’, ‘Medium’, and ‘Large’ for Power Analysis

(2020) Joshua Correll et al.   TRENDS IN COGNITIVE SCIENCES

Open Science principles for accelerating trait-based science across the Tree of Life

(2020) Rachael V. Gallagher et al.   Nature Ecology & Evolution

Cumulative meta‐analysis identifies declining but negative impacts of invasive species on richness after 20 yr

(2020) Robert Crystal‐Ornelas et al.   ECOLOGY

The role of replication studies in ecology

(2020) Hannah Fraser et al.   Ecology and Evolution

Revisiting and expanding the meta‐analysis of variation: The log coefficient of variation ratio, lnCVR

(2020) Alistair M. Senior et al.   Research Synthesis Methods

The Orchard Plot: Cultivating a Forest Plot for Use in Ecology, Evolution and Beyond

(2020) Shinichi Nakagawa et al.   Research Synthesis Methods

Low availability of code in ecology: A call for urgent action

(2020) Antica Culina et al.   PLOS BIOLOGY

No net insect abundance and diversity declines across US Long Term Ecological Research sites

(2020) Michael S. Crossley et al.   Nature Ecology & Evolution

Estimation in meta-analyses of response ratios

(2020) Ilyas Bakbergenuly et al.   BMC Medical Research Methodology

Scientists rise up against statistical significance

(2019) Valentin Amrhein et al.   NATURE

Making conservation science more reliable with preregistration and registered reports

(2019) Timothy Parker et al.   CONSERVATION BIOLOGY

Publication bias examined in meta-analyses from psychology and medicine: A meta-meta-analysis

(2019) Robbie C. M. van Aert et al.   PLoS One

Temporal Instability of Evidence Base: A Threat to Policy Making?

(2019) Julia Koricheva et al.   TRENDS IN ECOLOGY & EVOLUTION

Rate and success of study replication in ecology and evolution

(2019) Clint D. Kelly   PeerJ

A checklist for maximizing reproducibility of ecological niche models

(2019) Xiao Feng et al.   Nature Ecology & Evolution

Comparing meta-analyses and preregistered multiple-laboratory replication projects

(2019) Amanda Kvarven et al.   Nature Human Behaviour

Statistical power of clinical trials increased while effect size remained stable: an empirical analysis of 136,212 clinical trials between 1975-2014

(2018) Herm J. Lamberink et al.   JOURNAL OF CLINICAL EPIDEMIOLOGY

Meta-analysis and the science of research synthesis

(2018) Jessica Gurevitch et al.   NATURE

A meta-analysis of the agents of selection on floral traits

(2018) Christina M. Caruso et al.   EVOLUTION

What meta-analyses reveal about the replicability of psychological research.

(2018) T. D. Stanley et al.   PSYCHOLOGICAL BULLETIN

Research Weaving: Visualizing the Future of Research Synthesis

(2018) Shinichi Nakagawa et al.   TRENDS IN ECOLOGY & EVOLUTION

Meta-analysis challenges a textbook example of status signalling and demonstrates publication bias

(2018) Alfredo Sánchez-Tójar et al.   eLife

Nonindependence and sensitivity analyses in ecological and evolutionary meta-analyses

(2017) Daniel W.A. Noble et al.   MOLECULAR ECOLOGY

Meta-assessment of bias in science

(2017) Daniele Fanelli et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Timing anthropogenic stressors to mitigate their impact on marine ecosystem resilience

(2017) Paul Pao-Yen Wu et al.   Nature Communications

Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature

(2017) Denes Szucs et al.   PLOS BIOLOGY

A large-scale assessment of temporal trends in meta-analyses using systematic review reports from the Cochrane Library

(2017) Thomas R. Fanshawe et al.   Research Synthesis Methods

Heterogeneity in ecological and evolutionary meta-analyses: its magnitude and implications

(2016) Alistair M. Senior et al.   ECOLOGY

Underappreciated problems of low replication in ecological field studies

(2016) Nathan P. Lemoine et al.   ECOLOGY

Are heritability and selection related to population size in nature? Meta-analysis and conservation implications

(2016) Jacquelyn L. A. Wood et al.   Evolutionary Applications

Visualizing unbiased and biased unweighted meta-analyses

(2016) S. Nakagawa et al.   JOURNAL OF EVOLUTIONARY BIOLOGY

Meta-analysis of magnitudes, differences and variation in evolutionary parameters

(2016) M. B. Morrissey   JOURNAL OF EVOLUTIONARY BIOLOGY

Addition of multiple limiting resources reduces grassland diversity

(2016) W. Stanley Harpole et al.   NATURE

Evaluating replicability of laboratory experiments in economics

(2016) C. F. Camerer et al.   SCIENCE

Transparency in Ecology and Evolution: Real Problems, Real Solutions

(2016) Timothy H. Parker et al.   TRENDS IN ECOLOGY & EVOLUTION

Adult sex-ratio distortion in the native European polecat is related to the expansion of the invasive American mink

(2015) Rafael Barrientos   BIOLOGICAL CONSERVATION

Replicating research in ecology and evolution: feasibility, incentives, and the cost-benefit conundrum

(2015) Shinichi Nakagawa et al.   BMC BIOLOGY

Estimating the reproducibility of psychological science

(2015)   SCIENCE

Conducting Meta-Analyses inRwith themetaforPackage

(2015) Wolfgang Viechtbauer   Journal of Statistical Software

Evolutionary Change in Continuous Reaction Norms

(2014) Courtney J. Murren et al.   AMERICAN NATURALIST

Does source population size affect performance in new environments?

(2014) Matthew C. Yates et al.   Evolutionary Applications

Uses and misuses of meta-analysis in plant ecology

(2014) Julia Koricheva et al.   JOURNAL OF ECOLOGY

Publication Bias in Psychology: A Diagnosis Based on the Correlation between Effect Size and Sample Size

(2014) Anton Kühberger et al.   PLoS One

Meta-analysis of variation: ecological and evolutionary applications and beyond

(2014) Shinichi Nakagawa et al.   Methods in Ecology and Evolution

Power failure: why small sample size undermines the reliability of neuroscience

(2013) Katherine S. Button et al.   NATURE REVIEWS NEUROSCIENCE

Meta-regression approximations to reduce publication selection bias

(2013) T. D. Stanley et al.   Research Synthesis Methods

Methodological issues and advances in biological meta-analysis

(2012) Shinichi Nakagawa et al.   EVOLUTIONARY ECOLOGY

Does predation result in adult sex ratio skew in a sexually dimorphic insect genus?

(2011) P. M. WEHI et al.   JOURNAL OF EVOLUTIONARY BIOLOGY

Dissemination biases in ecology: effect sizes matter more than quality

(2011) E. Kathryn Barto et al.   OIKOS

Power rangers: no improvement in the statistical power of analyses published in Animal Behaviour

(2010) Daniel R. Smith et al.   ANIMAL BEHAVIOUR

Simple means to improve the interpretability of regression coefficients

(2010) Holger Schielzeth   Methods in Ecology and Evolution

Why Most Discovered True Associations Are Inflated

(2008) John P. A. Ioannidis   EPIDEMIOLOGY