Same data, different conclusions: Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis

Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.

(2020) Justin F. Landy et al.   PSYCHOLOGICAL BULLETIN

Variability in the analysis of a single neuroimaging dataset by many teams

(2020) Rotem Botvinik-Nezer et al.   NATURE

Time to get personal? The impact of researchers choices on the selection of treatment targets using the experience sampling methodology

(2020) Jojanneke A. Bastiaansen et al.   JOURNAL OF PSYCHOSOMATIC RESEARCH

Heterogeneity in direct replications in psychology and its association with effect size.

(2020) Anton Olsson-Collentine et al.   PSYCHOLOGICAL BULLETIN

Specification curve analysis

(2020) Uri Simonsohn et al.   Nature Human Behaviour

Boba: Authoring and Visualizing Multiverse Analyses

(2020) Yang Liu et al.   IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS

Metastudies for robust tests of theory

(2018) Beth Baribault et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

An empirical analysis of journal policy effectiveness for computational reproducibility

(2018) Victoria Stodden et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Crowdsourcing Samples in Cognitive Science

(2017) Neil Stewart et al.   TRENDS IN COGNITIVE SCIENCES

Stereotype Threat

(2016) Steven J. Spencer et al.   Annual Review of Psychology

Evaluating replicability of laboratory experiments in economics

(2016) C. F. Camerer et al.   SCIENCE

Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations

(2015) Chirag J. Patel et al.   JOURNAL OF CLINICAL EPIDEMIOLOGY

Crowdsourced research: Many hands make tight work

(2015) Raphael Silberzahn et al.   NATURE

Blind analysis: Hide results to seek the truth

(2015) Robert MacCoun et al.   NATURE

Estimating the reproducibility of psychological science

(2015)   SCIENCE

Research Data in Core Journals in Biology, Chemistry, Mathematics, and Physics

(2015) Ryan P. Womack   PLoS One

The Statistical Crisis in Science

(2014) Andrew Gelman et al.   AMERICAN SCIENTIST

A Cognitive Interpretation of Data Analysis

(2014) Garrett Grolemund et al.   INTERNATIONAL STATISTICAL REVIEW

The Availability of Research Data Declines Rapidly with Article Age

(2013) Timothy H. Vines et al.   CURRENT BIOLOGY

Raise standards for preclinical cancer research

(2012) C. Glenn Begley et al.   NATURE

The secret lives of experiments: Methods reporting in the fMRI literature

(2012) Joshua Carp   NEUROIMAGE

Believe it or not: how much can we rely on published data on potential drug targets?

(2011) Florian Prinz et al.   NATURE REVIEWS DRUG DISCOVERY

Public Availability of Published Research Data in High-Impact Journals

(2011) Alawi A. Alsheikh-Ali et al.   PLoS One

Empirical Study of Data Sharing by Authors Publishing in PLoS Journals

(2009) Caroline J. Savage et al.   PLoS One

SOCIAL SCIENCE: Computational Social Science

(2009) D. Lazer et al.   SCIENCE