☆ 4.7 Editorial Material

The costs and benefits of replication studies

BEHAVIORAL AND BRAIN SCIENCES (2018)

Journal

BEHAVIORAL AND BRAIN SCIENCES

Volume 41, Issue -, Pages -

Publisher

CAMBRIDGE UNIV PRESS

DOI: 10.1017/S0140525X18000596

Keywords

-

Categories

Psychology, Biological Behavioral Sciences Neurosciences

Ask authors/readers for more resources

Protocol

Community support

Reagent

Community support

Abstract

The debate about whether replication studies should become mainstream is essentially driven by disagreements about their costs and benefits and the best ways to allocate limited resources. Determining when replications are worthwhile requires quantifying their expected utility. We argue that a formalized framework for such evaluations can be useful for both individual decision-making and collective discussions about replication.

Authors

I am an author on this paper

Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7

Not enough ratings

Secondary Ratings

Novelty

-

Significance

-

Scientific rigor

-

Rate this paper

Recommended

Article Construction & Building Technology

Urban Scaling and the Benefits of Living in Cities

Lorraine Sugar, Chris Kennedy

Summary: Complexity science tools can better understand city development processes, with the urban scaling laws being power-law relationships between city size and other characteristics. Theoretical models introduce a parameter called net urban benefit, which plays a critical role in measuring city sustainability.

SUSTAINABLE CITIES AND SOCIETY (2021)

Add to Collection

Article Biology

The layered costs and benefits of translational redundancy

Parth K. Raval, Wing Yui Ngan, Jenna Gallie, Deepa Agashe

Summary: The rate and accuracy of translation depend on various components, including tRNA pools, tRNA modifying enzymes, and rRNA molecules, many of which are redundant. It is hypothesized that redundancy evolves under selection, driven by its impact on growth rate. However, there is a lack of empirical measurements on the fitness costs and benefits of redundancy, as well as a poor understanding of how this redundancy is organized across components. Manipulating redundancy in Escherichia coli, we found that redundancy in tRNA pools is beneficial under nutrient-rich conditions but costly under nutrient limitation. The loss of redundancy in rRNA genes and tRNA modifying enzymes had similar nutrient-dependent fitness consequences. Importantly, these effects are contingent upon interactions across translation components, indicating a layered hierarchy in redundancy.

ELIFE (2023)

Add to Collection

Article Multidisciplinary Sciences

The producer benefits of implicit fossil fuel subsidies in the United States

Matthew J. Kotchen

Summary: This study estimates the financial benefits accruing to fossil fuel producers in the United States due to implicit fossil fuel subsidies, with a significant portion of these benefits accruing to relatively few companies. The direct benefit across all four fuels is estimated at $62 billion per year, highlighting the financial stakes of the domestic fossil fuel industry in policies addressing climate change, local pollution, and transportation inefficiencies.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Add to Collection

Article Green & Sustainable Science & Technology

Explaining the diverse values assigned to environmental benefits across countries

Kayo Murakami, Norihiro Itsubo, Koichi Kuriyama

Summary: One of the key obstacles to building public consensus regarding environmental problems is the diverse valuation of environmental benefits by different individuals and regions. This study finds that people's perceptions of environmental benefits are determined by social indicators and individual conditions. As these conditions improve, people tend to prioritize the intangible environmental benefits.

NATURE SUSTAINABILITY (2022)

Add to Collection

Article Multidisciplinary Sciences

A model for estimating costs and benefits of new vaccine technologies from the perspective of both buyers and sellers

Michael Krautmann, Ben Davis, Pascale R. Leroueil

Summary: Despite the cost-effectiveness of vaccination, global coverage rates for many vaccines are still inadequate. New vaccine technologies can help overcome vaccination barriers and improve coverage rates. To guide vaccine technology investments, a comprehensive cost-benefit model is needed to compare the overall costs and benefits. This article presents a systematic and transparent model that estimates the value and risk of vaccine investment scenarios from the perspectives of buyers and sellers. The model can be applied to evaluate single or multiple vaccine presentations, and is particularly useful for organizations relying on funding from institutional donors.

PLOS ONE (2023)

Add to Collection

Correction Gastroenterology & Hepatology

The Impact of the Policy-Practice Gap on Costs and Benefits of Barrett's Esophagus Management (vol 115, pg 1026, 2020)

Amir-Houshang Omidvari, Carlijn A. M. Roumans, Steffie K. Naber, Sonja Kroep, Bas P. L. Wijnhoven, Ate van der Gaast, Pieter-Jan de Jonge, Manon C. W. Spaander, Iris Lansdorp-Vogelaar

Summary: The study showed that there is a policy-practice gap in the surveillance and treatment of Barrett's esophagus, leading to increased costs but only a minimal increase in the prevention of esophageal adenocarcinoma and gain in QALYs. Incentives should be developed to bridge this gap and reduce the burden on patients and healthcare resources.

AMERICAN JOURNAL OF GASTROENTEROLOGY (2021)

Add to Collection

Article Green & Sustainable Science & Technology

The costs and benefits of environmental sustainability

Paul Ekins, Dimitri Zenghelis

Summary: The natural science in GEO-6 highlights the potential adverse outcomes for humanity if current development paths are maintained, while traditional cost-benefit analysis is not feasible for assessing the economic implications of transitioning to a low-carbon and resource-efficient economy. Conventional modeling approaches often underestimate the risks of climate change and exaggerate the costs of a low-carbon transition, leading to flawed conclusions on how to address the climate emergency.

SUSTAINABILITY SCIENCE (2021)

Add to Collection

Article Business

VOCATIONAL TRAINING COSTS AND ECONOMIC BENEFITS: EXPLORING THE INTERACTIONS

Nataliak Samoliu, Yuriy Bilan, Halyna Mishchuk

Summary: This article studies the relationship between vocational training costs and economic benefits, finding that vocational training has a positive impact on enterprise profitability and the development of professional training programs is essential for macroeconomic growth.

JOURNAL OF BUSINESS ECONOMICS AND MANAGEMENT (2021)

Add to Collection

Article Economics

Determining the costs and benefits of Scientific Forest Management in Nepal

Ganesh Paudel, Prabin Bhusal, Jude Ndzifon Kimengsi

Summary: The study analyzes the costs and benefits for users in scientifically-managed community forests in Nepal. It found a decrease in costs and a threefold increase in benefits under Scientific Forest Management. Forest products account for 80% of the benefits, with high class users contributing more. Further research is needed to analyze changes in users' costs in response to potential changes in their roles.

FOREST POLICY AND ECONOMICS (2021)

Add to Collection

Article Chemistry, Analytical

Costs and Benefits of Popular P-Value Correction Methods in Three Models of Quantitative Omic Experiments

Steven R. Shuken, M. Windy McNerney

Summary: The issue of multiple hypothesis testing is common in large-scale quantitative omic experiments, but there is a lack of tools to compare different p-value correction methods under different experimental conditions. By performing simulations of omic experiments and applying various correction methods, we found that correction significantly improves the false discovery rate (FDR) in different contexts. Although no correction method can guarantee a low false discovery proportion (FDP) in a single experiment, a high number and proportion of corrected p-values can reduce the probability of a high FDP. BH and permutation methods have modest sensitivity costs compared to the FDR benefits, with permutation showing better FDR and sensitivity overall.

ANALYTICAL CHEMISTRY (2023)

Add to Collection

Article Plant Sciences

Costs and Benefits of Transgenerational Induced Resistance in Arabidopsis

Ana Lopez Sanchez, David Pascual-Pardo, Leonardo Furci, Michael R. Roberts, Jurriaan Ton

Summary: Pathogen-mediated transgenerational induced resistance provides benefits in matched environments but comes with ecological costs that become apparent in mismatched environments.

FRONTIERS IN PLANT SCIENCE (2021)

Add to Collection

Review Green & Sustainable Science & Technology

Green roof and green wall benefits and costs: A review of the quantitative evidence

Maria Manso, Ines Teotonio, Cristina Matos Silva, Carlos Oliveira Cruz

Summary: Greening the urban environment through green infrastructures like green roofs and walls can have multiple benefits, but the implementation is limited due to higher costs compared to conventional solutions. Studies show a wide variability in data, making it difficult to compare outcomes.

RENEWABLE & SUSTAINABLE ENERGY REVIEWS (2021)

Add to Collection

Article Computer Science, Interdisciplinary Applications

On the benefits and costs of offloading among cooperating clouds

Paul Ezhilchelvan, Isi Mitrani

Summary: This study analyzes a model of two multi-class service provisioning clouds cooperating with each other, examining the costs and revenues associated with offloading jobs. The solution is based on approximate class decomposition and fixed-point iterations, and can be applied to more than two cooperating clouds. The results of numerical and simulation experiments are presented to demonstrate the effects of successful and unsuccessful job offloading on revenues from local and offloaded jobs.

SIMULATION MODELLING PRACTICE AND THEORY (2021)

Add to Collection

Article Genetics & Heredity

Addressing the benefits of inhibiting APOBEC3-dependent mutagenesis in cancer

Mia Petljak, Abby M. Green, John Maciejowski, Matthew D. Weitzman

Summary: This translated passage discusses the characteristics of APOBEC3 enzyme mutations associated with cancer, the presence of APOBEC3 mutations in cancer cell lineages, and the potential benefits of inhibiting APOBEC3 mutations in cancer treatment.

NATURE GENETICS (2022)

Add to Collection

Article Ecology

Indigenous people's perceptions of benefits and costs of China's second phase of the grain for green program and the influencing factors

Lingling Qiu, Shashi Kant, Weizhong Zeng

Summary: This paper argues that the sustainability of programs like China's Grain for Green Program can be better measured by participants' perceptions of net economic, social, environmental, and overall benefits rather than conventional monetary measures. A model is proposed to examine the influencing factors of participants' perceptions, and the results reveal several interesting findings regarding the impact of factors such as income inequality, water pollution, non-farm work time, and family care and housework time on participants' perceptions. Policy interventions are suggested to improve positive factors and reduce negative factors.

ECOLOGICAL ECONOMICS (2023)

Add to Collection

Article Psychology, Multidisciplinary

Deciding What to Replicate: A Decision Model for Replication Study Selection Under Resource and Knowledge Constraints

Peder Mortvedt Isager, Robbie C. M. van Aert, Stepan Bahnik, Mark J. Brandt, K. Andrew DeSoto, Roger Giner-Sorolla, Joachim Krueger, Marco Perugini, Ivan Ropovik, Anna E. van 't Veer, Marek Vranka, Daniel Lakens

Summary: This article emphasizes the importance of replication in scientific knowledge and proposes a general rule for selecting replication studies based on their replication value. It discusses the concept of replication value and its relationship with the importance and uncertainty of the study. The article aims to provide theoretical foundations for concrete guidelines on study selection in replication research.

PSYCHOLOGICAL METHODS (2023)

Add to Collection

Article Psychology, Social

Fact or Artifact? Demand Characteristics and Participants' Beliefs Can Moderate, but Do Not Fully Account for, the Effects of Facial Feedback on Emotional Experience

Nicholas A. Coles, Lowell Gaertner, Brooke Frohlich, Jeff T. Larsen, Dana M. Basnight-Brown

Summary: The facial feedback hypothesis suggests that facial expressions can influence emotional experience, and the results of the experiments indicate that these effects are not solely driven by demand or placebo effects.

JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY (2023)

Add to Collection

Article Psychology, Multidisciplinary

The Benefits, Barriers, and Risks of Big-Team Science

Patrick S. Forscher, Eric-Jan Wagenmakers, Nicholas A. Coles, Miguel Alejandro Silan, Natalia Dutra, Dana Basnight-Brown, Hans IJzerman

Summary: Progress in psychology has been hindered by challenges in replicability, generalizability, strategy selection, inferential reproducibility, and computational reproducibility. The emerging emphasis on big-team science may help address these challenges but also carries unique risks.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2023)

Add to Collection

Article Psychology, Multidisciplinary

Not All Effects Are Indispensable: Psychological Science Requires Verifiable Lines of Reasoning for Whether an Effect Matters

Farid Anvari, Rogier Kievit, Daniel Lakens, Charlotte R. Pennington, Andrew K. Przybylski, Leo Tiokhin, Brenton M. Wiernik, Amy Orben

Summary: Recent articles have revisited the importance of seemingly small effect sizes in psychological science to discourage researchers from heuristically dismissing them as unimportant. The field is now in danger of accepting all effects as potentially important, and this study aims to encourage researchers to thoroughly consider the mechanisms that amplify or counteract the importance of an observed effect size. By transparently providing verifiable lines of reasoning, researchers can promote a more rigorous assessment of psychological findings and their generalizability.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2023)

Add to Collection

Article Psychology, Multidisciplinary

Are Small Effects the Indispensable Foundation for a Cumulative Psychological Science? A Reply to Gotz et al. (2022)

Maximilian A. Primbs, Charlotte R. Pennington, Daniel Lakens, Miguel Alejandro A. Silan, Dwayne S. N. Lieck, Patrick S. Forscher, Erin M. Buchanan, Samuel J. Westwood

Summary: Gotz et al. argue that small effects are crucial for cumulative psychological science, but we raise objections based on the misleading analogy between genetics and psychology, the reliance on p values in psychology publications, and the necessity for empirical evidence or falsifiable reasoning when claiming the importance of small effects.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2023)

Add to Collection

Article Multidisciplinary Sciences

The process of replication target selection in psychology: what to consider?

Merle-Marie Pittelkow, Sarahanne M. Field, Peder M. Isager, Anna E. van't Veer, Thomas Anderson, Scott N. Cole, Tomas Dominik, Roger Giner-Sorolla, Sebahat Gok, Tom Heyman, Marc Jekel, Timothy J. Luke, David B. Mitchell, Rik Peels, Rosina Pendrous, Samuel Sarrazin, Jacob M. Schauer, Eva Specker, Ulrich S. Tran, Marek A. Vranka, Jelte M. Wicherts, Naoto Yoshimura, Rolf A. Zwaan, Don van Ravenzwaaij

Summary: Increasing the execution of replication studies is important for restoring credibility in empirical research. However, there is a mismatch between the number of potential replication targets and available resources. To address this issue, researchers propose a study involving the scientific community to create a checklist for selecting replication targets in psychology. By using a modified Delphi approach, consensus was reached on what factors to consider when selecting a replication target. This checklist can help researchers transparently communicate their rationale for selecting studies for replication.

ROYAL SOCIETY OPEN SCIENCE (2023)

Add to Collection

Article Multidisciplinary Sciences

The Psychological Science Accelerator's COVID-19 rapid-response dataset

Erin M. Buchanan, Savannah C. Lewis, Bastien Paris, Patrick S. Forscher, Jeffrey M. Pavlacic, Julie E. Beshears, Shira Meir Drexler, Amelie Gourdon-Kanhukamwe, Peter R. Mallik, Miguel Alejandro A. Silan, Jeremy K. Miller, Hans IJzerman, Hannah Moshontz, Jennifer L. Beaudry, Jordan W. Suchow, Christopher R. Chartier, Nicholas A. Coles, MohammadHasan Sharifian, Anna Louise Todsen, Carmel A. Levitan, Flavio Azevedo, Nicole Legate, Blake Heller, Alexander J. Rothman, Charles A. Dorison, Brian P. Gill, Ke Wang, Vaughan W. Rees, Nancy Gibbs, Amit Goldenberg, Thuy-vy Thi Nguyen, James J. Gross, Gwenael Kaminski, Claudia C. von Bastian, Mariola Paruzel-Czachura, Farnaz Mosannenzadeh, Soufian Azouaghe, Alexandre Bran, Susana Ruiz-Fernandez, Anabela Caetano Santos, Niv Reggev, Janis H. Zickfeld, Handan Akkas, Myrto Pantazi, Ivan Ropovik, Max Korbmacher, Patricia Arriaga, Biljana Gjoneska, Lara Warmelink, Sara G. Alves, Gabriel Lins de Holanda Coelho, Stefan Stieger, Vidar Schei, Paul H. P. Hanel, Barnabas Szaszi, Maksim Fedotov, Jan Antfolk, Gabriela-Mariana Marcu, Jana Schroetter, Jonas R. Kunst, Sandra J. Geiger, Adeyemi Adetula, Halil Emre Kocalar, Julita Kielinska, Pavol Kacmar, Ahmed Bokkour, Oscar J. Galindo-Caballero, Ikhlas Djamai, Sara Johanna Poentinen, Bamikole Emmanuel Agesin, Teodor Jernsaether, Anum Urooj, Nikolay R. Rachev, Maria Koptjevskaja-Tamm, Murathan Kurfali, Ilse L. Pit, Ranran Li, Sami coksan, Dmitrii Dubrov, Tamar Elise Paltrow, Gabriel Banik, Tatiana Korobova, Anna Studzinska, Xiaoming Jiang, John Jamir Benzon R. Aruta, Jachym Vintr, Faith Chiu, Lada Kaliska, Jana B. Berkessel, Murat Tuemer, Sara Morales-Izquierdo, Hu Chuan-Peng, Kevin Vezirian, Anna Dalla Rosa, Olga Bialobrzeska, Martin R. Vasilev, Julia Beitner, Ondrej Kacha, Barbara Zuro, Minja Westerlund, Mina Nedelcheva-Datsova, Andrej Findor, Dajana Krupic, Marta Kowal, Adrian Dahl Askelund, Razieh Pourafshari, Jasna Milosevic Dordevic, Nadya-Daniela Schmidt, Ekaterina Baklanova, Anna Szala, Ilya Zakharov, Marek A. Vranka, Keiko Ihaya, Caterina Grano, Nicola Cellini, Michal Bialek, Lisa Anton-Boicuk, Ilker Dalgar, Arca Adiguezel, Jeroen P. H. Verharen, Princess Lovella G. Maturan, Angelos P. Kassianos, Raquel Oliveira, Martin Cadek, Vera Cubela Adoric, Asil Ali oezdogru, Therese E. Sverdrup, Balazs Aczel, Danilo Zambrano, Afroja Ahmed, Christian K. Tamnes, Yuki Yamada, Leonhard Volz, Naoyuki Sunami, Lilian Suter, Luc Vieira, Agata Groyecka-Bernard, Julia Arhondis Kamburidis, Ulf-Dietrich Reips, Mikayel Harutyunyan, Gabriel Agboola Adetula, Tara Bulut Allred, Krystian Barzykowski, Benedict G. Antazo, Andras N. Zsido, Dusana Dusan Sakan, Wilson Cyrus-Lai, Lina Pernilla Ahlgren, Matej Hruska, Diego Vega, Efisio Manunta, Aviv Mokady, Mariagrazia Capizzi, Marcel Martoncik, Nicolas Say, Katarzyna Filip, Roosevelt Vilar, Karolina Staniaszek, Milica Vdovic, Matus Adamkovic, Niklas Johannes, Nandor Hajdu, Noga Cohen, Clara Overkott, Dino Krupic, Barbora Hubena, Gustav Nilsonne, Giovanna Mioni, Claudio Singh Solorzano, Tatsunori Ishii, Zhang Chen, Elizaveta Kushnir, Cemre Karaarslan, Rafael R. Ribeiro, Ahmed Khaoudi, Malgorzata Kossowska, Jozef Bavolar, Karlijn Hoyer, Marta Roczniewska, Alper Karababa, Maja Becker, Renan P. Monteiro, Yoshihiko Kunisato, Irem Metin-Orta, Sylwia Adamus, Luca Kozma, Gabriela Czarnek, Artur Domurat, Eva Strukelj, Daniela Serrato Alvarez, Michal Parzuchowski, Sebastien Massoni, Johanna Czamanski-Cohen, Ekaterina Pronizius, Fany Muchembled, Kevin van Schie, Asli Sacakli, Evgeniya Hristova, Anna O. Kuzminska, Abdelilah Charyate, Gijsbert Bijlstra, Reza Afhami, Nadyanna M. Majeed, Erica D. Musser, Miroslav Sirota, Robert M. Ross, Siu Kit Yeung, Marietta Papadatou-Pastou, Francesco Foroni, Ines A. T. Almeida, Dmitry Grigoryev, David M. G. Lewis, Dawn L. Holford, Steve M. J. Janssen, Srinivasan Tatachari, Carlota Batres, Jonas K. Olofsson, Shimrit Daches, Anabel Belaus, Gerit Pfuhl, Nadia Sarai Corral-Frias, Daniela Sousa, Jan Philipp Roeer, Peder Mortvedt Isager, Hendrik Godbersen, Radoslaw B. Walczak, Natalia Van Doren, Dongning Ren, Tripat Gill, Martin Voracek, Lisa M. DeBruine, Michele Anne, Sanja Batic Ocovaj, Andrew G. Thomas, Alexios Arvanitis, Thomas Ostermann, Kelly Wolfe, Nwadiogo Chisom Arinze, Carsten Bundt, Claus Lamm, Robert J. Calin-Jageman, William E. Davis, Maria Karekla, Sasa Zorjan, Lisa M. Jaremka, Jim Uttley, Monika Hricova, Monica A. Koehn, Natalia Kiselnikova, Hui Bai, Anthony J. Krafnick, Busra Bahar Balci, Tonia Ballantyne, Samuel Lins, Zahir Vally, Celia Esteban-Serna, Kathleen Schmidt, Paulo Manuel L. Macapagal, Paulina Szwed, Przemyslaw Marcin Zdybek, David Moreau, W. Matthew Collins, Jennifer A. Joy-Gaba, Iris Vilares, Ulrich S. Tran, Jordane Boudesseul, Nihan Albayrak-Aydemir, Barnaby James Wyld Dixson, Jennifer T. Perillo, Ana Ferreira, Erin C. Westgate, Christopher L. Aberson, Azuka Ikechukwu Arinze, Bastian Jaeger, Muhammad Mussaffa Butt, Jaime R. Silva, Daniel Shafik Storage, Allison P. Janak, William Jimenez-Leal, Jose A. Soto, Agnieszka Sorokowska, Randy McCarthy, Alexa M. Tullett, Martha Frias-Armenta, Matheus Fernando Felix Ribeiro, Andree Hartanto, Paul A. G. Forbes, Megan L. Willis, Maria del Carmen R. Tejada, Adriana Julieth Olaya Torres, Ian D. Stephen, David C. Vaidis, Anabel de la Rosa-gomez, Karen Yu, Clare A. M. Sutherland, Mathi Manavalan, Behzad Behzadnia, Jan Urban, Ernest Baskin, Joseph P. McFall, Chisom Esther Ogbonnaya, Cynthia H. Y. Fu, Rima-Maria Rahal, Izuchukwu L. G. Ndukaihe, Thomas J. Hostler, Heather Barry Kappes, Piotr Sorokowski, Meetu Khosla, Ljiljana B. Lazarevic, Luis Eudave, Johannes K. Vilsmeier, Elkin O. Luis, Rafal Muda, Elena Agadullina, Rodrigo A. Carcamo, Crystal Reeck, Gulnaz Anjum, Monica Camila Toro Venegas, Michal Misiak, Richard M. Ryan, Nora L. Nock, Giovanni A. Travaglino, Michael C. Mensink, Gilad Feldman, Aaron L. Wichman, Weilun Chou, Ignazio Ziano, Martin Seehuus, William J. Chopik, Franki Y. H. Kung, Joelle Carpentier, Leigh Ann Vaughn, Hongfei Du, Qinyu Xiao, Tiago J. S. Lima, Chris Noone, Sandersan Onie, Frederick Verbruggen, Theda Radtke, Maximilian A. Primbs

Summary: In response to COVID-19, the Psychological Science Accelerator conducted three large-scale psychological studies on loss-gain framing, cognitive reappraisals, and autonomy framing manipulations. The data collected from 73,223 participants included specific measures, a general questionnaire on health prevention behaviors and COVID-19 experience, and demographic information. Participants were from 111 geopolitical regions and completed the survey in 44 unique languages/dialects. The anonymized dataset provides opportunities for secondary analysis on coping, framing, and self-determination in a global sample obtained during the COVID-19 pandemic.

SCIENTIFIC DATA (2023)

Add to Collection

Article Multidisciplinary Sciences

How to build up big team science: a practical guide for large-scale collaborations

Heidi A. A. Baumgartner, Nicolas Alessandroni, Krista Byers-Heinlein, Michael C. C. Frank, J. Kiley Hamlin, Melanie Soderstrom, Jan G. G. Voelkel, Robb Willer, Francis Yuen, Nicholas A. A. Coles

Summary: The past decade has seen a rise in big team science initiatives, where a large number of researchers collaborate to achieve a common goal. However, there is a lack of guidance on how to establish, manage, and participate in these collaborations. This paper integrates insights from various multidisciplinary big team science projects to provide a practical guide. It covers initial considerations for launching a project, running and completing it, and addressing challenges unique to big team science, such as authorship decisions and collaborative writing.

ROYAL SOCIETY OPEN SCIENCE (2023)

Add to Collection

Editorial Material Psychology, Biological

'Big team' science challenges us to reconsider authorship

Nicholas A. A. Coles, Lisa M. M. DeBruine, Flavio Azevedo, Heidi A. A. Baumgartner, Michael C. C. Frank

Summary: 'Big team' science challenges researchers to reconsider authorship issues including defining authorship-worthy contributions, documenting contributions, and handling disagreements among coauthors. We propose steps to resolve these issues.

NATURE HUMAN BEHAVIOUR (2023)

Add to Collection

Article Psychology, Multidisciplinary

The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests

Duygu Uygun Tunc, Mehmet Necip Tunc, Daniel Lakens

Summary: Researchers often make dichotomous claims based on continuous test statistics, which have been criticized as a misuse of statistics. However, we argue that these claims play important roles in science, both in terms of epistemology and pragmatism. They help transform data into tentative facts that can support or challenge theoretical claims, and they facilitate scrutiny and criticism among peers.

THEORY & PSYCHOLOGY (2023)

Add to Collection

Article Psychology, Multidisciplinary

Shifting the Level of Selection in Science

Leo Tiokhin, Karthik Panchanathan, Paul E. Smaldino, Daniel Lakens

Summary: Criteria for recognizing and rewarding scientists primarily focus on individual contributions. This creates a conflict between what is best for scientists' careers and what is best for science. In this article, the authors propose using the theory of multilevel selection to modify incentives and align individual and collective interests in science. Shifting the level of selection from individuals to groups can help address problems such as accounting for diverse contributions, reducing individual-level competition, and promoting team science.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2023)

Add to Collection

Letter Neurosciences

Is the effect large enough to matter? Why exercise physiologists should interpret effect sizes meaningfully: a reply to Williams et al. (2023)

Cristian Mesquida, Daniel Lakens

JOURNAL OF PHYSIOLOGY-LONDON (2023)

Add to Collection

No Data Available

© Peeref 2019-2024. All rights reserved.