4.2 Article

Delta plots and coherent distribution ordering

Journal

AMERICAN STATISTICIAN
Volume 62, Issue 3, Pages 262-266

Publisher

AMER STATISTICAL ASSOC
DOI: 10.1198/000313008X333493

Keywords

delta plot; Q-Q plot; stochastic dominance

Ask authors/readers for more resources

Social scientists often compare subclasses of populations or manipulatons. For example, in comparing task-completion times across two levels of a manipulations, if one group has faster overall mean response, it is natural to ask if the fastest 10% of the first group has a faster mean than the fastest 10% of the second group, and so on. Delta plots, a type of quantile-quantile residual plot used by psychologists, shed light on these comparisons and motivate new notions of stochastic ordering. If all percentile classes have faster mean in one group than in the other, we say that there is coherent mean ordering and that one group stochastically dominates the other in mean. A related notion of coherent variance ordering can be defined similarly. Violations of coherent orderings of means or variances are diagnostic signatures of complex effects and suggest further avenues of study. In this note, we derive necessary and sufficient conditions for stochastic dominance in mean and variance. We show that stochastic mean dominance is exactly equivalent to the usual stochastic dominance and stochastic variance dominance is equivalent to ordering of the first derivative of the quantile functions.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Statistics & Probability

Multiple Perspectives on Inference for Two Simple Statistical Scenarios

Noah N. N. van Dongen, Johnny B. van Doorn, Quentin F. Gronau, Don van Ravenzwaaij, Rink Hoekstra, Matthias N. Haucke, Daniel Lakens, Christian Hennig, Richard D. Morey, Saskia Homer, Andrew Gelman, Jan Sprenger, Eric-Jan Wagenmakers

AMERICAN STATISTICIAN (2019)

Editorial Material Psychology, Biological

Discussion points for Bayesian inference

Balazs Aczel, Rink Hoekstra, Andrew Gelman, Eric-Jan Wagenmakers, Irene G. Klugkist, Jeffrey N. Rouder, Joachim Vandekerckhove, Michael D. Lee, Richard D. Morey, Wolf Vanpaemel, Zoltan Dienes, Don van Ravenzwaaij

NATURE HUMAN BEHAVIOUR (2020)

Editorial Material Psychology, Biological

Use caution when applying behavioural science to policy

Hans IJzerman, Neil A. Lewis, Andrew K. Przybylski, Netta Weinstein, Lisa DeBruine, Stuart J. Ritchie, Simine Vazire, Patrick S. Forscher, Richard D. Morey, James D. Ivory, Farid Anvari

NATURE HUMAN BEHAVIOUR (2020)

Editorial Material Psychology, Biological

Extraordinary claims, extraordinary evidence? A discussion

Richard M. Shiffrin, Dora Matzke, Jonathon D. Crystal, E. -J. Wagenmakers, Suyog H. Chandramouli, Joachim Vandekerckhove, Marco Zorzi, Richard D. Morey, Mary C. Murphy

Summary: Roberts (2020) discussed research on honeybees' ability to perform arithmetic, sparking a debate on publication standards for results that may be viewed as unlikely by readers, editors, or reviewers.

LEARNING & BEHAVIOR (2021)

Article Psychology, Multidisciplinary

Beyond Statistical Ritual: Theory in Psychological Science

Travis Proulx, Richard D. Morey

Summary: The quality of theories in psychology has declined over the years, leading to a reliance on statistical methods over theoretical rigor. Contemporary psychology is facing a crisis similar to that described by Paul Meehl, with psychologists often opting for synthetic certainties over theory-guided research. Recommendations are made for psychology to fully reengage with theory-based science.

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

Does Every Study? Implementing Ordinal Constraint in Meta-Analysis

Julia M. Haaf, Jeffrey N. Rouder

Summary: The primary goal of conducting a meta-analysis is to estimate the true effect size across a collection of studies. However, when the analyzed studies have qualitatively different results, the average effect may be a product of different mechanisms and therefore uninterpretable. To address this issue, it is important to determine whether all studies show an effect in the same expected direction. This can be achieved by using a model with multiple ordinal constraints and comparing it to alternative models. If the ordinal constraints hold, it suggests the existence of an underlying mechanism that explains the results from all studies, making the average effects interpretable.

PSYCHOLOGICAL METHODS (2023)

Editorial Material Psychology, Multidisciplinary

Editorial: Perspectives on Psychological Science-A Key Journal to Foster the Quality of Research

Klaus Fiedler, Mirta Galesic, Leonel Garcia-Marques, Aparna Labroo, Tina M. Lowrey, Richard D. Morey, Timothy J. Pleskac

PERSPECTIVES ON PSYCHOLOGICAL SCIENCE (2022)

Article Education & Educational Research

Doctoral writing workshops: A pre-registered, randomized controlled trial

Barbara W. Sarnecka, Paulina N. Silva, Jeff Coon, Darby C. Vickers, Rena B. Goldstein, Jeffrey N. Rouder

Summary: This study examines the improvement of doctoral students' writing ability through a five-week writing workshop intervention, preceded or followed by a waiting period or a maintenance period of the same length. The results show that participants in the workshop developed a greater interest in writing, found it easier, and gained more confidence as academic writers. Additionally, they engaged in more effective research planning and engaged in more reflection and positive thinking during the writing process. This study highlights the importance of this writing intervention in enhancing doctoral students' academic writing skills.

INNOVATIVE HIGHER EDUCATION (2022)

Article Psychology

A Cautionary Note on Estimating Effect Size

Don van den Bergh, Julia M. Haaf, Alexander Ly, Jeffrey N. Rouder, Eric-Jan Wagenmakers

Summary: A popular approach to statistical inference is estimation of effect size, but it often ignores the existence of null hypothesis. A spike-and-slab model offers a more precise estimation of effect size by explicitly incorporating the plausibility of the null hypothesis.

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2021)

Article Psychology, Multidisciplinary

Beneath the Surface: Unearthing Within-Person Variability and Mean Relations With Bayesian Mixed Models

Donald R. Williams, Joris Mulder, Jeffrey N. Rouder, Philippe Rast

Summary: Mixed-effects models are increasingly common in psychological science and offer untapped potential for gaining richer understanding of psychological processes. By estimating mixed-effects submodels to both the mean and within-person variance, researchers can characterize individual differences and uncover complex mean-variance relations. The method also introduces novel Bayesian hypothesis testing for mean-variance correlations and suggests paradoxical within-person effects, contrary to traditional patterns.

PSYCHOLOGICAL METHODS (2021)

Article Statistics & Probability

Teaching Bayes' Theorem: Strength of Evidence as Predictive Accuracy

Jeffrey N. Rouder, Richard D. Morey

AMERICAN STATISTICIAN (2019)

Review Psychology, Mathematical

A psychometrics of individual differences in experimental tasks

Jeffrey N. Rouder, Julia M. Haaf

PSYCHONOMIC BULLETIN & REVIEW (2019)

Article Psychology

Beyond Statistics: Accepting the Null Hypothesis in Mature Sciences

Richard D. Morey, Saskia Homer, Travis Proulx

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE (2018)

Article Psychology, Mathematical

Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications

Eric-Jan Wagenmakers, Maarten Marsman, Tahira Jamil, Alexander Ly, Josine Verhagen, Jonathon Love, Ravi Selker, Quentin F. Gronau, Martin Smira, Sacha Epskamp, Dora Matzke, Jeffrey N. Rouder, Richard D. Morey

PSYCHONOMIC BULLETIN & REVIEW (2018)

Article Computer Science, Interdisciplinary Applications

JASP: Graphical Statistical Software for Common Statistical Designs

Jonathon Love, Ravi Selker, Maarten Marsman, Tahira Jamil, Damian Dropmann, Josine Verhagen, Alexander Ly, Quentin F. Gronau, Martin Smira, Sacha Epskamp, Dora Matzke, Anneliese Wild, Patrick Knight, Jeffrey N. Rouder, Richard D. Morey, Eric-Jan Wagenmakers

JOURNAL OF STATISTICAL SOFTWARE (2019)

No Data Available