A taxonomy of surprise definitions

Spatiotemporal Signatures of Surprise Captured by Magnetoencephalography

(2022) Zahra Mousavi et al.   Frontiers in Systems Neuroscience

Learning in Volatile Environments with the Bayes Factor Surprise

(2021) Vasiliki Liakoni et al.   NEURAL COMPUTATION

Active Inference: Demystified and Compared

(2021) Noor Sajid et al.   NEURAL COMPUTATION

Neural surprise in somatosensory Bayesian learning

(2021) Sam Gijsen et al.   PLoS Computational Biology

Signed and unsigned reward prediction errors dynamically enhance learning and memory

(2021) Nina Rouhani et al.   eLife

Electroencephalographic correlates of temporal Bayesian belief updating and surprise

(2021) Antonino Visalli et al.   NEUROIMAGE

Human inference in changing environments with temporal structure.

(2021) Arthur Prat-Carrabin et al.   PSYCHOLOGICAL REVIEW

Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making

(2021) He A. Xu et al.   PLoS Computational Biology

An empirical evaluation of active inference in multi-armed bandits

(2021) Dimitrije Marković et al.   NEURAL NETWORKS

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

(2021) Vasiliki Liakoni et al.   NEUROIMAGE

How particular is the physics of the free energy principle?

(2021) Miguel Aguilera et al.   Physics of Life Reviews

Brain dynamics for confidence-weighted learning

(2020) Florent Meyniel   PLoS Computational Biology

Understanding exploration in humans and machines by formalizing the function of curiosity

(2020) Rachit Dubey et al.   Current Opinion in Behavioral Sciences

Behavioral, Physiological, and Neural Signatures of Surprise during Naturalistic Sports Viewing

(2020) James W. Antony et al.   NEURON

Adaptive learning under expected and unexpected uncertainty

(2019) Alireza Soltani et al.   NATURE REVIEWS NEUROSCIENCE

Confidence resets reveal hierarchical adaptive learning in humans

(2019) Micha Heilbron et al.   PLoS Computational Biology

Brain signatures of a multiscale process of sequence learning in humans

(2019) Maxime Maheu et al.   eLife

Trial-by-trial surprise-decoding model for visual and auditory binary oddball tasks

(2019) Alireza Modirshanechi et al.   NEUROIMAGE

One-shot learning and behavioral eligibility traces in sequential decision making

(2019) Marco P Lehmann et al.   eLife

Reconciling novelty and complexity through a rational analysis of curiosity.

(2019) Rachit Dubey et al.   PSYCHOLOGICAL REVIEW

Balancing New against Old Information: The Role of Puzzlement Surprise in Learning

(2018) Mohammadjavad Faraji et al.   NEURAL COMPUTATION

Neurocomputational Dynamics of Sequence Learning

(2018) Arkady Konovalov et al.   NEURON

Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

(2018) Wulfram Gerstner et al.   Frontiers in Neural Circuits

Towards a neuroscience of active sampling and curiosity

(2018) Jacqueline Gottlieb et al.   NATURE REVIEWS NEUROSCIENCE

Dopaminergic basis for signaling belief updates, but not surprise, and the link to paranoia

(2018) Matthew M. Nour et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Variational Inference: A Review for Statisticians

(2017) David M. Blei et al.   JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION

Active Inference: A Process Theory

(2017) Karl Friston et al.   NEURAL COMPUTATION

The Representation of Prediction Error in Auditory Cortex

(2016) Jonathan Rubin et al.   PLoS Computational Biology

Human Inferences about Sequences: A Minimal Transition Probability Model

(2016) Florent Meyniel et al.   PLoS Computational Biology

Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system

(2016) Kiyohito Iigaya   eLife

Reinforcement Learning in Multidimensional Environments Relies on Attention Mechanisms

(2015) Y. Niv et al.   JOURNAL OF NEUROSCIENCE

A computational analysis of the neural bases of Bayesian inference

(2015) Antonio Kolossa et al.   NEUROIMAGE

Interplay of approximate planning strategies

(2015) Quentin J. M. Huys et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Normative evidence accumulation in unpredictable environments

(2015) Christopher M Glaze et al.   eLife

The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors

(2013) D. Talmi et al.   JOURNAL OF NEUROSCIENCE

Dissociable effects of surprise and model update in parietal and anterior cingulate cortex

(2013) J. X. O'Reilly et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems

(2013) Robert C. Wilson et al.   PLoS Computational Biology

Modelling Trial-by-Trial Changes in the Mismatch Negativity

(2013) Falk Lieder et al.   PLoS Computational Biology

Surprise! Neural correlates of Pearce-Hall and Rescorla-Wagner coexist within the brain

(2012) Matthew R. Roesch et al.   EUROPEAN JOURNAL OF NEUROSCIENCE

Rational regulation of learning dynamics by pupil-linked arousal systems

(2012) Matthew R Nassar et al.   NATURE NEUROSCIENCE

Evidence for neural encoding of Bayesian surprise in human somatosensation

(2012) Dirk Ostwald et al.   NEUROIMAGE

Surprise Signals in Anterior Cingulate Cortex: Neuronal Encoding of Unsigned Reward Prediction Errors Driving Adjustment in Behavior

(2011) B. Y. Hayden et al.   JOURNAL OF NEUROSCIENCE

Model-Based Influences on Humans' Choices and Striatal Prediction Errors

(2011) Nathaniel D. Daw et al.   NEURON

An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment

(2010) M. R. Nassar et al.   JOURNAL OF NEUROSCIENCE

The free-energy principle: a unified brain theory?

(2010) Karl Friston   NATURE REVIEWS NEUROSCIENCE

States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning

(2010) Jan Gläscher et al.   NEURON

Statistically optimal perception and learning: from behavior to neural representations

(2010) József Fiser et al.   TRENDS IN COGNITIVE SCIENCES

Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010)

(2010) Jürgen Schmidhuber   IEEE Transactions on Autonomous Mental Development

Reinforcement learning in the brain

(2009) Yael Niv   JOURNAL OF MATHEMATICAL PSYCHOLOGY

Of bits and wows: A Bayesian theory of surprise with applications to attention

(2009) Pierre Baldi et al.   NEURAL NETWORKS

Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise

(2008) R. B. Mars et al.   JOURNAL OF NEUROSCIENCE