Curiosity-driven exploration: foundations in neuroscience and computational modeling

An Information-Theoretic Perspective on Intrinsic Motivation in Reinforcement Learning: A Survey

(2023) Arthur Aubret et al.   Entropy

Surprise and novelty in the brain

(2023) Alireza Modirshanechi et al.   CURRENT OPINION IN NEUROBIOLOGY

Empowerment contributes to exploration behaviour in a creative video game

(2023) Franziska Brändle et al.   Nature Human Behaviour

A reward-learning framework of knowledge acquisition: An integrated account of curiosity, interest, and intrinsic–extrinsic rewards.

(2022) Kou Murayama   PSYCHOLOGICAL REVIEW

Surprise and recency in novelty detection in the primate brain

(2022) Kaining Zhang et al.   CURRENT BIOLOGY

Independent and interacting value systems for reward and information in the human brain

(2022) Irene Cogliati Dezza et al.   eLife

Contributions of expected learning progress and perceptual novelty to curiosity-driven exploration

(2022) Francesco Poli et al.   COGNITION

A taxonomy of surprise definitions

(2022) Alireza Modirshanechi et al.   JOURNAL OF MATHEMATICAL PSYCHOLOGY

Striatal dopamine explains novelty-induced behavioral dynamics and individual variability in threat prediction

(2022) Korleki Akiti et al.   NEURON

Uncertainty modulates visual maps during noninstrumental information demand

(2022) Yvonne Li et al.   Nature Communications

Human complex exploration strategies are enriched by noradrenaline-modulated heuristics

(2021) Magda Dubois et al.   eLife

Why and how the brain weights contributions from a mixture of experts

(2021) John P. O’Doherty et al.   NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS

A cell type–specific cortico-subcortical brain circuit for investigatory and novelty-seeking behavior

(2021) Mehran Ahmadlou et al.   SCIENCE

Neuropixels 2.0: A miniaturized high-density probe for stable, long-term brain recordings

(2021) Nicholas A. Steinmetz et al.   SCIENCE

Linear reinforcement learning in planning, grid fields, and cognitive control

(2021) Payam Piray et al.   Nature Communications

Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making

(2021) He A. Xu et al.   PLoS Computational Biology

Orienting our view of the superior colliculus: specializations and general functions

(2021) Kathryne M. Allen et al.   CURRENT OPINION IN NEUROBIOLOGY

A primate temporal cortex–zona incerta pathway for novelty seeking

(2021) Takaya Ogasawara et al.   NATURE NEUROSCIENCE

Humans monitor learning progress in curiosity-driven exploration

(2021) Alexandr Ten et al.   Nature Communications

Cue-Evoked Dopamine Promotes Conditioned Responding during Learning

(2020) Joachim Morrens et al.   NEURON

Shared striatal activity in decisions to satisfy curiosity and hunger at the risk of electric shocks

(2020) Johnny King L. Lau et al.   Nature Human Behaviour

The ventral striatum dissociates information expectation, reward anticipation, and reward receipt

(2020) Flavia Filimon et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Dopamine modulates subcortical responses to surprising sounds

(2020) Catalina Valdés-Baizabal et al.   PLOS BIOLOGY

A Platform for Brain-wide Volumetric Functional Ultrasound Imaging and Analysis of Circuit Dynamics in Awake Mice

(2020) Clément Brunner et al.   NEURON

Behavioral, Physiological, and Neural Signatures of Surprise during Naturalistic Sports Viewing

(2020) James W. Antony et al.   NEURON

Parietal neurons encode information sampling based on decision uncertainty

(2019) Mattias Horan et al.   NATURE NEUROSCIENCE

Diverse motives for human curiosity

(2019) Kenji Kobayashi et al.   Nature Human Behaviour

Trial-by-trial surprise-decoding model for visual and auditory binary oddball tasks

(2019) Alireza Modirshanechi et al.   NEUROIMAGE

An ecological framework of neophobia: from cells to organisms to populations

(2019) Adam L. Crane et al.   BIOLOGICAL REVIEWS

Visual novelty, curiosity, and intrinsic reward in machine learning and the brain

(2019) Andrew Jaegle et al.   CURRENT OPINION IN NEUROBIOLOGY

A neural network for information seeking

(2019) J. Kael White et al.   Nature Communications

Reconciling novelty and complexity through a rational analysis of curiosity.

(2019) Rachit Dubey et al.   PSYCHOLOGICAL REVIEW

Predicting the unknown: Novelty processing depends on expectations

(2018) J. Schomaker et al.   BRAIN RESEARCH

Novelty-Sensitive Dopaminergic Neurons in the Human Substantia Nigra Predict Success of Declarative Memory Formation

(2018) Jan Kamiński et al.   CURRENT BIOLOGY

Induction and relief of curiosity elicit parietal and frontal activity

(2018) Lieke L. F. van Lieshout et al.   JOURNAL OF NEUROSCIENCE

Circuits in the Rodent Brainstem that Control Whisking in Concert with Other Orofacial Motor Actions

(2018) Lauren E. McElvain et al.   NEUROSCIENCE

Dopamine neuron activity before action initiation gates and invigorates future movements

(2018) Joaquim Alves da Silva et al.   NATURE

Towards a neuroscience of active sampling and curiosity

(2018) Jacqueline Gottlieb et al.   NATURE REVIEWS NEUROSCIENCE

The algorithmic architecture of exploration in the human brain

(2018) Eric Schulz et al.   CURRENT OPINION IN NEUROBIOLOGY

Parietal neurons encode expected gains in instrumental information

(2017) Nicholas C. Foley et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Neurons along the auditory pathway exhibit a hierarchical organization of prediction error

(2017) Gloria G. Parras et al.   Nature Communications

Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice

(2017) William Menegas et al.   eLife

Locus coeruleus and dopaminergic consolidation of everyday memory

(2016) Tomonori Takeuchi et al.   NATURE

Dopamine neurons learn relative chosen value from probabilistic rewards

(2016) Armin Lak et al.   eLife

Perirhinal cortex lesions in rats: Novelty detection and sensitivity to interference.

(2015) Mathieu M. Albasser et al.   BEHAVIORAL NEUROSCIENCE

Perirhinal cortex lesions impair tests of object recognition memory but spare novelty detection

(2015) Cristian M. Olarte-Sánchez et al.   EUROPEAN JOURNAL OF NEUROSCIENCE

Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity

(2015) Tommy C. Blanchard et al.   NEURON

Short- and long-lasting consequences of novelty, deviance and surprise on brain and cognition

(2015) J. Schomaker et al.   NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS

Eye movements reveal epistemic curiosity in human observers

(2015) Adrien Baranes et al.   VISION RESEARCH

Novelty Enhances Visual Salience Independently of Reward in the Parietal Lobe

(2014) N. C. Foley et al.   JOURNAL OF NEUROSCIENCE

States of Curiosity Modulate Hippocampus-Dependent Learning via the Dopaminergic Circuit

(2014) Matthias J. Gruber et al.   NEURON

K-ATP channels in dopamine substantia nigra neurons control bursting and novelty-induced exploration

(2012) Julia Schiemann et al.   NATURE NEUROSCIENCE

Dynamic Sensory Representations in the Olfactory Bulb: Modulation by Wakefulness and Experience

(2012) Hiroyuki K. Kato et al.   NEURON

Sniffing and whisking in rodents

(2011) Martin Deschênes et al.   CURRENT OPINION IN NEUROBIOLOGY

Lateral habenula neurons signal errors in the prediction of reward information

(2011) Ethan S Bromberg-Martin et al.   NATURE NEUROSCIENCE

Contextual Novelty Changes Reward Representations in the Striatum

(2010) M. Guitart-Masip et al.   JOURNAL OF NEUROSCIENCE

Tuning arousal with optogenetic modulation of locus coeruleus neurons

(2010) Matthew E Carter et al.   NATURE NEUROSCIENCE

The anatomical and functional relationship between the P3 and autonomic components of the orienting response

(2010) Sander Nieuwenhuis et al.   PSYCHOPHYSIOLOGY

Intrinsically Motivated Reinforcement Learning: An Evolutionary Perspective

(2010) Satinder Singh et al.   IEEE Transactions on Autonomous Mental Development

Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010)

(2010) Jürgen Schmidhuber   IEEE Transactions on Autonomous Mental Development

Reward Motivation Accelerates the Onset of Neural Novelty Signals in Humans to 85 Milliseconds

(2009) Nico Bunzeck et al.   CURRENT BIOLOGY

Of bits and wows: A Bayesian theory of surprise with applications to attention

(2009) Pierre Baldi et al.   NEURAL NETWORKS

Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards

(2009) Ethan S. Bromberg-Martin et al.   NEURON

An analysis of model-based Interval Estimation for Markov Decision Processes

(2008) Alexander L. Strehl et al.   JOURNAL OF COMPUTER AND SYSTEM SCIENCES

Relation of Locus Coeruleus Neurons in Monkeys to Pavlovian and Operant Behaviors

(2008) Sebastien Bouret et al.   JOURNAL OF NEUROPHYSIOLOGY

Striatal Activity Underlies Novelty-Based Choice in Humans

(2008) Bianca C. Wittmann et al.   NEURON

Bayesian surprise attracts human attention

(2008) Laurent Itti et al.   VISION RESEARCH