Planning in the brain

Hippocampal place cells encode global location but not connectivity in a complex space

(2021) Éléonore Duvelle et al.   CURRENT BIOLOGY

Fixation patterns in simple choice reflect optimal information sampling

(2021) Frederick Callaway et al.   PLoS Computational Biology

Representations of uncertainty: where art thou?

(2021) Ádám Koblinger et al.   Current Opinion in Behavioral Sciences

Formalizing planning and information search in naturalistic decision-making

(2021) L. T. Hunt et al.   NATURE NEUROSCIENCE

Experience replay is associated with efficient nonlocal learning

(2021) Yunzhe Liu et al.   SCIENCE

The Versatile Wayfinder: Prefrontal Contributions to Spatial Navigation

(2021) Eva Zita Patai et al.   TRENDS IN COGNITIVE SCIENCES

Linear reinforcement learning in planning, grid fields, and cognitive control

(2021) Payam Piray et al.   Nature Communications

Hippocampal replay reflects specific past experiences rather than a plan for subsequent choice

(2021) Anna K. Gillespie et al.   NEURON

Constant Sub-second Cycling between Representations of Possible Futures in the Hippocampus

(2020) Kenneth Kay et al.   CELL

Assembly-Specific Disruption of Hippocampal Replay Leads to Selective Memory Deficit

(2020) Igor Gridchyn et al.   NEURON

Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference

(2020) Rodrigo Echeveste et al.   NATURE NEUROSCIENCE

Combined model-free and model-sensitive reinforcement learning in non-human primates

(2020) Bruno Miranda et al.   PLoS Computational Biology

Neuronal Computation Underlying Inferential Reasoning in Humans and Mice

(2020) Helen C. Barron et al.   CELL

Mastering Atari, Go, chess and shogi by planning with a learned model

(2020) Julian Schrittwieser et al.   NATURE

The Anterior Cingulate Cortex Predicts Future States to Mediate Model-Based Action Selection

(2020) Thomas Akam et al.   NEURON

Prioritized experience replays on a hippocampal predictive map for learning

(2020) Hideyoshi Igata et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Rational thoughts in neural codes

(2020) Zhengwei Wu et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Evidence for model-based encoding of Pavlovian contingencies in the human brain

(2019) Wolfgang M. Pauli et al.   Nature Communications

Hippocampal Contributions to Model-Based Planning and Spatial Memory

(2019) Oliver M. Vikbladh et al.   NEURON

Novel electrode technologies for neural recordings

(2019) Guosong Hong et al.   NATURE REVIEWS NEUROSCIENCE

Resource-rational analysis: understanding human cognition as the optimal use of limited computational resources

(2019) Falk Lieder et al.   BEHAVIORAL AND BRAIN SCIENCES

Reward revaluation biases hippocampal replay content away from the preferred outcome

(2019) Alyssa A. Carey et al.   NATURE NEUROSCIENCE

Planning at decision time and in the background during spatial navigation

(2019) Giovanni Pezzulo et al.   Current Opinion in Behavioral Sciences

The honeycomb maze provides a novel test to study hippocampal-dependent spatial navigation

(2018) Ruth A. Wood et al.   NATURE

Prefrontal cortex as a meta-reinforcement learning system

(2018) Jane X. Wang et al.   NATURE NEUROSCIENCE

Orbitofrontal neurons signal sensory associations underlying model-based inference in a sensory preconditioning task

(2018) Brian F Sadacca et al.   eLife

Vector-based navigation using grid-like representations in artificial agents

(2018) Andrea Banino et al.   NATURE

DeepLabCut: markerless pose estimation of user-defined body parts with deep learning

(2018) Alexander Mathis et al.   NATURE NEUROSCIENCE

Triple dissociation of attention and decision computations across prefrontal cortex

(2018) Laurence T. Hunt et al.   NATURE NEUROSCIENCE

Hippocampal replays under the scrutiny of reinforcement learning models

(2018) Romain Cazé et al.   JOURNAL OF NEUROPHYSIOLOGY

Prioritized memory access explains planning and hippocampal replay

(2018) Marcelo G. Mattar et al.   NATURE NEUROSCIENCE

What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior

(2018) Timothy E.J. Behrens et al.   NEURON

Navigating cognition: Spatial codes for human thinking

(2018) Jacob L. S. Bellmund et al.   SCIENCE

A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play

(2018) David Silver et al.   SCIENCE

Deep Reinforcement Learning: A Brief Survey

(2017) Kai Arulkumaran et al.   IEEE SIGNAL PROCESSING MAGAZINE

Mastering the game of Go without human knowledge

(2017) David Silver et al.   NATURE

Fully integrated silicon probes for high-density recording of neural activity

(2017) James J. Jun et al.   NATURE

Mapping of a non-spatial dimension by the hippocampal–entorhinal circuit

(2017) Dmitriy Aronov et al.   NATURE

Dorsal hippocampus contributes to model-based planning

(2017) Kevin J Miller et al.   NATURE NEUROSCIENCE

Reinstated episodic context guides sampling-based decisions for reward

(2017) Aaron M Bornstein et al.   NATURE NEUROSCIENCE

Spatial representation in the hippocampal formation: a history

(2017) Edvard I Moser et al.   NATURE NEUROSCIENCE

The hippocampus as a predictive map

(2017) Kimberly L Stachenfeld et al.   NATURE NEUROSCIENCE

The cognitive map in humans: spatial navigation and beyond

(2017) Russell A Epstein et al.   NATURE NEUROSCIENCE

A distributed, hierarchical and recurrent framework for reward-based choice

(2017) Laurence T. Hunt et al.   NATURE REVIEWS NEUROSCIENCE

Neuroscience Needs Behavior: Correcting a Reductionist Bias

(2017) John W. Krakauer et al.   NEURON

On the Integration of Space, Time, and Memory

(2017) Howard Eichenbaum   NEURON

Reminders of past choices bias decisions for reward in humans

(2017) Aaron M. Bornstein et al.   Nature Communications

Predictive representations can link model-based reinforcement learning to model-free mechanisms

(2017) Evan M. Russek et al.   PLoS Computational Biology

Goal-Directed Decision Making with Spiking Neurons

(2016) Johannes Friedrich et al.   JOURNAL OF NEUROSCIENCE

Mastering the game of Go with deep neural networks and tree search

(2016) David Silver et al.   NATURE

Decoding subjective decisions from orbitofrontal cortex

(2016) Erin L Rich et al.   NATURE NEUROSCIENCE

Vicarious trial and error

(2016) A. David Redish   NATURE REVIEWS NEUROSCIENCE

Interplay between Hippocampal Sharp-Wave-Ripple Events and Vicarious Trial and Error Behaviors in Decision Making

(2016) Andrew E. Papale et al.   NEURON

Adaptive integration of habits into depth-limited planning defines a habitual-goal–directed spectrum

(2016) Mehdi Keramati et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Organizing conceptual knowledge in humans with a gridlike code

(2016) A. O. Constantinescu et al.   SCIENCE

Evidence integration in model-based tree search

(2015) Alec Solway et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Interplay of approximate planning strategies

(2015) Quentin J. M. Huys et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Prospective Optimization with Limited Resources

(2015) Joseph Snider et al.   PLoS Computational Biology

Simple Plans or Sophisticated Habits? State, Transition and Learning Interactions in the Two-Step Task

(2015) Thomas Akam et al.   PLoS Computational Biology

Hippocampal place cells construct reward related sequences through unexplored space

(2015) H Freyja Ólafsdóttir et al.   eLife

The Hippocampus and Entorhinal Cortex Encode the Path and Euclidean Distances to Goals during Navigation

(2014) Lorelei R. Howard et al.   CURRENT BIOLOGY

Can We Reconcile the Declarative Memory and Spatial Navigation Views on Hippocampal Function?

(2014) Howard Eichenbaum et al.   NEURON

Orbitofrontal Cortex as a Cognitive Map of Task Space

(2014) Robert C. Wilson et al.   NEURON

The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes

(2014) Peter H. Rudebeck et al.   NEURON

The algorithmic anatomy of model-based evaluation

(2014) N. D. Daw et al.   PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES

Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.

(2014) Anne G. E. Collins et al.   PSYCHOLOGICAL REVIEW

Optimal Behavioral Hierarchy

(2014) Alec Solway et al.   PLoS Computational Biology

Cognitive Tomography Reveals Complex, Task-Independent Mental Representations

(2013) Neil M.T. Houlsby et al.   CURRENT BIOLOGY

Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making

(2013) C.-H. Luk et al.   JOURNAL OF NEUROSCIENCE

Hippocampal place-cell sequences depict future paths to remembered goals

(2013) Brad E. Pfeiffer et al.   NATURE

Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating

(2013) Peter H Rudebeck et al.   NATURE NEUROSCIENCE

Goals and Habits in the Brain

(2013) Ray J. Dolan et al.   NEURON

Hippocampal SWR Activity Predicts Correct Decisions during the Initial Learning of an Alternation Task

(2013) Annabelle C. Singer et al.   NEURON

Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions

(2013) Christina M. Gremel et al.   Nature Communications

Actions, Action Sequences and Habits: Evidence That Goal-Directed and Habitual Action Control Are Hierarchically Organized

(2013) Amir Dezfouli et al.   PLoS Computational Biology

Making decisions through a distributed consensus

(2012) Paul Cisek   CURRENT OPINION IN NEUROBIOLOGY

Mapping value based planning and extensively trained choice in the human brain

(2012) Klaus Wunderlich et al.   NATURE NEUROSCIENCE

Goal-oriented searching mediated by ventral hippocampus early in trial-and-error learning

(2012) Sarah Ruediger et al.   NATURE NEUROSCIENCE

Goal-directed decision making as probabilistic inference: A computational framework and potential neural correlates.

(2012) Alec Solway et al.   PSYCHOLOGICAL REVIEW

Orbitofrontal Cortex Supports Behavior and Learning Using Inferred But Not Cached Values

(2012) J. L. Jones et al.   SCIENCE

Awake Hippocampal Sharp-Wave Ripples Support Spatial Memory

(2012) S. P. Jadhav et al.   SCIENCE

Planning as inference

(2012) Matthew Botvinick et al.   TRENDS IN COGNITIVE SCIENCES

Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision Trees

(2012) Quentin J. M. Huys et al.   PLoS Computational Biology

Neural Correlates of Forward Planning in a Spatial Decision Task in Humans

(2011) D. A. Simon et al.   JOURNAL OF NEUROSCIENCE

Computational Mechanisms of Sensorimotor Control

(2011) David W. Franklin et al.   NEURON

Model-Based Influences on Humans' Choices and Striatal Prediction Errors

(2011) Nathaniel D. Daw et al.   NEURON

Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment

(2011) P. Berkes et al.   SCIENCE

States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement Learning

(2010) Jan Gläscher et al.   NEURON

Hippocampal Replay Is Not a Simple Function of Experience

(2010) Anoopum S. Gupta et al.   NEURON

Statistically optimal perception and learning: from behavior to neural representations

(2010) József Fiser et al.   TRENDS IN COGNITIVE SCIENCES

What can man do without basal ganglia motor output? The effect of combined unilateral subthalamotomy and pallidotomy in a patient with Parkinson's disease

(2009) J.A. Obeso et al.   EXPERIMENTAL NEUROLOGY

Awake replay of remote experiences in the hippocampus

(2009) Mattias P Karlsson et al.   NATURE NEUROSCIENCE

Selective suppression of hippocampal ripples impairs spatial memory

(2009) Gabrielle Girardeau et al.   NATURE NEUROSCIENCE

Goal-directed control and its antipodes

(2009) Peter Dayan   NEURAL NETWORKS

Hippocampal Replay of Extended Experience

(2009) Thomas J. Davidson et al.   NEURON

Distinct error-correcting and incidental learning of location relative to landmarks and boundaries

(2008) C. F. Doeller et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA