Reward-based training of recurrent neural networks for cognitive and value-based tasks

Goal-Directed Decision Making with Spiking Neurons

(2016) Johannes Friedrich et al.   JOURNAL OF NEUROSCIENCE

Explicit information for category-orthogonal object properties increases along the ventral stream

(2016) Ha Hong et al.   NATURE NEUROSCIENCE

Recurrent Network Models of Sequence Generation and Memory

(2016) Kanaka Rajan et al.   NEURON

Toward an Integration of Deep Learning and Neuroscience

(2016) Adam H. Marblestone et al.   Frontiers in Computational Neuroscience

Random synaptic feedback weights support error backpropagation for deep learning

(2016) Timothy P. Lillicrap et al.   Nature Communications

Training Excitatory-Inhibitory Recurrent Neural Networks for Cognitive Tasks: A Simple and Flexible Framework

(2016) H. Francis Song et al.   PLoS Computational Biology

On simplicity and complexity in the brave new world of large-scale neuroscience

(2015) Peiran Gao et al.   CURRENT OPINION IN NEUROBIOLOGY

Confidence estimation as a stochastic process in a neurodynamical system of decision making

(2015) Ziqiang Wei et al.   JOURNAL OF NEUROPHYSIOLOGY

A neural network that finds a naturalistic solution for the production of muscle activity

(2015) David Sussillo et al.   NATURE NEUROSCIENCE

What the orbitofrontal cortex does not do

(2015) Thomas A Stalnaker et al.   NATURE NEUROSCIENCE

Dynamic Control of Response Criterion in Premotor Cortex during Perceptual Detection under Temporal Uncertainty

(2015) Federico Carnevale et al.   NEURON

Choice-correlated activity fluctuations underlie learning of neuronal category representation

(2015) Tatiana A. Engel et al.   Nature Communications

Reinforcement Learning of Linking and Tracing Contours in Recurrent Neural Networks

(2015) Tobias Brosch et al.   PLoS Computational Biology

Basal Ganglia Circuits for Reward Value–Guided Behavior

(2014) Okihide Hikosaka et al.   Annual Review of Neuroscience

Neural circuits as computational dynamical systems

(2014) David Sussillo   CURRENT OPINION IN NEUROBIOLOGY

A category-free neural population supports evolving demands during decision-making

(2014) David Raposo et al.   NATURE NEUROSCIENCE

Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements

(2014) Guillaume Hennequin et al.   NEURON

Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence

(2014) Armin Lak et al.   NEURON

Performance-optimized hierarchical models predict neural responses in higher visual cortex

(2014) D. L. K. Yamins et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition

(2014) Charles F. Cadieu et al.   PLoS Computational Biology

Context-dependent computation by recurrent dynamics in prefrontal cortex

(2013) Valerio Mante et al.   NATURE

The importance of mixed selectivity in complex cognitive tasks

(2013) Mattia Rigotti et al.   NATURE

Robust timing and motor patterns by taming chaos in recurrent neural networks

(2013) Rodrigo Laje et al.   NATURE NEUROSCIENCE

From fixed points to chaos: Three models of delayed discrimination

(2013) Omri Barak et al.   PROGRESS IN NEUROBIOLOGY

Emergence of Complex Computational Structures From Chaotic Neural Networks Through Reward-Modulated Hebbian Learning

(2012) Gregor M. Hoerzer et al.   CEREBRAL CORTEX

A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients

(2012) Ivo Grondman et al.   IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND RE

Multisensory Decision-Making in Rats and Humans

(2012) D. Raposo et al.   JOURNAL OF NEUROSCIENCE

Opening the Black Box: Low-Dimensional Dynamics in High-Dimensional Recurrent Neural Networks

(2012) David Sussillo et al.   NEURAL COMPUTATION

Does the orbitofrontal cortex signal value?

(2011) Geoffrey Schoenbaum et al.   Annals of the New York Academy of Sciences

Signals in Human Striatum Are Appropriate for Policy Update Rather than Value Prediction

(2011) J. Li et al.   JOURNAL OF NEUROSCIENCE

A reservoir of time constants for memory traces in cortical neurons

(2011) Alberto Bernacchia et al.   NATURE NEUROSCIENCE

Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex

(2011) Yuji K Takahashi et al.   NATURE NEUROSCIENCE

Basal ganglia contributions to motor control: a vigorous tutor

(2010) Robert S Turner et al.   CURRENT OPINION IN NEUROBIOLOGY

Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity

(2010) N. Fremaux et al.   JOURNAL OF NEUROSCIENCE

Functional, But Not Anatomical, Separation of "What" and "When" in Prefrontal Cortex

(2010) C. K. Machens et al.   JOURNAL OF NEUROSCIENCE

Two-factor theory, the actor--critic model, and conditioned avoidance

(2010) T. V. Maia   LEARNING & BEHAVIOR

Internal representation of task rules by recurrent dynamics: the importance of the diversity of neural responses

(2010) Mattia Rigotti   Frontiers in Computational Neuroscience

Decision Making Under Uncertainty: A Neural Model Based on Partially Observable Markov Decision Processes

(2010) Rajesh P. N. Rao   Frontiers in Computational Neuroscience

Recurrent policy gradients

(2009) D. Wierstra et al.   LOGIC JOURNAL OF THE IGPL

Reinforcement learning in populations of spiking neurons

(2009) Robert Urbanczik et al.   NATURE NEUROSCIENCE

Synaptic computation underlying probabilistic inference

(2009) Alireza Soltani et al.   NATURE NEUROSCIENCE

Generating Coherent Patterns of Activity from Chaotic Neural Networks

(2009) David Sussillo et al.   NEURON

Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex

(2009) R. Kiani et al.   SCIENCE

Decision theory, reinforcement learning, and the brain

(2008) P. Dayan et al.   COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE

Bounded Integration in Parietal Cortex Underlies Decisions Even When Viewing Duration Is Dictated by the Environment

(2008) R. Kiani et al.   JOURNAL OF NEUROSCIENCE

Neural correlates, computation and behavioural impact of decision confidence

(2008) Adam Kepecs et al.   NATURE

Reinforcement learning of motor skills with policy gradients

(2008) Jan Peters et al.   NEURAL NETWORKS

Decision Making in Recurrent Neuronal Circuits

(2008) Xiao-Jing Wang   NEURON

Silencing the critics: understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model

(2008) Yuji Takahashi   Frontiers in Neuroscience