标题
Wave-like dopamine dynamics as a mechanism for spatiotemporal credit assignment
作者
关键词
dopamine, striatum, basal ganglia, reinforcement learning, credit assignment, decisionmaking, motivated behaviors, agency learning
出版物
CELL
Volume 184, Issue 10, Pages 2733-2749.e16
出版商
Elsevier BV
发表日期
2021-04-16
DOI
10.1016/j.cell.2021.03.046
参考文献
相关参考文献
注意:仅列出部分参考文献,下载原文获取全部文献信息。- A distributional code for value in dopamine-based reinforcement learning
- (2020) Will Dabney et al. NATURE
- Local D2- to D1-neuron transmodulation updates goal-directed learning in the striatum
- (2020) Miriam Matamales et al. SCIENCE
- Dopamine D2 receptors in discrimination learning and spine enlargement
- (2020) Yusuke Iino et al. NATURE
- Prefrontal Cortex-Driven Dopamine Signals in the Striatum Show Unique Spatial and Pharmacological Properties
- (2020) Martín F. Adrover et al. JOURNAL OF NEUROSCIENCE
- Anatomically segregated basal ganglia pathways allow parallel behavioral modulation
- (2020) Jaeeon Lee et al. NATURE NEUROSCIENCE
- Spatial organization of functional clusters representing reward and movement information in the striatal direct and indirect pathways
- (2020) Jung Hwan Shin et al. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
- Axonal mechanisms mediating γ-aminobutyric acid receptor type A (GABA-A) inhibition of striatal dopamine release
- (2020) Paul F Kramer et al. eLife
- A Unified Framework for Dopamine Signals across Timescales
- (2020) HyungGoo R. Kim et al. CELL
- Distinct Cortical-Thalamic-Striatal Circuits through the Parafascicular Nucleus
- (2019) Gil Mandelbaum et al. NEURON
- Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons
- (2019) Ben Engelhard et al. NATURE
- Dissociable dopamine dynamics for learning and motivation
- (2019) Ali Mohebi et al. NATURE
- Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience
- (2019) Emily L Mackevicius et al. eLife
- An open cortico-basal ganglia loop allows limbic control over motor output via the nigrothalamic pathway
- (2019) Sho Aoki et al. eLife
- Continuous and Discrete Neuron Types of the Adult Murine Striatum
- (2019) Geoffrey Stanley et al. NEURON
- A Spatiomolecular Map of the Striatum
- (2019) Antje Märtin et al. Cell Reports
- Dopamine Secretion Is Mediated by Sparse Active Zone-like Release Sites
- (2018) Changliang Liu et al. CELL
- A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum
- (2018) Tomomi Shindou et al. EUROPEAN JOURNAL OF NEUROSCIENCE
- What does dopamine mean?
- (2018) Joshua D. Berke NATURE NEUROSCIENCE
- Author Correction: Dopamine transients are sufficient and necessary for acquisition of model-based associations
- (2018) Melissa J Sharpe et al. NATURE NEUROSCIENCE
- Cortical travelling waves: mechanisms and computational principles
- (2018) Lyle Muller et al. NATURE REVIEWS NEUROSCIENCE
- Ultrafast neuronal imaging of dopamine dynamics with designed genetically encoded sensors
- (2018) Tommaso Patriarchi et al. SCIENCE
- Local GABAA receptor mediated suppression of dopamine release within the nucleus accumbens
- (2018) Zachary Brodnik et al. ACS Chemical Neuroscience
- Diametric neural ensemble dynamics in parkinsonian and dyskinetic states
- (2018) Jones G. Parker et al. NATURE
- Dopamine neuron activity before action initiation gates and invigorates future movements
- (2018) Joaquim Alves da Silva et al. NATURE
- Topographic precision in sensory and motor corticostriatal projections varies across cell type and cortical area
- (2018) Bryan M. Hooks et al. Nature Communications
- Inhibition of nigrostriatal dopamine release by striatal GABAA and GABAB receptors
- (2018) Emanuel F. Lopes et al. JOURNAL OF NEUROSCIENCE
- Detection and analysis of spatiotemporal patterns in brain activity
- (2018) Rory G. Townsend et al. PLoS Computational Biology
- Optical-flow analysis toolbox for characterization of spatiotemporal dynamics in mesoscale optical imaging of brain activity
- (2017) Navvab Afrashteh et al. NEUROIMAGE
- The Spatiotemporal Organization of the Striatum Encodes Action Space
- (2017) Andreas Klaus et al. NEURON
- Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice
- (2017) William Menegas et al. eLife
- Cortical Control of Striatal Dopamine Transmission via Striatal Cholinergic Interneurons
- (2016) Polina Kosillo et al. CEREBRAL CORTEX
- Rapid signalling in distinct dopaminergic axons during locomotion and reward
- (2016) M. W. Howe et al. NATURE
- Dopamine neurons share common response function for reward prediction error
- (2016) Neir Eshel et al. NATURE NEUROSCIENCE
- The mouse cortico-striatal projectome
- (2016) Houri Hintiryan et al. NATURE NEUROSCIENCE
- Dopamine reward prediction-error signalling: a two-component response
- (2016) Wolfram Schultz NATURE REVIEWS NEUROSCIENCE
- Spatially Compact Neural Clusters in the Dorsal Striatum Encode Locomotion Relevant Information
- (2016) Giovanni Barbera et al. NEURON
- Midbrain dopamine neurons control judgment of time
- (2016) S. Soares et al. SCIENCE
- A comprehensive excitatory input map of the striatum reveals novel functional organization
- (2016) Barbara J Hunnicutt et al. eLife
- Sensitive red protein calcium indicators for imaging neural activity
- (2016) Hod Dana et al. eLife
- Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards
- (2015) Hyoung F. Kim et al. BRAIN
- Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine Subcircuits
- (2015) Talia N. Lerner et al. CELL
- A Scalable Population Code for Time in the Striatum
- (2015) Gustavo B.M. Mello et al. CURRENT BIOLOGY
- Mesolimbic dopamine signals the value of work
- (2015) Arif A Hamid et al. NATURE NEUROSCIENCE
- Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens
- (2015) Kevin Lloyd et al. PLoS Computational Biology
- A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning
- (2015) Nicholas T Franklin et al. eLife
- Regional Variation in Phasic Dopamine Release during Alcohol and Sucrose Self-Administration in Rats
- (2014) Tatiana A. Shnitko et al. ACS Chemical Neuroscience
- Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive.
- (2014) Anne G. E. Collins et al. PSYCHOLOGICAL REVIEW
- A critical time window for dopamine actions on the structural plasticity of dendritic spines
- (2014) S. Yagishita et al. SCIENCE
- The stimulus-evoked population response in visual cortex of awake monkey is a propagating wave
- (2014) Lyle Muller et al. Nature Communications
- Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
- (2013) Mark W. Howe et al. NATURE
- Ultrasensitive fluorescent proteins for imaging neuronal activity
- (2013) Tsai-Wen Chen et al. NATURE
- Spontaneous cortical activity alternates between motifs defined by regional axonal projections
- (2013) Majid H Mohajerani et al. NATURE NEUROSCIENCE
- Dopamine Ramps Are a Consequence of Reward Prediction Errors
- (2013) Samuel J. Gershman NEURAL COMPUTATION
- How Did the Chicken Cross the Road? With Her Striatal Cholinergic Interneurons, Of Course
- (2013) Geoffrey Schoenbaum et al. NEURON
- The Thalamostriatal Pathway and Cholinergic Control of Goal-Directed Action: Interlacing New with Existing Learning in the Striatum
- (2013) Laura A. Bradfield et al. NEURON
- Cognitive control over learning: Creating, clustering, and generalizing task-set structure.
- (2013) Anne G. E. Collins et al. PSYCHOLOGICAL REVIEW
- The energy cost of action potential propagation in dopamine neurons: clues to susceptibility in Parkinson's disease
- (2013) Eleftheria K. Pissadaki et al. Frontiers in Computational Neuroscience
- Dopamine Enhances Model-Based over Model-Free Choice Behavior
- (2012) Klaus Wunderlich et al. NEURON
- Striatal Dopamine Release Is Triggered by Synchronized Activity in Cholinergic Interneurons
- (2012) Sarah Threlfell et al. NEURON
- Coordinated Activity of Ventral Tegmental Neurons Adapts to Appetitive and Aversive Learning
- (2012) Yunbok Kim et al. PLoS One
- Selective Activation of Cholinergic Interneurons Enhances Accumbal Phasic Dopamine Release: Setting the Tone for Reward Processing
- (2012) Roger Cachope et al. Cell Reports
- Acute in vivo nicotine administration enhances synchrony among dopamine neurons
- (2011) Wei Li et al. BIOCHEMICAL PHARMACOLOGY
- Mechanisms of Hierarchical Reinforcement Learning in Corticostriatal Circuits 1: Computational Analysis
- (2011) Michael J. Frank et al. CEREBRAL CORTEX
- Mechanisms of Hierarchical Reinforcement Learning in Cortico-Striatal Circuits 2: Evidence from fMRI
- (2011) D. Badre et al. CEREBRAL CORTEX
- Computational models of motivated action selection in corticostriatal circuits
- (2011) Michael J Frank CURRENT OPINION IN NEUROBIOLOGY
- Primary food reward and reward-predictive stimuli evoke different patterns of phasic dopamine signaling throughout the striatum
- (2011) Holden D. Brown et al. EUROPEAN JOURNAL OF NEUROSCIENCE
- Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis
- (2011) P. W. Glimcher PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
- Posterior dorsomedial striatum is critical for both selective instrumental and Pavlovian reward learning
- (2010) Laura H. Corbit et al. EUROPEAN JOURNAL OF NEUROSCIENCE
- Differential Dynamics of Activity Changes in Dorsolateral and Dorsomedial Striatal Loops during Learning
- (2010) Catherine A. Thorn et al. NEURON
- Human Reinforcement Learning Subdivides Structured Action Spaces by Learning Effector-Specific Values
- (2009) S. J. Gershman et al. JOURNAL OF NEUROSCIENCE
- Single Nigrostriatal Dopaminergic Neurons Form Widely Spread and Highly Dense Axonal Arborizations in the Neostriatum
- (2009) W. Matsuda et al. JOURNAL OF NEUROSCIENCE
- Hippocampal theta oscillations are travelling waves
- (2009) Evgueniy V. Lubenov et al. NATURE
- Synchronization of Midbrain Dopaminergic Neurons Is Enhanced by Rewarding Events
- (2009) Mati Joshua et al. NEURON
- Automated Analysis of Cellular Signals from Large-Scale Calcium Imaging Data
- (2009) Eran A. Mukamel et al. NEURON
- Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action
- (2009) Bernard W Balleine et al. NEUROPSYCHOPHARMACOLOGY
- Neural mechanisms of acquired phasic dopamine responses in learning
- (2009) Thomas E. Hazy et al. NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
- Habits, Rituals, and the Evaluative Brain
- (2008) Ann M. Graybiel Annual Review of Neuroscience
- Stimulus Representation and the Timing of Reward-Prediction Errors in Models of the Dopamine System
- (2008) Elliot A. Ludvig et al. NEURAL COMPUTATION
- Efficient subpixel image registration algorithms
- (2008) Manuel Guizar-Sicairos et al. OPTICS LETTERS
- Functional integration across a gradient of corticostriatal channels controls UP state transitions in the dorsal striatum
- (2008) F. Kasanetz et al. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA
Find Funding. Review Successful Grants.
Explore over 25,000 new funding opportunities and over 6,000,000 successful grants.
ExploreBecome a Peeref-certified reviewer
The Peeref Institute provides free reviewer training that teaches the core competencies of the academic peer review process.
Get Started