4.6 Article

Variability in Action Selection Relates to Striatal Dopamine 2/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models

期刊

CEREBRAL CORTEX
卷 30, 期 6, 页码 3573-3589

出版社

OXFORD UNIV PRESS INC
DOI: 10.1093/cercor/bhz327

关键词

active inference; action selection; decision temperature; dopamine 2/3 receptors; go no-go task; reinforcement learning

资金

  1. Academy of Medical Sciences [AMS-SGCL13-Adams]
  2. National Institute of Health Research [CL2013-18-003]
  3. NIHR UCLH Biomedical Research Centre
  4. Wellcome Strategic Award [095844/7/11/Z]
  5. National institute for Health Research
  6. EU-FP7 MC6 ITN IN-SENS grant [607616]
  7. Swedish Research Council [VR521-2013-2589]
  8. Wellcome Trust [088130/Z/09/Z, 094849/Z/10/Z]
  9. NIHR UCLH Biomedical Research Centre pump priming award [BRC252/NS/JR/101410]
  10. Medical Research Council-UK [MC-A656-5QD30]
  11. National Institute for Health Research Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King's College London
  12. MRC [MR/L022176/1, MR/N027078/1, G0700995, MR/N026063/1, MC_U120097115, MR/S007806/1] Funding Source: UKRI

向作者/读者索取更多资源

Choosing actions that result in advantageous outcomes is a fundamental function of nervous systems. All computational decision-making models contain a mechanism that controls the variability of (or confidence in) action selection, but its neural implementation is unclear-especially in humans. We investigated this mechanism using two influential decision-making frameworks: active inference (AI) and reinforcement learning (RL). In AI, the precision (inverse variance) of beliefs about policies controls action selection variability-similar to decision 'noise' parameters in RL-and is thought to be encoded by striatal dopamine signaling. We tested this hypothesis by administering a 'go/no-go' task to 75 healthy participants, and measuring striatal dopamine 2/3 receptor (D2/3R) availability in a subset (n = 25) using [C-11]-(+)-PHNO positron emission tomography. In behavioral model comparison, RL performed best across the whole group but AI performed best in participants performing above chance levels. Limbic striatal D2/3R availability had linear relationships with AI policy precision (P = 0.029) as well as with RL irreducible decision 'noise' (P = 0.020), and this relationship with D2/3R availability was confirmed with a 'decision stochasticity' factor that aggregated across both models (P = 0.0006). These findings are consistent with occupancy of inhibitory striatal D(2/3)Rs decreasing the variability of action selection in humans.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Biochemistry & Molecular Biology

Striatal dopaminergic alterations in individuals with copy number variants at the 22q11.2 genetic locus and their implications for psychosis risk: a [18F]-DOPA PET study

Maria Rogdaki, Celine Devroye, Mariasole Ciampoli, Mattia Veronese, Abhishekh Ashok, Robert A. McCutcheon, Sameer Jauhar, Ilaria Bonoldi, Maria Gudbrandsen, Eileen Daly, Therese van Amelsvoort, Marianne Van Den Bree, Michael J. Owen, Federico Turkheimer, Francesco Papaleo, Oliver D. Howes

Summary: Dopaminergic dysfunction is associated with genetic risk for psychosis, particularly in individuals with 22q11.2 deletion. This study found increased striatal dopamine synthesis capacity in individuals with 22q11.2 deletion compared to healthy controls and individuals with 22q11.2 duplication. Furthermore, dopamine synthesis was positively correlated with the severity of psychosis-risk symptoms.

MOLECULAR PSYCHIATRY (2023)

Correction Biochemistry & Molecular Biology

Striatal dopaminergic alterations in individuals with copy number variants at the 22q11.2 genetic locus and their implications for psychosis risk: a [18F]-DOPA PET study (Jun, 2021, 10.1038/s41380-02101108-y)

Maria Rogdaki, Celine Devroye, Mariasole Ciampoli, Mattia Veronese, Abhishekh H. Ashok, Robert A. McCutcheon, Sameer Jauhar, Ilaria Bonoldi, Maria Gudbrandsen, Eileen Daly, Therese van Amelsvoort, Marianne Van Den Bree, Michael J. Owen, Federico Turkheimer, Francesco Papaleo, Oliver D. Howes

MOLECULAR PSYCHIATRY (2023)

Review Psychology, Clinical

Brain glucose metabolism in schizophrenia: a systematic review and meta-analysis of 18FDG-PET studies in schizophrenia

Leigh Townsend, Toby Pillinger, Pierluigi Selvaggi, Mattia Veronese, Federico Turkheimer, Oliver Howes

Summary: This study investigates brain metabolism in patients with schizophrenia and finds evidence of lower glucose metabolism in the frontal cortex, supporting the hypothesis of hypofrontality in schizophrenia. However, there were no consistent alterations in other brain regions.

PSYCHOLOGICAL MEDICINE (2023)

Article Psychology, Clinical

Reduced cortical cerebral blood flow in antipsychotic-free first-episode psychosis and relationship to treatment response

Pierluigi Selvaggi, Sameer Jauhar, Vasileia Kotoula, Fiona Pepper, Mattia Veronese, Barbara Santangelo, Fernando Zelaya, Federico E. Turkheimer, Mitul A. Mehta, Oliver D. Howes

Summary: This study found significantly lower frontal cortical blood flow in FEP patients before antipsychotic treatment. Additionally, the relative-to-global frontal cerebral blood flow measured before antipsychotic treatment may be associated with treatment response.

PSYCHOLOGICAL MEDICINE (2023)

Article Clinical Neurology

Neurophysiological consequences of synapse loss in progressive supranuclear palsy

Natalie E. Adams, Amirhossein Jafarian, Alistair Perry, Matthew A. Rouse, Alexander D. Shaw, Alexander G. Murley, Thomas E. Cope, W. Richard Bevan-Jones, Luca Passamonti, Duncan Street, Negin Holland, David Nesbitt, Laura E. Hughes, Karl J. Friston, James B. Rowe

Summary: Adams et al. use PET measures of synaptic density to enhance biophysical models of cortical dynamics and demonstrate the link between synaptic loss, neurophysiology, and cognitive deficits. Their inclusion of regional synaptic density in a mesoscale model of human cortical function significantly increases model evidence and predicts individual differences in behavior. This method can be applied to assess the mechanisms of other neurological disorders and test the effects of experimental pharmacology.
Article Clinical Neurology

Gamma Oscillations and Potassium Channel Modulation in Schizophrenia: Targeting GABAergic Dysfunction

Stephen J. Kaar, Judith F. Nottage, Ilinca Angelescu, Tiago Reis Marques, Oliver D. Howes

Summary: A study found that a potassium channel modulator called AUT00206 has a significant effect on frontal resting gamma power in people with schizophrenia, potentially improving their symptoms.

CLINICAL EEG AND NEUROSCIENCE (2023)

Review Neurosciences

Trace amine-associated receptor 1 (TAAR1) agonism as a new treatment strategy for schizophrenia and related disorders

Els F. Halff, Grazia Rutigliano, Anna Garcia-Hidalgo, Oliver D. Howes

Summary: Schizophrenia is a major health burden and new treatment approaches are needed. Targeting the trace amine (TA) system shows potential, as supported by genetic, preclinical, and clinical evidence. The trace amine-associated receptor 1 (TAAR1) is positioned to modulate key brain circuits for schizophrenia through its localization and function. Animal studies using TAAR1 agonists have shown promising results in inhibiting dopamine and serotonin activity, enhancing glutamatergic function, and improving symptoms and cognitive measures. Clinical trials of TAAR1 agonists may address unmet needs in the treatment of schizophrenia, including psychotic and negative symptoms and tolerability issues.

TRENDS IN NEUROSCIENCES (2023)

Editorial Material Psychiatry

The drug treatment deadlock in psychiatry and the route forward

Oliver D. Howes, Luke Baxter

WORLD PSYCHIATRY (2023)

Article Clinical Neurology

Longitudinal decline in striatal dopamine transporter binding in Parkinson's disease: associations with apathy and anhedonia

Harry Costello, Yumeya Yamamori, Suzanne Reeves, Anette-Eleonore Schrag, Robert Howard, Jonathan P. Roiser

Summary: This study found that dopaminergic dysfunction in the midbrain is associated with motivational symptoms such as apathy and anhedonia in Parkinson's disease (PD), and this association becomes evident as the disease progresses. These findings can inform intervention strategies for improving the treatment of PD patients.

JOURNAL OF NEUROLOGY NEUROSURGERY AND PSYCHIATRY (2023)

Article Computer Science, Artificial Intelligence

Reward Maximization Through Discrete Active Inference

Lancelot Da Costa, Noor Sajid, Thomas Parr, Karl Friston, Ryan Smith

Summary: Active inference is a probabilistic framework based on the principle of minimizing free energy, used for modeling the behavior of biological and artificial agents. It has been successfully applied to various situations involving reward maximization, often yielding comparable or superior results to alternative approaches. This article explores the connection between reward maximization and active inference and demonstrates the conditions under which active inference produces the optimal solution to the Bellman equation, a fundamental equation in reinforcement learning and control. Additionally, it introduces a new recursive active inference scheme that can produce Bellman optimal actions on any finite temporal horizon.

NEURAL COMPUTATION (2023)

Letter Neurosciences

Scientific communication and the semantics of sentience

Brett J. Kagan, Adeel Razi, Anjali Bhat, Andy C. Kitchen, Nhi T. Tran, Forough Habibollahi, Moein Khajehnejad, Bradyn J. Parker, Ben Rollo, Karl J. Friston

NEURON (2023)

Article Neurosciences

Canalization and plasticity in psychopathology

R. L. Carhart-Harris, S. Chandaria, D. E. Erritzoe, A. Gazzaley, M. Girn, H. Kettner, P. A. M. Mediano, D. J. Nutt, F. E. Rosa, L. Roseman, C. Timmermann, B. Weiss, R. J. Zeifman, K. J. Friston

Summary: This theoretical article proposes a new model of a general factor of psychopathology, using the concept of 'canalization'. It distinguishes between two types of plasticity: 'TEMP' and 'canalization', which can be differentiated by their relationship to precision or inverse variance. The authors argue that 'pathological' phenotypes develop through mechanisms of canalization and increased model precision, as a response to adversity and distress. They suggest that TEMP, along with psychological support, can counter canalization and offer experiments and measures to test their hypotheses.

NEUROPHARMACOLOGY (2023)

Article Psychiatry

Clozapine Optimization: A Delphi Consensus Guideline From the Treatment Response and Resistance in Psychosis Working Group

Elias Wagner, Dan Siskind, Peter Falkai, Oliver Howes, Christoph Correll, Jimmy Lee, William G. Honer, John M. Kane, Emilio Fernandez-Egea, Thomas R. E. Barnes, Alkomiet Hasan

Summary: This study conducted an online Delphi survey to develop consensus recommendations for the optimization of clozapine monotherapy. The recommendations include specific treatment options for certain symptoms and management of side effects. The study results provide guidance for clinical decision-making and future research in treatment-resistant schizophrenia.

SCHIZOPHRENIA BULLETIN (2023)

Review Immunology

Sickness behaviour and depression: An updated model of peripheral-central immunity interactions

Federico E. Turkheimer, Mattia Veronese, Valeria Mondelli, Diana Cash, Carmine M. Pariante

Summary: Current research suggests that immune mediators related to chronic somatic disorders have significant effects on brain function in mood disorders. Anti-inflammatory therapies are being explored as adjunctive treatments to standard antidepressants to improve efficacy, especially in non-responsive patients. Biomarkers are needed to personalize these therapies for optimal outcomes, along with a better understanding of the interaction between peripheral immunity and brain function. This proposal presents a modified model of periphery-brain interactions, suggesting that brain barriers play a crucial role in the pathophysiology and treatment resistance of mood disorders, particularly in patients with mild peripheral inflammation.

BRAIN BEHAVIOR AND IMMUNITY (2023)

Article Neurosciences

Attentional effects on local V1 microcircuits explain selective V1-V4 communication

Christini Katsanevaki, Andre M. Bastos, Hayriye Cagnan, Conrado A. Bosman, Karl J. Friston, Pascal Fries

Summary: Selective attention enhances the influence of specific synaptic inputs on higher-area neurons, enabling preferential routing of attended stimuli. Presynaptic circuits, influenced by top-down attentional signals, play a crucial role in selective routing by selectively entraining postsynaptic neurons. The study demonstrates that attentional modulation of intrinsic connections in the visual cortex mediates selective entrainment, providing an explanation for the observed phenomenon.

NEUROIMAGE (2023)

暂无数据