Review
Neurosciences
Bruno Averbeck, John P. O'Doherty
Summary: This article reviews the current state of knowledge on the computational and neural mechanisms of reinforcement learning, with a focus on fronto-striatal circuits. Five broad research themes are identified, including learning targets, algorithms driving learning and inference, value conversion into choices and actions, state representations, and brain control over reinforcement learning subsystems. The authors argue that bridging algorithmic level descriptions to implementation level models is essential to better understand how reinforcement learning emerges from multiple distributed neural networks in the brain.
NEUROPSYCHOPHARMACOLOGY
(2022)
Article
Neurosciences
Karly M. Turner, Anna Svegborn, Mia Langguth, Colin McKenzie, Trevor W. Robbins
Summary: This study reveals a functional opposition between the dorsomedial and dorsolateral striatum during skill and habit formation. Loss of function in the dorsomedial striatum accelerates sequence acquisition, while loss of function in the dorsolateral striatum impedes it. The mPFC is not involved, but the lateral orbitofrontal cortex plays a critical role.
JOURNAL OF NEUROSCIENCE
(2022)
Article
Behavioral Sciences
Damien Brevers, Chris Baeken, Stefanie De Smet, Beatriz Catoira, Sara De Witte, Qinghua He, Pierre Maurage, Laimi Schulze-Steinen, Guillaume Sescousse, Claudia Vila Verde, Claus Vogele, Joel Billieux
Summary: Brain imaging studies have found that stimulation of the left dorsolateral prefrontal cortex (dlPFC) can modulate brain reactivity to reward-related cues. However, the impact of contextual factors on this modulation effect remains unclear. In this study, researchers tested the effects of high-frequency repetitive transcranial magnetic stimulation (HF-rTMS) on brain reactivity to cues signaling reward availability or unavailability. The results showed that HF-rTMS modulated brain activity in response to game cues, with increases in posterior insula and caudate nucleus activation and a decrease in occipital pole activation. HF-rTMS also increased ventral striatal activity for cues available for betting but had no effect on cues unavailable for betting.
Article
Clinical Neurology
David M. Niddam, Shih-Wei Wu, Kuan-Lin Lai, Yun-Yen Yang, Yen-Fang Wang, Shuu-Jiun Wang
Summary: This study examines the similarities between medication overuse headache and substance use disorders, finding that patients with medication overuse headache exhibit altered decision-making behavior and reward processing. Compared to healthy controls, these patients show greater temporal discounting and weaker subjective value representations in the dorsomedial and ventromedial prefrontal cortices when accepting delayed rewards, as well as in the ventral striatum when accepting immediate rewards. Additionally, resting-state functional connectivity is reduced among the valuation regions in patients with medication overuse headache.
Article
Behavioral Sciences
Ramon Bartolo, Bruno Averbeck
Summary: Organisms have evolved to take advantage of environmental regularities, allowing them to acquire a model of the world and make decisions and adjust behavior efficiently under uncertainty. Recent research has focused on various aspects of model-based inference and its neural underpinnings.
CURRENT OPINION IN BEHAVIORAL SCIENCES
(2021)
Article
Multidisciplinary Sciences
Alice Newton-Fenner, Danielle Hewitt, Jessica Henderson, Hannah Roberts, Tyler Mari, Yiquan Gu, Olga Gorelkina, Timo Giesbrecht, Nicolas Fallon, Carl Roberts, Andrej Stancak
Summary: Forming and comparing subjective values (SVs) of choice options is a critical stage of decision-making. This study utilized the Becker-DeGroot-Marschak (BDM) auction to identify the core brain valuation system involved in processing SV. The results showed that willingness-to-pay (WTP) was positively correlated with BOLD activations in several brain regions.
Review
Clinical Neurology
Despina Messimeris, Richard Levy, Raphael Le Bouc
Summary: Damage to the vmPFC is associated with personality changes and impairments in decision-making. The vmPFC may play a unified role in guiding decisions in both social and non-social domains, but the exact mechanism is unclear. Assessing the effects of vmPFC damage in patients can help determine its causal role in shaping economic and social behavior.
FRONTIERS IN NEUROLOGY
(2023)
Review
Multidisciplinary Sciences
S. Jauhar, L. Fortea, A. Solanes, A. Albajes-Eizagirre, P. J. McKenna, J. Radua
Summary: This meta-analysis focused on fMRI studies using monetary reward with a definable cue-reward contingency. The results showed that both reward anticipation and delivery activated the ventral striatum, with different patterns of cortical activation.
Article
Neurosciences
Edmund T. Rolls, Gustavo Deco, Chu-Chung Huang, Jianfeng Feng
Summary: The human orbitofrontal cortex, vmPFC, and anterior cingulate cortex play a crucial role in reward processing, emotion, and episodic memory. Effective connectivity between cortical regions and subcortical regions was measured in the human brain, revealing the complex network involved in these processes. This research enhances our understanding of the functional and neural connections in the brain.
Article
Neurosciences
Jesus Pujol, Laura Blanco-Hinojo, Gerard Martinez-Vilavella, Joan Deus, Victor Perez-Sola, Jordi Sunyer
Summary: The study found that childhood obesity may be associated with functional alterations in the brain's reward system, leading to behavioral control disorders. Obese children showed weaker connectivity in the reward system and structural changes similar to those seen in obsessive-compulsive disorder and Prader-Willi syndrome.
Article
Psychiatry
Tim Van Timmeren, Ruth J. Van Holst, Anna E. Goudriaan
Summary: This study compared the activation of the striatum during reward anticipation between patients with alcohol use disorder (AUD) and gambling disorder (GD) using functional MRI. The results showed hypoactivation of the reward system in AUD patients compared to healthy controls. However, the study did not support the hypothesis that addiction-related cues explain striatal dysfunction.
JOURNAL OF BEHAVIORAL ADDICTIONS
(2023)
Article
Neurosciences
Yarden Cohen, Elad Schneidman, Rony Paz
Summary: The study found that neurons in the cingulate cortex mainly rotated towards the rule, while neurons in the putamen showed an increase in magnitude, indicating strengthening of confidence for the newly acquired rule-based policy. Additionally, neural representation at the end of a session predicted next-day behavior, reflecting overnight retention. The novel framework for characterization of neural dynamics suggests complementary roles for the putamen and the anterior cingulate cortex.
Article
Neurosciences
Ziv Ben-Zion, Ofir Shany, Roee Admon, Nimrod Jackob Keynan, Netanell Avisdris, Shira Reznik Balter, Arieh Y. Shalev, Israel Liberzon, Talma Hendler
Summary: This study found that PTSD severity following trauma is associated with neural functioning and risky behavior. Specifically, biased neural responsivity to positive as compared to negative motivational outcomes plays a crucial role in the development of PTSD.
BIOLOGICAL PSYCHIATRY-COGNITIVE NEUROSCIENCE AND NEUROIMAGING
(2022)
Article
Neurosciences
Justin M. Fine, David J. -N. Maisson, Seng Bum Michael Yoo, Tyler V. Cash-Padgett, Maya Zhe Wang, Jan Zimmermann, Benjamin Y. Hayden
Summary: An important question in neuroeconomics is how the brain represents the value of offers in a way that allows for comparison while preserving the details that influence value. This study examined neuronal responses in male macaques and found that there was no overlap in neural coding between risky and safe options, even when the options had identical subjective values. However, these regions were linked through a linear transform of their encodings, allowing for comparison of different types of options.
JOURNAL OF NEUROSCIENCE
(2023)
Article
Neurosciences
Masaya Harada, Vincent Pascoli, Agnes Hiver, Jerome Flakowski, Christian Luescher
Summary: The study reveals that compulsive individuals exhibit stronger neuronal activity in the DS during the cue predicting reward availability, even at the risk of punishment. An increased AMPA/NMDA ratio was observed selectively at orbitofrontal cortex to DS synapses, and spiny projection neurons in the DS showed an activity peak at the moment of signaled reward availability.
BIOLOGICAL PSYCHIATRY
(2021)
Article
Neurosciences
Sanne J. H. van Rooij, Mitzy Kennis, Matthijs Vink, Elbert Geuze
NEUROPSYCHOPHARMACOLOGY
(2016)
Article
Psychiatry
Matthijs Vink, Max de Leeuw, Jurjen J. Luykx, Kristel R. van Eijk, Hanna E. van den Munkhof, Mariet van Buuren, Rene S. Kahn
SCHIZOPHRENIA BULLETIN
(2016)
Review
Neurosciences
C. S. Hakkers, J. E. Arends, R. E. Barth, S. Du Plessis, A. I. M. Hoepelman, M. Vink
JOURNAL OF NEUROVIROLOGY
(2017)
Article
Neurosciences
Iris Kleerekooper, Sanne J. H. van Rooij, Wery P. M. van den Wildenberg, Max de Leeuw, Rene S. Kahn, Matthijs Vink
Article
Neurosciences
Max de Leeuw, Marc M. Bohlken, Rene C. W. Mandl, Manon H. J. Hillegers, Rene S. Kahn, Matthijs Vink
NEUROPSYCHOPHARMACOLOGY
(2017)
Article
Psychiatry
Matthijs Vink, Max de Leeuw, Ruby Pouwels, Hanna E. van den Munkhof, Rene S. Kahn, Manon Hillegers
SCHIZOPHRENIA RESEARCH
(2016)
Review
Behavioral Sciences
Jurjen J. Luykx, Juliette L. Broersen, Max de Leeuw
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
(2017)
Article
Psychiatry
Laila Asmal, Stefan du Plessis, Matthijs Vink, Jean-Paul Fouche, Bonginkosi Chiliza, Robin Emsley
SCHIZOPHRENIA RESEARCH
(2017)
Article
Endocrinology & Metabolism
S. E. E. C. Bauduin, M. S. van Noorden, S. J. A. van der Werff, M. de Leeuw, A. M. van Hemert, N. J. A. van der Wee, E. J. Giltay
PSYCHONEUROENDOCRINOLOGY
(2018)
Article
Neurosciences
Pascal Pas, Stefan Du Plessis, Hanna E. van den Munkhof, Thomas E. Gladwin, Matthijs Vink
EUROPEAN JOURNAL OF NEUROSCIENCE
(2019)
Article
Clinical Neurology
R. Mesbah, M. A. Koenders, A. T. Spijker, M. de Leeuw, L. Boschloo, B. W. J. H. Penninx, A. M. van Hemert, E. J. Giltay
JOURNAL OF AFFECTIVE DISORDERS
(2019)
Article
Psychiatry
S. E. E. C. Bauduin, E. J. Giltay, M. S. van Noorden, S. J. A. van der Werff, M. de Leeuw, A. M. van Hemert, N. J. A. van der Wee
Summary: The study suggests that the link between increased salivary cortisol and social withdrawal in depression may be mediated by social withdrawal. Basal and diurnal salivary alpha-amylase were found to be unrelated to social withdrawal and depression, but HPA-axis activation may exacerbate social withdrawal in depressive disorders.
JOURNAL OF PSYCHIATRIC RESEARCH
(2021)
Article
Psychology, Clinical
Rahele Mesbah, Nienke de Bles, Nathaly Rius-Ottenheim, A. J. Willem van der Does, Brenda W. J. H. Penninx, Albert M. van Hemert, Max de Leeuw, Erik J. Giltay, Manja Koenders
Summary: Feelings of anger and irritability are prominent symptoms of bipolar disorder (BD), and individuals with a history of unipolar depression who convert to BD tend to exhibit higher levels of trait anger, aggression reactivity, and anger-related constructs compared to those who do not convert.
DEPRESSION AND ANXIETY
(2021)
Review
Psychiatry
Rahele Mesbah, Manja A. Koenders, Nic J. A. van der Wee, Erik J. Giltay, Albert M. van Hemert, Max de Leeuw
Summary: This systematic review and meta-analysis revealed evidence for activity disturbances in key brain areas involved in cognitive and emotion processing in individuals with bipolar disorder (BD). Most of the regions are part of the fronto-limbic network. The results suggest that aberrations in the fronto-limbic network, present in both euthymic and symptomatic individuals, may be underlying cognitive and emotional dysfunctions in BD.