4.8 Article

The value of what's to come: Neural mechanisms coupling prediction error and the utility of anticipation

Journal

SCIENCE ADVANCES
Volume 6, Issue 25, Pages -

Publisher

AMER ASSOC ADVANCEMENT SCIENCE
DOI: 10.1126/sciadv.aba3828

Keywords

-

Funding

  1. Max Planck Society
  2. Gatsby Foundation
  3. Wellcome Trust Investigator Award
  4. Japan Society for the Promotion of Science
  5. Swartz Foundation
  6. Jacobs Foundation [2017-1261-04]
  7. Medical Research Foundation
  8. Wellcome Sir Henry Dale Fellowship [211155/Z/18/Z]
  9. Alexander von Humboldt Foundation
  10. 2018 NARSAD Young Investigator grant from the Brain and Behavior Research Foundation [27023]
  11. Wellcome Trust [211155/Z/18/Z] Funding Source: Wellcome Trust

Ask authors/readers for more resources

Having something to look forward to is a keystone of well-being. Anticipation of future reward, such as an upcoming vacation, can often be more gratifying than the experience itself. Theories suggest the utility of anticipation underpins various behaviors, ranging from beneficial information-seeking to harmful addiction. However, how neural systems compute anticipatory utility remains unclear. We analyzed the brain activity of human participants as they performed a task involving choosing whether to receive information predictive of future pleasant outcomes. Using a computational model, we show three brain regions orchestrate anticipatory utility. Specifically, ventromedial prefrontal cortex tracks the value of anticipatory utility, dopaminergic midbrain correlates with information that enhances anticipation, while sustained hippocampal activity mediates a functional coupling between these regions. Our findings suggest a previously unidentified neural underpinning for anticipation's influence over decision-making and unify a range of phenomena associated with risk and time-delay preference.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Psychology, Developmental

Stratification of adolescents across mental phenomena emphasizes the importance of transdiagnostic distress: a replication in two general population cohorts

Jan Stochl, Hannah Jones, Emma Soneson, Adam P. Wagner, Golam M. Khandaker, Stanley Zammit, Jon Heron, Gemma Hammerton, Edward T. Bullmore, Ray Dolan, Peter Fonagy, Ian M. Goodyer, J. Perez, Peter B. Jones

Summary: Characterizing patterns of mental phenomena in epidemiological studies of adolescents can provide insight into the latent organization of psychiatric disorders. This avoids the biases of chronicity and selection inherent in clinical samples, guides models of shared aetiology within psychiatric disorders and informs the development and implementation of interventions.

EUROPEAN CHILD & ADOLESCENT PSYCHIATRY (2023)

Article Psychology, Clinical

Disrupted state transition learning as a computational marker of compulsivity

Paul B. Sharp, Raymond J. Dolan, Eran Eldar

Summary: This study suggests that disorders involving compulsivity, fear, and anxiety are linked to impairments in learning the probabilistic mapping between actions and environmental states. Individuals with higher levels of compulsivity are more likely to demonstrate impairments in state transition learning. The dysregulated state transition learning, characterized by either too fast or too slow learning rates, may provide a target for therapeutic intervention in compulsivity.

PSYCHOLOGICAL MEDICINE (2023)

Article Behavioral Sciences

Exploration heuristics decrease during youth

Magda Dubois, Aislinn Bowler, Madeleine E. Moses-Payne, Johanna Habicht, Rani Moran, Nikolaus Steinbeis, Tobias U. Hauser

Summary: This study investigates changes in exploration mechanisms in different age groups and finds that younger individuals tend to use a computationally light exploration heuristic, which is also associated with attention-deficit/hyperactivity disorder symptoms.

COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE (2022)

Article Psychiatry

Low self-esteem and the formation of global self-performance estimates in emerging adulthood

Marion Rouault, Geert-Jan Will, Stephen M. Fleming, Raymond J. Dolan

Summary: This study investigated the differences in constructing beliefs about self-performance in a non-social context between individuals with low and high self-esteem. The findings revealed that individuals with low self-esteem consistently underestimated their performance, while those with high self-esteem did not show significant differences. These results contribute to our understanding of the influence of self-esteem on cognitive processes.

TRANSLATIONAL PSYCHIATRY (2022)

Article Psychology, Developmental

Computational and behavioral markers of model-based decision making in childhood

Claire R. Smid, Wouter Kool, Tobias U. Hauser, Nikolaus Steinbeis

DEVELOPMENTAL SCIENCE (2023)

Review Neurosciences

Spatiotemporal Precision of Neuroimaging in Psychiatry

Jessica McFadyen, Raymond J. Dolan

Summary: Aberrant patterns of cognition, perception, and behavior in psychiatric disorders are believed to result from complex neural processes evolving at a fast temporal scale. However, current neuroimaging technologies face limitations in balancing spatial and temporal resolutions, hindering the understanding of these dynamic processes in humans. Recent advancements in high temporal resolution imaging, particularly magnetoencephalography, combined with sophisticated machine learning decoding techniques, offer novel insights into the spatiotemporal dynamics of cognitive phenomena relevant to psychiatric illnesses. This review considers the recent developments and applications that aim to drive a mechanistic understanding of psychopathology and aid in preclinical translation.

BIOLOGICAL PSYCHIATRY (2023)

Review Neurosciences

Replay and compositional computation

Zeb Kurth-Nelson, Timothy Behrens, Greg Wayne, Kevin Miller, Lennart Luettgau, Ray Dolan, Yunzhe Liu, Philipp Schwartenbeck

Summary: Replay in the brain can implement compositional computation, assembling entities into relationally bound structures to derive new knowledge. Recent neuroscience advances show that the hippocampus flexibly binds objects to generalizable roles, and replay strings these role-bound objects into compound statements. We propose experiments to test this hypothesis and highlight the implications for AI systems lacking the human ability to generalize past experience.

NEURON (2023)

Article Multidisciplinary Sciences

Distinct replay signatures for prospective decision-making and memory preservation

Elliott Wimmer, Yunzhe Liu, Daniel C. McNamee, Raymond J. Dolan

Summary: Theories of neural replay propose that it supports various functions, mainly planning and memory consolidation. This study tests the hypothesis that different signatures of replay in the same task are related to model-based decision-making and memory preservation. Using magnetoencephalography and multivariate analysis, the researchers identify temporally compressed sequential reactivation, or replay, before choice and following reward feedback. The results support key theoretical proposals regarding the functional role of replay and demonstrate the modulation of planning and memory-related signals by ongoing computational and task demands.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2023)

Article Neurosciences

Differential replay of reward and punishment paths predicts approach and avoidance

Jessica McFadyen, Yunzhe Liu, Raymond J. Dolan

Summary: Neural replay is involved in planning, with rapid reactivation of states relevant to a task goal. This study using MEG found forward sequential replay during planning, with rapid state-to-state transitions. Replay of rewarding paths was enhanced before avoiding, while attenuated before approaching. Trial-by-trial bias towards replaying potential punishing paths predicted irrational decision-making, especially in participants with higher trait anxiety. These findings highlight the coupling of replay with planned behavior and the prioritization of worst-case scenarios for approaching or avoiding.

NATURE NEUROSCIENCE (2023)

Article Neurosciences

Theory-Driven Analysis of Natural Language Processing Measures of Thought Disorder Using Generative Language Modeling

Isaac Fradkin, Matthew M. Nour, Raymond J. Dolan

Summary: This study used deep generative language models to simulate FTD-like narratives and analyzed common NLP metrics to reveal factors related to language disorganization and their relationships. The results showed that increasing word selection stochasticity or limiting model's memory span led to increased semantic distance. Limiting memory span also increased semantic distance between words. Additionally, the measure of tangentiality was uniquely predicted by limited memory span.

BIOLOGICAL PSYCHIATRY-COGNITIVE NEUROSCIENCE AND NEUROIMAGING (2023)

Article Clinical Neurology

Reduced coupling between offline neural replay events and default mode network activation in schizophrenia

Matthew M. Nour, Yunzhe Liu, Cameron Higgins, Mark W. Woolrich, Raymond J. Dolan

Summary: Schizophrenia patients show reduced coupling between task-relevant neural replay and default mode network (DMN) activation during rest, which is important for memory consolidation. This finding sheds light on the functional significance of default mode network abnormalities in schizophrenia.

BRAIN COMMUNICATIONS (2023)

Article Biochemistry & Molecular Biology

Generative replay underlies compositional inference in the hippocampal-prefrontal circuit

Philipp Schwartenbeck, Alon Baram, Yunzhe Liu, Shirley Mark, Timothy Muller, Raymond Dolan, Matthew Botvinick, Zeb Kurth-Nelson, Timothy Behrens

Summary: This study investigates how compositional computation is implemented in the human brain. The findings show that the representations of constructed objects in the frontal cortex and hippocampus are relational and compositional. Additionally, the replay process assembles elements into compounds, gradually shifting from predictable to uncertain elements, and converging on the correct configuration. These results suggest that the hippocampal-prefrontal circuitry plays a crucial role in compositional inference and hypothesis testing.
Article Neurosciences

Boosting Serotonin Increases Information Gathering by Reducing Subjective Cognitive Costs

Jochen Michely, Ingrid M. Martin, Raymond J. Dolan, Tobias U. Hauser

Summary: A study shows that serotonin enhances the willingness to gather information by reducing sensitivity to cognitive effort, which suggests its potential impact on motivational deficits in psychiatric disorders.

JOURNAL OF NEUROSCIENCE (2023)

Editorial Material Psychiatry

How computational psychiatry can advance the understanding and treatment of obsessive-compulsive disorder

Isaac Fradkin, Helen Blair Simpson, Raymond J. Dolan, Jonathan D. Huppert

WORLD PSYCHIATRY (2023)

Article Multidisciplinary Sciences

A longitudinal resource for population neuroscience of school-age children and adolescents in China

Xue-Ru Fan, Yin-Shan Wang, Da Chang, Ning Yang, Meng-Jie Rong, Zhe Zhang, Ye He, Xiaohui Hou, Quan Zhou, Zhu-Qing Gong, Li-Zhi Cao, Hao-Ming Dong, Jing-Jing Nie, Li-Zhen Chen, Qing Zhang, Jia-Xin Zhang, Lei Zhang, Hui-Jie Li, Min Bao, Antao Chen, Jing Chen, Xu Chen, Jinfeng Ding, Xue Dong, Yi Du, Chen Feng, Tingyong Feng, Xiaolan Fu, Li-Kun Ge, Bao Hong, Xiaomeng Hu, Wenjun Huang, Chao Jiang, Li Li, Qi Li, Su Li, Xun Liu, Fan Mo, Jiang Qiu, Xue-Quan Su, Gao-Xia Wei, Yiyang Wu, Haishuo Xia, Chao-Gan Yan, Zhi-Xiong Yan, Xiaohong Yang, Wenfang Zhang, Ke Zhao, Liqi Zhu, Xi-Nian Zuo, Xing-Ting Zhu, Xiao-Hui Hou, Ping Wang, Yi-Wen Zhang, Dan-Yang Sui, Ting Xu, Lili Jiang, Yuan Zhou, Yan Zhuo, Zhentao Zuo, Li Ke, Fei Wang, F. Xavier Castellanos, Michael Peter Milham, Yu-Feng Zang, Chris Adamson, Sophie Adler, Aaron F. Alexander-Bloch, Evdokia Anagnostou, Kevin M. Anderson, Ariosky Areces-Gonzalez, Duncan E. Astle, Bonnie Auyeung, Muhammad Ayub, Gareth Ball, Simon Baron-Cohen, Richard Beare, Saashi A. Bedford, Vivek Benegal, Richard A. I. Bethlehem, Frauke Beyer, Jong Bin Bae, John Blangero, Manuel Blesa Cabez, James P. Boardman, Matthew Borzage, Jorge F. Bosch-Bayard, Niall Bourke, Edward T. Bullmore, Vince D. Calhoun, Mallar M. Chakravarty, Christina Chen, Casey Chertavian, Gael Chetelat, Yap S. Chong, Aiden Corvin, Manuela Costantino, Eric Courchesne, Fabrice Crivello, Vanessa L. Cropley, Jennifer Crosbie, Nicolas Crossley, Marion Delarue, Richard Delorme, Sylvane Desrivieres, Gabriel Devenyi, Maria A. Di Biase, Ray Dolan, Kirsten A. Donald, Gary Donohoe, Katharine Dunlop, Anthony D. Edwards, Jed T. Elison, Cameron T. Ellis, Jeremy A. Elman, Lisa Eyler, Damien A. Fair, Paul C. Fletcher, Peter Fonagy, Carol E. Franz, Lidice Galan-Garcia, Ali Gholipour, Jay Giedd, John H. Gilmore, David C. Glahn, Ian M. Goodyer, P. E. Grant, Nynke A. Groenewold, Faith M. Gunning, Raquel E. Gur, Ruben C. Gur, Christopher F. Hammill, Oskar Hansson, Trey Hedden, Andreas Heinz, Richard N. Henson, Katja Heuer, Jacqueline Hoare, Bharath Holla, Avram J. Holmes, Hao Huang, Kiho Im, Jonathan Ipser, Clifford R. Jack, Andrea P. Jackowski, Tianye Jia, David T. Jones, Peter B. Jones, Rene S. Kahn, Hasse Karlsson, Linnea Karlsson, Ryuta Kawashima, Elizabeth A. Kelley, Silke Kern, Ki-Woong Kim, Manfred G. Kitzbichler, William S. Kremen, Francois Lalonde, Brigitte Landeau, Jason Lerch, John D. Lewis, Jiao Li, Wei Liao, Deirel Paz-Linares, Conor Liston, Michael V. Lombardo, Jinglei Lv, Travis T. Mallard, Samuel R. Mathias, Machteld Marcelis, Bernard Mazoyer, Philip McGuire, Michael J. Meaney, Andrea Mechelli, Bratislav Misic, Sarah E. Morgan, David Mothersill, Cynthia Ortinau, Rik Ossenkoppele, Minhui Ouyang, Lena Palaniyappan, Leo Paly, Pedro M. Pan, Christos Pantelis, Min Tae M. Park, Tomas Paus, Zdenka Pausova, Alexa Pichet Binette, Karen Pierce, Xing Qian, Anqi Qiu, Armin Raznahan, Timothy Rittman, Amanda Rodrigue, Caitlin K. Rollins, Rafael Romero-Garcia, Lisa Ronan, Monica D. Rosenberg, David H. Rowitch, Giovanni A. Salum, Theodore D. Satterthwaite, H. Lina Schaare, Russell J. Schachar, Michael Scholl, Aaron P. Schultz, Jakob Seidlitz, David Sharp, Russell T. Shinohara, Ingmar Skoog, Christopher D. Smyser, Reisa A. Sperling, Dan J. Stein, Aleks Stolicyn, John Suckling, Gemma Sullivan, Benjamin Thyreau, Roberto Toro, Nicolas Traut, Kamen A. Tsvetanov, Nicholas B. Turk-Browne, Jetro J. Tuulari, Christophe Tzourio, Etienne Vachon-Presseau, Mitchell J. Valdes-Sosa, Pedro A. Valdes-Sosa, Sofie L. Valk, Therese van Amelsvoort, Simon N. Vandekar, Lana Vasung, Petra E. Vertes, Lindsay W. Victoria, Sylvia Villeneuve, Arno Villringer, Jacob W. Vogel, Konrad Wagstyl, Simon K. Warfield, Varun Warrier, Eric Westman, Margaret L. Westwater, Heather C. Whalley, Simon R. White, A. Veronica Witte, B. T. Thomas Yeo, Hyuk Jin Yun, Andrew Zalesky, Heather J. Zar, Anna Zettergren, Juan H. Zhou, Hisham Ziauddeen, Andre Zugman

Summary: In the past decade, cognitive neuroscience has emphasized the importance of population diversity in order to address the challenges of validity and generalizability, leading to the emergence of population neuroscience. The devCCNP project, which focuses on brain-mind development, aims to create and share a large-scale, longitudinal, and multimodal dataset of typically developing children and adolescents in the Chinese population. The dataset includes a variety of assessments and measurements, such as demographic, biophysical, psychological, behavioral, cognitive, affective, and ocular-tracking assessments, as well as neuroimaging data obtained through magnetic resonance imaging (MRI). This Data Descriptor introduces the first data release of devCCNP, providing details on the experimental design, sampling strategies, and technical validation of the resource. The potential of a multicohort longitudinal design to depict normative brain growth curves from the perspective of developmental population neuroscience is demonstrated and discussed.

SCIENTIFIC DATA (2023)

No Data Available