4.5 Review

From biophysics to cognition: reward-dependent adaptive choice behavior

Journal

CURRENT OPINION IN NEUROBIOLOGY
Volume 18, Issue 2, Pages 209-216

Publisher

CURRENT BIOLOGY LTD
DOI: 10.1016/j.conb.2008.07.003

Keywords

-

Categories

Funding

  1. NIH [MH073246]
  2. NATIONAL INSTITUTE OF MENTAL HEALTH [R01MH073246] Funding Source: NIH RePORTER

Ask authors/readers for more resources

In neurobiological studies of various cognitive abilities, neuroscientists use mathematical models to fit behavioral data from well-controlled experiments and look for neural activities that are correlated with parameters in those models. The pinpointed neural correlates are often taken as evidence that a given task is performed according to the prescription of the applied model, and the relevant brain areas encode parameters of such a model. However, to go beyond correlations toward causal understanding, it is necessary to elucidate at multiple levels the neural circuit mechanisms of cognitive processes. This review focuses on recent studies of reward-based decision-making that have begun to tackle this challenge.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Neurosciences

Salience-Driven Value Construction for Adaptive Choice under Risk

Mehran Spitmaan, Emily Chu, Alireza Soltani

JOURNAL OF NEUROSCIENCE (2019)

Review Neurosciences

Adaptive learning under expected and unexpected uncertainty

Alireza Soltani, Alicia Izquierdo

NATURE REVIEWS NEUROSCIENCE (2019)

Article Psychology, Biological

Flexible combination of reward information across primates

Shiva Farashahi, Christopher H. Donahue, Benjamin Y. Hayden, Daeyeol Lee, Alireza Soltani

NATURE HUMAN BEHAVIOUR (2019)

Article Multidisciplinary Sciences

Contributions of anterior cingulate cortex and basolateral amygdala to decision confidence and learning under uncertainty

A. Stolyarova, M. Rakhshan, E. E. Hart, T. J. O'Dell, M. A. K. Peters, H. Lau, A. Soltani, A. Izquierdo

NATURE COMMUNICATIONS (2019)

Article Biochemical Research Methods

Combinations of low-level and high-level neural processes account for distinct patterns of context-dependent choice

Mehran Spitmaan, Oihane Horno, Emily Chu, Alireza Soltani

PLOS COMPUTATIONAL BIOLOGY (2019)

Article Neurosciences

Influence of Expected Reward on Temporal Order Judgment

Mohsen Rakhshan, Vivian Lee, Emily Chu, Lauren Harris, Lillian Laiks, Peyman Khorsand, Alireza Soltani

JOURNAL OF COGNITIVE NEUROSCIENCE (2020)

Article Multidisciplinary Sciences

Multiple timescales of neural dynamics and integration of task-relevant signals across cortex

Mehran Spitmaan, Hyojung Seo, Daeyeol Lee, Alireza Soltani

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2020)

Article Neurosciences

Separable Influences of Reward on Visual Processing and Choice

Alireza Soltani, Mohsen Rakhshan, Robert J. Schafer, Brittany E. Burrows, Tirin Moore

Summary: In a novel paradigm, researchers measured the effects of reward outcomes and expected reward on target selection and sensitivity to visual motion in primates. They found that while reward influenced both choice and sensitivity to visual motion, there were differences in how it affected these processes.

JOURNAL OF COGNITIVE NEUROSCIENCE (2021)

Article Behavioral Sciences

Unique Features of Stimulus-Based Probabilistic Reversal Learning

Carl Harris, Claudia Aguirre, Saisriya Kolli, Kanak Das, Alicia Izquierdo, Alireza Soltani

Summary: The study revealed differences between male and female rats in a visual probabilistic discrimination and reversal learning paradigm, including differences in latency to choose the better option and win-stay strategies. Additionally, the study found an impact of reward probability on behavioral performance.

BEHAVIORAL NEUROSCIENCE (2021)

Review Neurosciences

Computational models of adaptive behavior and prefrontal cortex

Alireza Soltani, Etienne Koechlin

Summary: This article highlights the importance of the prefrontal cortex in enabling adaptive behavior in the face of uncertainty and constant change in the real world. Adaptive behavior relies on specific interactions between multiple systems, including selective models, predictive models, and contextual models. The PFC combines internal models to drive behavior and constantly evaluates their reliability in predicting external contingencies to adjust or create new task sets.

NEUROPSYCHOPHARMACOLOGY (2022)

Article Multidisciplinary Sciences

Computational mechanisms of distributed value representations and mixed learning strategies

Shiva Farashahi, Alireza Soltani

Summary: Real-world learning is challenging due to the association of reward with multiple features of choice options. The study demonstrates that humans can learn complex learning strategies and reveals the underlying computational and neural mechanisms.

NATURE COMMUNICATIONS (2021)

Article Multidisciplinary Sciences

Entropy-based metrics for predicting choice behavior based on local response to reward

Ethan Trepka, Mehran Spitmaan, Bilal A. Bari, Vincent D. Costa, Jeremiah Y. Cohen, Alireza Soltani

Summary: The authors proposed metrics based on information theory to predict global behavioral rules of animal choices based on reward feedback. These metrics explained 50% and 41% of variance in matching behavior in mice and monkeys, respectively, and were used to develop more accurate models of choice. Overall, the entropy-based metrics provide a model-free tool to predict adaptive choice behavior and reveal underlying neural mechanisms.

NATURE COMMUNICATIONS (2021)

Article Behavioral Sciences

Timescales of cognition in the brain

Alireza Soltani, John D. Murray, Hyojung Seo, Daeyeol Lee

Summary: The human brain has evolved to integrate various types of information on multiple timescales. Recent research has shown that the integration of sensory and reward signals is influenced by the temporal properties of the environment. Future studies need to investigate how neural computations at multiple timescales are adjusted to influence behavior flexibly.

CURRENT OPINION IN BEHAVIORAL SCIENCES (2021)

Letter Neurosciences

A response to claims of emergent intelligence and sentience in a dish

Fuat Balci, Suliann Ben Hamed, Thomas Boraud, Sebastien Bouret, Thomas Brochier., Cedric Brun., Jeremiah Y. Cohen, Etienne Coutureau, Marc Deffains, Valerie Doyere, Georgia G. Gregoriou, J. Alexander Heimel, Bjorg Elisabeth Kilavik, Daeyeol Lee, Eric C. Leuthardt, Zachary F. Mainen, Mackenzie Mathis, Ilya E. Monosov, Jeremie Naude, Amy L. Orsborn, Camillo Padoa-Schioppa, Emmanuel Procyk, Bernardo Sabatini, Jerome Sallet, Carmen Sandi, Jeffrey D. Schall, Alireza Soltani, Karel Svoboda, Charles R. E. Wilson, Jan Zimmermann

NEURON (2023)

No Data Available