4.5 Review

Components and characteristics of the dopamine reward utility signal

期刊

JOURNAL OF COMPARATIVE NEUROLOGY
卷 524, 期 8, 页码 1699-1711

出版社

WILEY
DOI: 10.1002/cne.23880

关键词

stimulus components; subjective value; temporal discounting; utility; risk; neuroeconomics

资金

  1. Wellcome Trust
  2. European Research Council (ERC)
  3. National Institutes of Health Conte Center at Caltech

向作者/读者索取更多资源

Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions. J. Comp. Neurol. 524:1699-1711, 2016. (c) 2015 Wiley Periodicals, Inc.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Editorial Material Medicine, General & Internal

MRI Mapping of Muscle Denervation in Metastatic Myelopathy

Nozomu Matsuda, Hiroyuki Minemura, Shunsuke Kobayashi, Kazuaki Kanai

INTERNAL MEDICINE (2020)

Article Neurosciences

Nonhuman Primates Satisfy Utility Maximization in Compliance with the Continuity Axiom of Expected Utility Theory

Simone Ferrari-Toniolo, Philipe M. Bujold, Fabian Grabenhorst, Raymundo Baez-Mendoza, Wolfram Schultz

Summary: Expected Utility Theory describes choices as a process of maximizing utility, where decision makers assign subjective value to each choice option and select the one with the highest utility. The continuity axiom is central to the theory, requiring decision makers to be indifferent between different gambles, which is crucial for defining numerical utilities.

JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Single-Dimensional Human Brain Signals for Two-Dimensional Economic Choice Options

Leo Chi U. Seak, Konstantin Volkmann, Alexandre Pastor-Bernier, Fabian Grabenhorst, Wolfram Schultz

Summary: The study demonstrates that reward-related brain structures in humans can integrate multiple reward components into a scalar signal, beyond the known subjective value coding of single-component rewards.

JOURNAL OF NEUROSCIENCE (2021)

Article Neurosciences

Rare rewards amplify dopamine responses

Kathryn M. Rothenhoefer, Tao Hong, Aydin Alikaya, William R. Stauffer

Summary: This study found that rare rewards amplify dopamine responses, even when conventional prediction errors are identical, indicating a mechanism for learning the complexities of real-world incentives.

NATURE NEUROSCIENCE (2021)

Article Neurosciences

Dopamine Axons in Dorsal Striatum Encode Contralateral Visual Stimuli and Choices

Morgane M. Moss, Peter Zatka-Haas, Kenneth D. Harris, Matteo Carandini, Armin Lak

Summary: Research suggests that dopamine in the striatum plays a critical role in visual decision-making, encoding visual stimuli and rewarded actions in a lateralized fashion. Contrary to previous beliefs, dopamine signals in the DMS respond to contralateral stimuli and rewarded actions, facilitating associations between specific visual stimuli and actions.

JOURNAL OF NEUROSCIENCE (2021)

Article Multidisciplinary Sciences

Reward-specific satiety affects subjective value signals in orbitofrontal cortex during multicomponent economic choice

Alexandre Pastor-Bernier, Arkadiusz Stasiak, Wolfram Schultz

Summary: This study demonstrates that satiety affects reward value coding and that Revealed Preference Theory may offer a solution to assess economic reward value. Neuronal signals in the OFC closely track subjective value changes, supporting the idea of subjective economic reward value coding in OFC neurons.

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA (2021)

Article Behavioral Sciences

Comparing utility functions between risky and riskless choice in rhesus monkeys

Philipe M. Bujold, Leo Chi U. Seak, Wolfram Schultz, Simone Ferrari-Toniolo

Summary: Decisions can be risky or riskless, depending on the outcomes of the choice. The utility functions for risky and riskless choices can be different, which should be taken into account in neuronal investigations of utility-based choice.

ANIMAL COGNITION (2022)

Article Neurosciences

Reward value revealed by auction in rhesus monkeys

Alaa Al-Mohammad, Wolfram Schultz

Summary: Economic choice involves eliciting the subjective values of the choice options. Traditional animal value estimation methods are complex and do not capture the immediacy of individual choices. This study implemented a simple auction-like mechanism called BDM in monkeys, demonstrating its feasibility for meaningful value estimation of liquid rewards.

JOURNAL OF NEUROSCIENCE (2022)

Article Clinical Neurology

Weak shoulder and arm sparing signs in amyotrophic lateral sclerosis

Yuichi Hamada, Takamichi Kanbayashi, Kazusa Takahashi, Hisao Kamiya, Shunsuke Kobayashi, Masahiro Sonoo

Summary: This study describes two new signs, weak shoulder and arm sparing signs, in amyotrophic lateral sclerosis (ALS). The weak shoulder sign is highly sensitive in ALS and specific when compared with multifocal motor neuropathy (MMN). The arm sparing sign is highly specific for ALS. These two new signs are promising as clinical clues in the diagnosis of ALS.

MUSCLE & NERVE (2022)

Article Behavioral Sciences

Smarter than humans: rationality reflected in primate neuronal reward signals

Wolfram Schultz, Wiliam R. Stauffer, Armin Lak, Alexandre Pastor-Bernier

Summary: Studies have shown that neuronal reward signals demonstrate a propensity for rational choice, with dopamine signals following transitivity and first-order stochastic dominance. Additionally, neurons in the orbitofrontal cortex exhibit unchanged preferences when a dominated option is removed, satisfying the Independence of Irrelevant Alternatives (IIA) principle.

CURRENT OPINION IN BEHAVIORAL SCIENCES (2021)

Article Medicine, Research & Experimental

Quantitative single-cell transcriptome-based ranking of engineered AAVs in human retinal explants

Zhouhuan Xi, Bilge E. Ozturk, Molly E. Johnson, Serhan Turunc, William R. Stauffer, Leah C. Byrne

Summary: This study evaluated the efficiency and tropism of 18 AAV serotypes in human retinal explants using a recently developed RNA sequencing AAV engineering pipeline. The top-performing serotypes, K91, K912, and 7m8, were further validated in non-human primate and human retinal explants. The findings provide important information for the translation of retinal gene therapies to the clinic.

MOLECULAR THERAPY-METHODS & CLINICAL DEVELOPMENT (2022)

Article Business, Finance

Risky choice: Probability weighting explains independence axiom violations in monkeys

Simone Ferrari-Toniolo, Leo Chi U. Seak, Wolfram Schultz

Summary: This study tested the Independence Axiom of Expected Utility Theory and found violations of this axiom. By analyzing the probabilities of gambles, it was discovered that Cumulative Prospect Theory provided a better explanation for choices. The monkeys' preference changes were consistent with those reported for humans.

JOURNAL OF RISK AND UNCERTAINTY (2022)

Article Cell Biology

Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

Karolina Farrell, Armin Lak, Aman B. Saleem

Summary: Midbrain dopamine neurons encode reward prediction error signals to improve goal-directed navigation.

CELL REPORTS (2022)

Article Neurosciences

Computational complexity drives sustained deliberation

Tao Hong, William R. Stauffer

Summary: This study investigates the decision-making process in nonhuman primates by observing their behavior in a combinatorial optimization task. The findings suggest that the animals employ different algorithms based on the complexity of the problem, and the deliberation time is correlated with the computational complexity. These results provide evidence for algorithm-based reasoning and establish a paradigm for studying sustained deliberation in the brain.

NATURE NEUROSCIENCE (2023)

Article Biochemical Research Methods

Studying neural responses for multi-component economic choices in human and non-human primates using concept-based behavioral choice experiments

Alexandre Pastor-Bernier, Konstantin Volkmann, Leo Chi U. Seak, Arkadiusz Stasiak, Charles R. Plott, Wolfram Schultz

Summary: This article presents a protocol to identify single-dimensional neural responses for multi-component choice options in humans and monkeys. It utilizes concept-based behavioral choice experiments and stringent economic concepts to develop and implement behavioral tasks. The article also discusses regional neuroimaging in humans and fine-grained neurophysiology in monkeys, as well as approaches for data analysis.

STAR PROTOCOLS (2023)

暂无数据