Journal
COGNITIVE COMPUTATION
Volume 5, Issue 1, Pages 152-160Publisher
SPRINGER
DOI: 10.1007/s12559-012-9178-8
Keywords
Hippocampus; Reward discounting; Neural network; Prediction
Funding
- NIH [R01-DA013165]
Ask authors/readers for more resources
Decision-making often requires taking into consideration immediate gains as well as delayed rewards. Studies of behavior have established that anticipated rewards are discounted according to a decreasing hyperbolic function. Although mathematical explanations for reward delay discounting have been offered, little has been proposed in terms of neural network mechanisms underlying discounting. There has been much recent interest in the potential role of the hippocampus. Here, we demonstrate that a previously established neural network model of hippocampal region CA3 contains a mechanism that could explain discounting in downstream reward-prediction systems (e.g., basal ganglia). As part of its normal function, the model forms codes for stimuli that are similar to future predicted stimuli. This similarity provides a means for reward predictions associated with future stimuli to influence current decision-making. Simulations show that this predictive similarity decreases as the stimuli are separated in time, at a rate that is consistent with hyperbolic discounting.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available