4.8 Article

Mesolimbic confidence signals guide perceptual learning in the absence of external feedback

Journal

ELIFE
Volume 5, Issue -, Pages -

Publisher

ELIFE SCIENCES PUBLICATIONS LTD
DOI: 10.7554/eLife.13388

Keywords

-

Categories

Funding

  1. Deutsche Forschungsgemeinschaft [GRK 1589/1, STE 1430/6-1, STE 1430/7-1]

Ask authors/readers for more resources

It is well established that learning can occur without external feedback, yet normative reinforcement learning theories have difficulties explaining such instances of learning. Here, we propose that human observers are capable of generating their own feedback signals by monitoring internal decision variables. We investigated this hypothesis in a visual perceptual learning task using fMRI and confidence reports as a measure for this monitoring process. Employing a novel computational model in which learning is guided by confidence-based reinforcement signals, we found that mesolimbic brain areas encoded both anticipation and prediction error of confidence in remarkable similarity to previous findings for external reward-based feedback. We demonstrate that the model accounts for choice and confidence reports and show that the mesolimbic confidence prediction error modulation derived through the model predicts individual learning success. These results provide a mechanistic neurobiological explanation for learning without external feedback by augmenting reinforcement models with confidence-based feedback.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.8
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Biology

The organizational principles of de-differentiated topographic maps in somatosensory cortex

Peng Liu, Anastasia Chrysidou, Juliane Doehler, Martin N. Hebart, Thomas Wolbers, Esther Kuehn

Summary: The study found that older adults' primary somatosensory cortex maps have similar amplitude and size to those of younger adults, but show less representational similarity between different fingers. Larger population receptive field sizes in older adults' maps do not correlate with behavior, whereas reduced cortical distances between D2 and D3 are associated with worse finger individuation but better motor performance.

ELIFE (2021)

Article Neurosciences

Non-stimulated regions in early visual cortex encode the contents of conscious visual perception

Bianca M. van Kemenade, Gregor Wilbertz, Annalena Muller, Philipp Sterzer

Summary: The theory of predictive processing suggests that our brains interpret incoming sensory input by generating predictions based on internal models of the world, with conscious perception corresponding to the most probable model. Studies using functional magnetic resonance imaging have shown that early sensory cortices receive predictive feedback signals reflecting the contents of conscious perception.

HUMAN BRAIN MAPPING (2022)

Article Neurosciences

Autobiographical Script-Driven Imagery Has No Detectable Effect on Emotion Regulation in Healthy Individuals

Stephan Koehler, Veith Andreas Weilnhammer, Henrik Walter, Susanne Erk, Philipp Sterzer, Anne Guhn

Summary: The study found that negative emotions induced by autobiographical scripts did not significantly affect the neural processes underlying emotion regulation. Replication of previously reported neural correlates of emotion regulation, such as the right dorsolateral prefrontal cortex and right inferior parietal lobule, was observed.

NEUROPSYCHOBIOLOGY (2022)

Article Multidisciplinary Sciences

Human EEG recordings for 1,854 concepts presented in rapid serial visual presentation streams

Tijl Grootswagers, Ivy Zhou, Amanda K. Robinson, Martin N. Hebart, Thomas A. Carlson

Summary: This paper presents the THINGS-EEG dataset, which includes electroencephalography responses from 50 subjects to 1,854 object concepts and 22,248 images. This dataset can support research in understanding how the brain recognizes and processes visual objects.

SCIENTIFIC DATA (2022)

Article Behavioral Sciences

Probing the attentional modulation of unconscious processing under interocular suppression in a spatial cueing paradigm

Juliane Handschack, Marcus Rothkirch, Philipp Sterzer, Guido Hesselmann

Summary: The debate on the scope and limits of unconscious visual processing under continuous flash suppression (CFS) has resulted in divergent findings. This study aimed to investigate the hypothesis of CFS attenuation by inattention using functional magnetic resonance imaging (fMRI) and multivariate pattern analysis (MVPA). The results did not support the hypothesis, but showed higher decoding accuracies for visible stimuli compared to invisible stimuli.

CORTEX (2022)

Article Psychiatry

Impaired empathic functioning in chronic depression: Behavioral evidence for the Cognitive Behavioral Analysis System of Psychotherapy (CBASP) model

Anne Guhn, Lydia Merkel, Christine Heim, Heiko Klawitter, Paula Teich, Felix Betzler, Philipp Sterzer, Stephan Koehler

Summary: The Cognitive Behavioral Analysis System of Psychotherapy (CBASP) model suggests that preoperational functioning and empathy deficits are core features of persistent depressive disorders (PDD). This study found that empathy deficits in PDD patients were only apparent under stress and improved after CBASP treatment. The study supports the CBASP model and highlights the importance of stress-induced empathy impairments in PDD.

JOURNAL OF PSYCHIATRIC RESEARCH (2022)

Review Psychology, Experimental

When seeing is not believing: A mechanistic basis for predictive divergence

Chiara Caporuscio, Sascha Benjamin Fink, Philipp Sterzer, Joshua M. Martin

Summary: Visual illusions demonstrate the potential incongruence between perception and belief, challenging the Predictive Processing framework which aims to explain this phenomenon. Insights on how prior information is approximated in information processing streams shed light on the divergence between flexible and inflexible priors. This allows for conflicting percepts and beliefs to be accounted for while maintaining a hierarchical and unitary conception of cognition.

CONSCIOUSNESS AND COGNITION (2022)

Article Biochemical Research Methods

The value of confidence: Confidence prediction errors drive value-based learning in the absence of external feedback

Lena Esther Ptasczynski, Isa Steinecker, Philipp Sterzer, Matthias Guggenmos

Summary: This study investigates the impact of confidence-based learning signals on instrumental conditioning and finds that subjective confidence and choice consistency increase in the absence of external feedback. By comparing different models, the researchers demonstrate that confidence-based models outperform standard models, highlighting the importance of confidence signals in value-based learning.

PLOS COMPUTATIONAL BIOLOGY (2022)

Article Neurosciences

Experimental Sleep Deprivation Results in Diminished Perceptual Stability Independently of Psychosis Proneness

Leonie J. T. Balter, Granville J. Matheson, Tina Sundelin, Philipp Sterzer, Predrag Petrovic, John Axelsson

Summary: This study aims to investigate the effects of sleep deprivation on perceptual stability and its relationship with psychosis proneness. The results suggest that sleep deprivation reduces perceptual stability, but there is no association between variability in psychosis traits and vulnerability to sleep deprivation.

BRAIN SCIENCES (2022)

Article Psychology, Experimental

Believing is seeing: The link between paranormal beliefs and perceiving signal in noise

Kiley Seymour, Philipp Sterzer, Natalie Soto

Summary: Research suggests that the tendency to attribute meaning to ambiguous stimuli is at the core of paranormal belief formation. This study aimed to examine the relationship between paranormal belief and perceptual sensitivity. The results showed that individuals with stronger beliefs in paranormal phenomena were less sensitive in discriminating between signal and noise. This finding suggests that paranormal believers perceive things differently, disentangling perceptual sensitivity from response bias.

CONSCIOUSNESS AND COGNITION (2022)

Article Psychiatry

Cross-Modality Evidence for Reduced Choice History Biases in Psychosis-Prone Individuals

Anna-Lena Eckert, Yael Gounitski, Matthias Guggenmos, Philipp Sterzer

Summary: This study investigated the relationship between psychosis proneness and choice history biases in perceptual decision-making, finding that psychosis proneness is associated with reduced choice history biases and no evidence for compensatory reliance on cue information. These results are important for understanding the connection between psychotic experiences and perceptual decision-making.

SCHIZOPHRENIA BULLETIN (2023)

Article Multidisciplinary Sciences

No effect of attentional modulation by spatial cueing in a masked numerical priming paradigm using continuous flash suppression (CFS)

Juliane Handschack, Marcus Rothkirch, Philipp Sterzer, Guido Hesselmann

Summary: Emerging from studies on unconscious visual processing, it is suggested that different blinding techniques suppress conscious perception at different levels. However, even with a single suppression method like continuous flash suppression (CFS), the extent and limits of unconscious visual processing remain diverse. In this study, the CFS-attenuation-by-inattention hypothesis was investigated using a numerical priming task. Results showed no priming effects in the invisible condition and an inverse effect of prime-target congruency in the visible condition, supporting the notion that CF-suppressed stimuli are limited to basic features without semantic processing.

PEERJ (2023)

Article Multidisciplinary Sciences

Neural correlates of hierarchical predictive processes in autistic adults

Laurie-Anne Sapey-Triomphe, Lauren Pattyn, Veith Weilnhammer, Philipp Sterzer, Johan Wagemans

Summary: This study reveals that predictive mechanisms have an impact on behavior and perception at the neural level in both neurotypical and autistic adults, and are hierarchically encoded in the brain. These findings help to understand the neural specificities of atypical predictive processing in autism spectrum disorders.

NATURE COMMUNICATIONS (2023)

Article Multidisciplinary Sciences

Sensory and environmental uncertainty in perceptual decision-making

Merve Fritsch, Veith Weilnhammer, Paul Thiele, Andreas Heinz, Philipp Sterzer

Summary: This study aimed to investigate the impact of noisy sensory information and environmental uncertainties on perceptual decisions. The results showed that under high sensory uncertainty, learned audiovisual associations had a greater influence on perceptual decisions, and this effect was even larger under high environmental uncertainty. Additionally, individual tendencies to change beliefs affected the degree to which observers relied on learned beliefs in making perceptual decisions. While the weighting of sensory information and learned beliefs was modulated by their respective uncertainties, belief learning was not influenced by sensory uncertainty. Understanding the interactive effects of sensory and environmental uncertainties in perception could provide insights into aberrant perceptual inference in psychopathology such as schizophrenia.

ISCIENCE (2023)

No Data Available