4.7 Review

The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia

Journal

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS
Volume 100, Issue -, Pages 19-34

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neubiorev.2019.02.008

Keywords

Cortex; Cerebellum; Basal ganglia; Unsupervised learning; Supervised learning; Reinforcement learning; Super-learning; Interplay between learning mechanisms; System-level neuroscience; Cortical-subcortical hierarchies; Neuromodulation; Dopamine; Serotonin; Noradrenaline; Acetylcholine

Funding

  1. EU FET Open project GOAL-Robots - Goal-based Open-ended Autonomous Learning Robots [713010]
  2. National Science Foundation [BCS-1343544]

Ask authors/readers for more resources

Despite wide evidence suggesting anatomical and functional interactions between cortex, cerebellum and basal ganglia, the learning processes operating within them -often viewed as respectively unsupervised, supervised and reinforcement learning- are studied in isolation, neglecting their strong interdependence. We discuss how those brain areas form a highly integrated system combining different learning mechanisms into an effective super-learning process supporting the acquisition of flexible motor behaviour. The term super-learning does not indicate a new learning paradigm. Rather, it refers to the fact that different learning mechanisms act in synergy as they: (a) affect neural structures often relying on the widespread action of neuromodulators; (b) act within various stages of cortical/subcortical pathways that are organised in pipeline to support multiple sensation-toaction mappings operating at different levels of abstraction; (c) interact through the reciprocal influence of the output compartments of different brain structures, most notably in the cerebello-cortical and basal ganglia-cortical loops. Here we articulate this new hypothesis and discuss empirical evidence supporting it by specifically referring to motor adaptation and sequence learning.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Clinical Neurology

Targeted tDCS selectively improves motor adaptation with the proximal and distal upper limb

Matthew Weightman, John-Stuart Brittain, David Punt, R. Chris Miall, Ned Jenkinson

BRAIN STIMULATION (2020)

Article Neurosciences

Adaptation of reach action to a novel force-field is not predicted by acuity of dynamic proprioception in either older or younger adults

Nick M. Kitchen, R. Chris Miall

Summary: This study found that age-related proprioceptive deficits are unrelated to accuracy in rapid arm movements, and do not impact force-field adaptation. Regardless of visual feedback conditions, physically inactive individuals perform worse in proprioceptive errors.

EXPERIMENTAL BRAIN RESEARCH (2021)

Article Clinical Neurology

How and Why the Cerebellum Recodes Input Signals: An Alternative to Machine Learning

Mike Gilbert, R. Chris Miall

Summary: In the cerebellum, mossy fiber input is recoded into internal signals before being transmitted to Purkinje cells for output. The process of recoding is essential for confining the effect of certain variables and utilizing statistical coding for reliable and precise effects. This mechanism helps normalize diverse input signals and maintain the basic circuit structure of the cerebellum across different species.

NEUROSCIENTIST (2022)

Article Multidisciplinary Sciences

Direct and indirect effects of cathodal cerebellar TDCS on visuomotor adaptation of hand and arm movements

Matthew Weightman, John-Stuart Brittain, R. Chris Miall, Ned Jenkinson

Summary: The study demonstrates the differential effects of cathodal transcranial direct current stimulation (TDCS) on motor adaptation of proximal and distal upper-limb movements. While cathodal TDCS over the cerebellum impairs whole-arm movements, it enhances hand movements, suggesting a modulation of excitability between the cerebellum and M1.

SCIENTIFIC REPORTS (2021)

Article Neurosciences

Perception of body shape and size without touch or proprioception: evidence from individuals with congenital and acquired neuropathy

R. Christopher Miall, Daria Afanasyeva, Jonathan D. Cole, Peggy Mason

Summary: The research contrasted two deafferented adults in terms of their mental representations of the body and perceptual task performance. Differences were found in accuracy of hand shape and arm length, with one participant demonstrating better conscious awareness. Reach distance estimation and attentional bias also varied among the participants.

EXPERIMENTAL BRAIN RESEARCH (2021)

Article Neurosciences

The role of somatosensation in automatic visuo-motor control: a comparison of congenital and acquired sensory loss

R. Chris Miall, Daria Afanasyeva, Jonathan D. Cole, Peggy Mason

Summary: Studies have shown that regaining some motor control after adult-onset loss of proprioceptive and touch input heavily depends on cognitive control. By contrasting the performance of IW and KS, it is suggested that KS may have some advantage in automating simple visually-guided actions. In contrast, IW is unable to achieve this level of automation. The dual task of writing and drawing performed with and without an audio-verbal echoing task showed differences in visuo-motor performance between the two individuals.

EXPERIMENTAL BRAIN RESEARCH (2021)

Article Engineering, Biomedical

A 1D CNN for high accuracy classification and transfer learning in motor imagery EEG-based brain-computer interface

F. Mattioli, C. Porcaro, G. Baldassarre

Summary: This study aims to establish communication paths between the brain and external devices through Brain-Computer Interface (BCI) and has shown great potential for methods based on motor imagery (MI). A new approach based on convolutional neural network was proposed to classify five brain states, achieving high accuracy in the experiment.

JOURNAL OF NEURAL ENGINEERING (2021)

Article Computer Science, Artificial Intelligence

Internal manipulation of perceptual representations in human flexible cognition: A computational model

Giovanni Granato, Gianluca Baldassarre

Summary: Executive functions depend on integrated cortical-basal ganglia brain systems and form the basis of flexible human behavior. Various computational models have been proposed for studying cognitive flexibility, with the Wisconsin card sorting test (WCST) being an important tool in investigating flexibility.

NEURAL NETWORKS (2021)

Article Computer Science, Artificial Intelligence

C-GRAIL: Autonomous Reinforcement Learning of Multiple and Context-Dependent Goals

Vieri Giuliano Santucci, Davide Montella, Gianluca Baldassarre

Summary: When faced with the problem of autonomously learning to achieve multiple goals, researchers typically focus on problems where each goal can be solved using just one policy. However, in environments presenting different contexts, the same goal might require different skills to solve. We propose a novel robotic architecture, C-GRAIL, that can autonomously detect new relevant contexts and quickly learn policies for new contexts using transfer learning techniques.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Intrinsic Motivations and Planning to Explain Tool-Use Development: A Study With a Simulated Robot Model

Kristsana Seepanomwan, Daniele Caligiore, Kevin J. O'Regan, Gianluca Baldassarre

Summary: Developmental psychology experiments show that infants' ability to use tools suddenly emerges around 18 months. Using a developmental-robotics model, two hypotheses were proposed and tested to explain this phenomenon. The results indicate that only the hypothesis about intrinsic motivation can explain the sudden improvement in tool use.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2022)

Article Mathematical & Computational Biology

A neuro-inspired computational model of life-long learning and catastrophic interference, mimicking hippocampus novelty-based dopamine modulation and lateral inhibitory plasticity

Pierangelo Afferni, Federico Cascino-Milani, Andrea Mattera, Gianluca Baldassarre

Summary: This article introduces a neuro-inspired computational model to explain the mechanism behind the human brain's lifelong learning capability. The model incorporates two key factors - dopamine encoding and homeostatic plasticity mechanism, and shows positive results in experiments.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2022)

Article Computer Science, Artificial Intelligence

A Natural Human-Drone Embodied Interface: Empirical Comparison With a Traditional Interface

Marina Di Vincenzo, Francesco Palini, Maria De Marsico, Anna M. Borghi, Gianluca Baldassarre

Summary: This study compares the usability of a new NUI with a traditional interface in controlling a simulated drone. While the specific NUI used led to lower performance, it was evaluated as more natural and embodied. The results call for further investigation into possible improvements of the NUI.

FRONTIERS IN NEUROROBOTICS (2022)

Article Clinical Neurology

Short duration event related cerebellar TDCS enhances visuomotor adaptation

Matthew Weightman, Neeraj Lalji, Chin-Hsuan Sophie Lin, Joseph M. Galea, Ned Jenkinson, R. Chris Miall

Summary: Brief bursts of anodal stimulation to the cerebellum during a visuomotor adaptation task were found to enhance motor adaptation significantly better than standard TDCS. Short duration, event related, anodal TDCS targeting the cerebellum enhances motor adaptation compared to the standard model.

BRAIN STIMULATION (2023)

Article Computer Science, Artificial Intelligence

Learning Abstract Representations Through Lossy Compression of Multimodal Signals

Charles Wilmot, Gianluca Baldassarre, Jochen Triesch

Summary: A key competence for open-ended learning is the formation of increasingly abstract representations that drive complex behavior. In a multimodal setting, generic lossy compression of sensory input naturally extracts abstract representations that prioritize shared information across different modalities. The proposed architecture utilizing autoencoder neural networks demonstrates the validity of the approach and its applicability to embodied agents.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Editorial Material Computer Science, Artificial Intelligence

Special Issue on Intrinsically Motivated Open-Ended Learning (IMOL) Guest Editorial

Kathryn Kasmarik, Gianluca Baldassarre, Vieri Giuliano Santucci, Jochen Triesch

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Article Behavioral Sciences

Success versus failure in cognitive control: Meta-analytic evidence from neuroimaging studies on error processing

Edna C. Cieslik, Markus Ullsperger, Martin Gell, Simon B. Eickhoff, Robert Langner

Summary: Previous studies on error processing have primarily focused on the posterior medial frontal cortex, but the role of other brain regions has been underestimated. This study used activation likelihood estimation meta-analyses to explore brain activity related to committing errors and responding successfully in interference tasks. It was found that the salience network and the temporoparietal junction were commonly involved in both correct and incorrect responses, indicating their general involvement in coping with situations that require increased cognitive control. Error-specific convergence was observed in the dorsal posterior cingulate cortex, posterior thalamus, and left superior frontal gyrus, while successful responding showed stronger convergence in the dorsal attention network and lateral prefrontal regions. Underrecruitment of these regions in error trials may reflect failures in activating the appropriate stimulus-response contingencies necessary for successful response execution.

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS (2024)