4.6 Article

General differential Hebbian learning: Capturing temporal relations between events in neural networks and the brain

Journal

PLOS COMPUTATIONAL BIOLOGY
Volume 14, Issue 8, Pages -

Publisher

PUBLIC LIBRARY SCIENCE
DOI: 10.1371/journal.pcbi.1006227

Keywords

-

Funding

  1. European Union [FP6-IST-IP-027819, FP7-ICT-IP-231722, FP8-FETOPEN-713010]

Ask authors/readers for more resources

Learning in biologically relevant neural-network models usually relies on Hebb learning rules. The typical implementations of these rules change the synaptic strength on the basis of the co-occurrence of the neural events taking place at a certain time in the pre- and postsynaptic neurons. Differential Hebbian learning (DHL) rules, instead, are able to update the synapse by taking into account the temporal relation, captured with derivatives, between the neural events happening in the recent past. The few DHL rules proposed so far can update the synaptic weights only in few ways: this is a limitation for the study of dynamical neurons and neural-network models. Moreover, empirical evidence on brain spike-timing-dependent plasticity (STDP) shows that different neurons express a surprisingly rich repertoire of different learning processes going far beyond existing DHL rules. This opens up a second problem of how capturing such processes with DHL rules. Here we propose a general DHL (G-DHL) rule generating the existing rules and many others. The rule has a high expressiveness as it combines in different ways the pre-and post-synaptic neuron signals and derivatives. The rule flexibility is shown by applying it to various signals of artificial neurons and by fitting several different STDP experimental data sets. To these purposes, we propose techniques to pre-process the neural signals and capture the temporal relations between the neural events of interest. We also propose a procedure to automatically identify the rule components and parameters that best fit different STDP data sets, and show how the identified components might be used to heuristically guide the search of the biophysical mechanisms underlying STDP. Overall, the results show that the G-DHL rule represents a useful means to study time-sensitive learning processes in both artificial neural networks and brain.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Biomedical

A 1D CNN for high accuracy classification and transfer learning in motor imagery EEG-based brain-computer interface

F. Mattioli, C. Porcaro, G. Baldassarre

Summary: This study aims to establish communication paths between the brain and external devices through Brain-Computer Interface (BCI) and has shown great potential for methods based on motor imagery (MI). A new approach based on convolutional neural network was proposed to classify five brain states, achieving high accuracy in the experiment.

JOURNAL OF NEURAL ENGINEERING (2021)

Article Computer Science, Artificial Intelligence

Internal manipulation of perceptual representations in human flexible cognition: A computational model

Giovanni Granato, Gianluca Baldassarre

Summary: Executive functions depend on integrated cortical-basal ganglia brain systems and form the basis of flexible human behavior. Various computational models have been proposed for studying cognitive flexibility, with the Wisconsin card sorting test (WCST) being an important tool in investigating flexibility.

NEURAL NETWORKS (2021)

Article Environmental Sciences

Accept Anxiety to Improve Sleep: The Impact of the COVID-19 Lockdown on the Relationships between Mindfulness, Distress, and Sleep Quality

Marco Mirolli, Luca Simione, Monica Martoni, Marco Fabbri

Summary: The study found that the COVID-19 lockdown decreased levels of mindfulness, increased distress and sleep problems, and the effects of lockdown on sleep were fully mediated by mindfulness and distress, with the acceptance component playing a leading role.

INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH (2021)

Article Computer Science, Artificial Intelligence

C-GRAIL: Autonomous Reinforcement Learning of Multiple and Context-Dependent Goals

Vieri Giuliano Santucci, Davide Montella, Gianluca Baldassarre

Summary: When faced with the problem of autonomously learning to achieve multiple goals, researchers typically focus on problems where each goal can be solved using just one policy. However, in environments presenting different contexts, the same goal might require different skills to solve. We propose a novel robotic architecture, C-GRAIL, that can autonomously detect new relevant contexts and quickly learn policies for new contexts using transfer learning techniques.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Intrinsic Motivations and Planning to Explain Tool-Use Development: A Study With a Simulated Robot Model

Kristsana Seepanomwan, Daniele Caligiore, Kevin J. O'Regan, Gianluca Baldassarre

Summary: Developmental psychology experiments show that infants' ability to use tools suddenly emerges around 18 months. Using a developmental-robotics model, two hypotheses were proposed and tested to explain this phenomenon. The results indicate that only the hypothesis about intrinsic motivation can explain the sudden improvement in tool use.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2022)

Article Mathematical & Computational Biology

A neuro-inspired computational model of life-long learning and catastrophic interference, mimicking hippocampus novelty-based dopamine modulation and lateral inhibitory plasticity

Pierangelo Afferni, Federico Cascino-Milani, Andrea Mattera, Gianluca Baldassarre

Summary: This article introduces a neuro-inspired computational model to explain the mechanism behind the human brain's lifelong learning capability. The model incorporates two key factors - dopamine encoding and homeostatic plasticity mechanism, and shows positive results in experiments.

FRONTIERS IN COMPUTATIONAL NEUROSCIENCE (2022)

Article Computer Science, Artificial Intelligence

A Natural Human-Drone Embodied Interface: Empirical Comparison With a Traditional Interface

Marina Di Vincenzo, Francesco Palini, Maria De Marsico, Anna M. Borghi, Gianluca Baldassarre

Summary: This study compares the usability of a new NUI with a traditional interface in controlling a simulated drone. While the specific NUI used led to lower performance, it was evaluated as more natural and embodied. The results call for further investigation into possible improvements of the NUI.

FRONTIERS IN NEUROROBOTICS (2022)

Article Biology

Kick-starting concept formation with intrinsically motivated learning: the grounding by competence acquisition hypothesis

Francesco Mannella, Luca Tummolini

Summary: This study proposes a mechanism to support concept formation by initiating learning through online interaction of perception and intentional action. By mapping multi-modal sensory patterns and motor repertoire in the same low-dimensional representation space, the acquisition of these mappings can be mutually constrained by maximizing convergence between sensory and motor representations. The results demonstrate that this intrinsically motivated learning process can create a cross-modal categorization system with semantic content, supporting perception and intentional action selection, and have the ability to re-enact its own multi-modal experiences, thus kick-starting the formation of concepts grounded in the external environment.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2023)

Article Neurosciences

Attentional Bias for Sleep-Related Words as a Function of Severity of Insomnia Symptoms

Marco Fabbri, Luca Simione, Laura Catalano, Marco Mirolli, Monica Martoni

Summary: Attentional bias toward sleep-related stimuli is related to the severity of insomnia symptoms, as indicated by slower reaction times for sleep-related words in individuals with subclinical and moderate/severe sleep groups. Furthermore, only the moderate/severe sleep group showed a significant disengagement from sleep-related information, suggesting greater difficulties in shifting attention away from sleep-related stimuli in insomnia.

BRAIN SCIENCES (2023)

Editorial Material Audiology & Speech-Language Pathology

Grounded cognition can be multimodal all the way down

Anna M. Borghi, Claudia Mazzuca, Angelo Mattia Gervasi, Francesco Mannella, Luca Tummolini

Summary: In his position paper, Calzavarini (2023) argues that recent studies in multisensory research challenge the claim that word meaning is grounded in modality-specific representations. Here we argue that the coherence of the Grounded Cognition model does not require the modality-specificity assumption. In fact, already some strong versions of the model had relied on a multimodal view of the sensorimotor cortex that seems consistent with much of the evidence discussed in the paper. Next, we address some possible consequences for empirical research using behavioural methods, particularly for norming studies on word meaning. We conclude by identifying some open issues.

LANGUAGE COGNITION AND NEUROSCIENCE (2023)

Article Computer Science, Artificial Intelligence

Learning Abstract Representations Through Lossy Compression of Multimodal Signals

Charles Wilmot, Gianluca Baldassarre, Jochen Triesch

Summary: A key competence for open-ended learning is the formation of increasingly abstract representations that drive complex behavior. In a multimodal setting, generic lossy compression of sensory input naturally extracts abstract representations that prioritize shared information across different modalities. The proposed architecture utilizing autoencoder neural networks demonstrates the validity of the approach and its applicability to embodied agents.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Editorial Material Computer Science, Artificial Intelligence

Special Issue on Intrinsically Motivated Open-Ended Learning (IMOL) Guest Editorial

Kathryn Kasmarik, Gianluca Baldassarre, Vieri Giuliano Santucci, Jochen Triesch

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Meeting Abstract Psychology, Multidisciplinary

MULTILINGUAL ONLINE GROUP COMPASSION MEDITATION: PROOF OF CONCEPT OF A GLOBAL INTERVENTION FOR THE COVID-19 PANDEMIC

Dara G. Friedman-Wheeler, Alessandro Giannandrea, Monica Martoni, Sara Schairer, Marco Mirolli, Hope Chang, Jessica Lombardi, Alex Tribo

ANNALS OF BEHAVIORAL MEDICINE (2022)

Article Clinical Neurology

The Relationship between Acceptance and Sleep-Wake Quality before, during, and after the First Italian COVID-19 Lockdown

Marco Fabbri, Luca Simione, Monica Martoni, Marco Mirolli

Summary: Several studies have shown that the COVID-19 pandemic negatively affects sleep quality and mood, but the underlying mechanisms are not well understood. Recent research indicates that the acceptance aspect of mindfulness can reduce anxiety, leading to improved sleep quality. This cross-sectional study aimed to examine changes in mindfulness traits, sleep-wake quality, and general distress before, during, and after the first wave of COVID-19, and to test a model in which acceptance influences sleep through anxiety during each period.

CLOCKS & SLEEP (2022)

Article Psychology, Clinical

Acceptance, and Not Its Interaction with Attention Monitoring, Increases Psychological Well-Being: Testing the Monitor and Acceptance Theory of Mindfulness

Luca Simione, Antonino Raffone, Marco Mirolli

Summary: The study found little support for the two tested MAT tenets, and instead strongly supported the alternative view that the beneficial effects of mindfulness on psychological outcomes depend mostly on acceptance.

MINDFULNESS (2021)

No Data Available