4.7 Article

An embodied account of serial order How instabilities drive sequence generation

期刊

NEURAL NETWORKS
卷 23, 期 10, 页码 1164-1179

出版社

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2010.07.012

关键词

Dynamic Field Theory; Sequence generation; Embodiment; Neural dynamics; Attractors and instabilities

向作者/读者索取更多资源

Learning and generating serially ordered sequences of actions is a core component of cognition both in organisms and in artificial cognitive systems When these systems are embodied and situated in partially unknown environments specific constraints arise for any neural mechanism of sequence generation In particular sequential action must resist fluctuating sensory information and be capable of generating sequences in which the individual actions may vary unpredictably in duration We provide a solution to this problem within the framework of Dynamic Field Theory by proposing an architecture in which dynamic neural networks create stable states at each stage of a sequence These neural attractors are destabilized in a cascade of bifurcations triggered by a neural representation of a condition of satisfaction for each action We implement the architecture on a robotic vehicle in a color search task demonstrating both sequence learning and sequence generation on the basis of low-level sensory information (C) 2010 Elsevier Ltd All rights reserved

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

How infants' reaches reveal principles of sensorimotor decision making

Evelina Dineva, Gregor Schoener

CONNECTION SCIENCE (2018)

Article Engineering, Electrical & Electronic

Real-Time Depth From Focus on a Programmable Focal Plane Processor

Julien N. P. Martel, Lorenz K. Mueller, Stephen J. Carey, Jonathan Mueller, Yulia Sandamirskaya, Piotr Dudek

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2018)

Article Neurosciences

Anticipatory coarticulation in non-speeded arm movements can be motor-equivalent, carry-over coarticulation always is

Eva Hansen, Britta Grimme, Hendrik Reimann, Gregor Schoener

EXPERIMENTAL BRAIN RESEARCH (2018)

Article Computer Science, Cybernetics

A process account of the uncontrolled manifold structure of joint space variance in pointing movements

Valere Martin, Hendrik Reimann, Gregor Schoener

BIOLOGICAL CYBERNETICS (2019)

Article Computer Science, Artificial Intelligence

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement

Jan Tekuelve, Adrien Fois, Yulia Sandamirskaya, Gregor Schoener

FRONTIERS IN NEUROROBOTICS (2019)

Article Engineering, Electrical & Electronic

Digital multiplier-less implementation of high-precision SDSP and synaptic strength-based STDP

Hajar Asgari, Babak Mazloom-Nezhad Maybodi, Yulia Sandamirskaya

INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS (2020)

Article Engineering, Electrical & Electronic

Neural State Machines for Robust Learning and Control of Neuromorphic Agents

Dongchen Liang, Raphaela Kreiser, Carsten Nielsen, Ning Qiao, Yulia Sandamirskaya, Giacomo Indiveri

IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS (2019)

Article Computer Science, Artificial Intelligence

Parameter Optimization and Learning in a Spiking Neural Network for UAV Obstacle Avoidance Targeting Neuromorphic Processors

Llewyn Salt, David Howard, Giacomo Indiveri, Yulia Sandamirskaya

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2020)

Article Engineering, Electrical & Electronic

Digital Multiplier-Less Spiking Neural Network Architecture of Reinforcement Learning in a Context-Dependent Task

Hajar Asgari, Babak Mazloom-Nezhad Maybodi, Raphaela Kreiser, Yulia Sandamirskaya

IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS (2020)

Article Engineering, Electrical & Electronic

Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook

Mike Davies, Andreas Wild, Garrick Orchard, Yulia Sandamirskaya, Gabriel A. Fonseca Guerra, Prasad Joshi, Philipp Plank, Sumedh R. Risbud

Summary: Neuromorphic computing aims to develop chips inspired by biological neural circuits to process new knowledge, adapt, behave, and learn in real time at low power levels, with recent advancements showing promising results with Intel's Loihi processor. Compelling neuromorphic networks using spike-based hardware demonstrate significantly lower latency and energy consumption compared to state-of-the-art conventional approaches, solving diverse problems representative of brain-like computation.

PROCEEDINGS OF THE IEEE (2021)

Article Computer Science, Artificial Intelligence

A Neural Dynamic Network Drives an Intentional Agent That Autonomously Learns Beliefs in Continuous Time

Jan Tekulve, Gregor Schoener

Summary: This article examines the neural process organization required for autonomous learning, including the decision and control of learning, the construction of learning data representations, and the selection of neural substrate for learning new patterns. It demonstrates how a neural dynamic network can learn new beliefs from single experiences and use them to satisfy desires.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2022)

Review Robotics

Neuro-inspired electronic skin for robots

Fengyuan Liu, Sweety Deswal, Adamos Christou, Yulia Sandamirskaya, Mohsen Kaboli, Ravinder Dahiya

Summary: Touch is a complex sensing modality that enables us to feel and perceive the world through the large number of receptors in our skin. The touch-sensing capability of current robots is far behind humans, therefore there is a need for neural-like hardware for electronic skin (e-skin). This paper discusses the hardware implementations of various computational building blocks for e-skin and how they can potentially achieve human skin-like or peripheral nervous system-like functionalities.

SCIENCE ROBOTICS (2022)

Article Robotics

Neuromorphic computing hardware and neural architectures for robotics

Yulia Sandamirskaya, Mohsen Kaboli, Jorg Conradt, Tansu Celikel

Summary: This viewpoint provides an overview of recent insights from neuroscience that could enhance signal processing in artificial neural networks on chip, unlocking innovative applications in robotics and autonomous intelligent systems.

SCIENCE ROBOTICS (2022)

Article Neurosciences

Estimating the time structure of descending activation that generates movements at different speeds

Rachid Ramadan, Cora Hummert, Jean-Stephane Jokeit, Gregor Schoener

Summary: The study focuses on the characteristics of descending activation patterns in targeted hand movements, revealing that these patterns have different temporal structures at different movement speeds to adapt to changes in interaction torques and muscle dynamics.

JOURNAL OF NEUROPHYSIOLOGY (2022)

Article Computer Science, Artificial Intelligence

Reduced-complexity Convolutional Neural Network in the compressed domain

Hamdan Abdellatef, Lina J. Karam

Summary: This paper proposes performing the learning and inference processes in the compressed domain to reduce computational complexity and improve speed of neural networks. Experimental results show that modified ResNet-50 in the compressed domain is 70% faster than traditional spatial-based ResNet-50 while maintaining similar accuracy. Additionally, a preprocessing step with partial encoding is suggested to improve resilience to distortions caused by low-quality encoded images. Training a network with highly compressed data can achieve good classification accuracy with significantly reduced storage requirements.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks

Victor R. Barradas, Yasuharu Koike, Nicolas Schweighofer

Summary: Inverse models are essential for human motor learning as they map desired actions to motor commands. The shape of the error surface and the distribution of targets in a task play a crucial role in determining the speed of learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning a robust foundation model against clean-label data poisoning attacks at downstream tasks

Ting Zhou, Hanshu Yan, Jingfeng Zhang, Lei Liu, Bo Han

Summary: We propose a defense strategy that reduces the success rate of data poisoning attacks in downstream tasks by pre-training a robust foundation model.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

AdaSAM: Boosting sharpness-aware minimization with adaptive learning rate and momentum for neural networks

Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao

Summary: In this paper, the convergence rate of AdaSAM in the stochastic non-convex setting is analyzed. Theoretical proof shows that AdaSAM has a linear speedup property and decouples the stochastic gradient steps with the adaptive learning rate and perturbed gradient. Experimental results demonstrate that AdaSAM outperforms other optimizers in terms of performance.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Grasping detection of dual manipulators based on Markov decision process with neural network

Juntong Yun, Du Jiang, Li Huang, Bo Tao, Shangchun Liao, Ying Liu, Xin Liu, Gongfa Li, Disi Chen, Baojia Chen

Summary: In this study, a dual manipulator grasping detection model based on the Markov decision process is proposed. By parameterizing the grasping detection model of dual manipulators using a cross entropy convolutional neural network and a full convolutional neural network, stable grasping of complex multiple objects is achieved. Robot grasping experiments were conducted to verify the feasibility and superiority of this method.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Asymmetric double networks mutual teaching for unsupervised person Re-identification

Miaohui Zhang, Kaifang Li, Jianxin Ma, Xile Wang

Summary: This paper proposes an unsupervised person re-identification (Re-ID) method that uses two asymmetric networks to generate pseudo-labels for each other by clustering and updates and optimizes the pseudo-labels through alternate training. It also designs similarity compensation and similarity suppression based on the camera ID of pedestrian images to optimize the similarity measure. Extensive experiments show that the proposed method achieves superior performance compared to state-of-the-art unsupervised person re-identification methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Low-variance Forward Gradients using Direct Feedback Alignment and momentum

Florian Bacho, Dominique Chu

Summary: This paper proposes a new approach called the Forward Direct Feedback Alignment algorithm for supervised learning in deep neural networks. By combining activity-perturbed forward gradients, direct feedback alignment, and momentum, this method achieves better performance and convergence speed compared to other local alternatives to backpropagation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Maximum margin and global criterion based-recursive feature selection

Xiaojian Ding, Yi Li, Shilin Chen

Summary: This research paper addresses the limitations of recursive feature elimination (RFE) and its variants in high-dimensional feature selection tasks. The proposed algorithms, which introduce a novel feature ranking criterion and an optimal feature subset evaluation algorithm, outperform current state-of-the-art methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation

Naoko Koide-Majima, Shinji Nishimoto, Kei Majima

Summary: Visual images observed by humans can be reconstructed from brain activity, and the visualization of arbitrary natural images from mental imagery has been achieved through an improved method. This study provides a unique tool for directly investigating the subjective contents of the brain.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Hierarchical attention network with progressive feature fusion for facial expression recognition

Huanjie Tao, Qianyue Duan

Summary: In this paper, a hierarchical attention network with progressive feature fusion is proposed for facial expression recognition (FER), addressing the challenges posed by pose variation, occlusions, and illumination variation. The model achieves enhanced performance by aggregating diverse features and progressively enhancing discriminative features.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

SLAPP: Subgraph-level attention-based performance prediction for deep learning models

Zhenyi Wang, Pengfei Yang, Linwei Hu, Bowen Zhang, Chengmin Lin, Wenkai Lv, Quan Wang

Summary: In the face of the complex landscape of deep learning, we propose a novel subgraph-level performance prediction method called SLAPP, which combines graph and operator features through an innovative graph neural network called EAGAT, providing accurate performance predictions. In addition, we introduce a mixed loss design with dynamic weight adjustment to improve predictive accuracy.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

LDCNet: Lightweight dynamic convolution network for laparoscopic procedures image segmentation

Yiyang Yin, Shuangling Luo, Jun Zhou, Liang Kang, Calvin Yu-Chian Chen

Summary: Medical image segmentation is crucial for modern healthcare systems, especially in reducing surgical risks and planning treatments. Transanal total mesorectal excision (TaTME) has become an important method for treating colon and rectum cancers. Real-time instance segmentation during TaTME surgeries can assist surgeons in minimizing risks. However, the dynamic variations in TaTME images pose challenges for accurate instance segmentation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Teng Cheng, Lei Sun, Junning Zhang, Jinling Wang, Zhanyang Wei

Summary: This study proposes a scheme that combines the start-stop point signal features for wideband multi-signal detection, called Fast Spectrum-Size Self-Training network (FSSNet). By utilizing start-stop points to build the signal model, this method successfully solves the difficulty of existing deep learning methods in detecting discontinuous signals and achieves satisfactory detection speed.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning deep representation and discriminative features for clustering of multi-layer networks

Wenming Wu, Xiaoke Ma, Quan Wang, Maoguo Gong, Quanxue Gao

Summary: The layer-specific modules in multi-layer networks are critical for understanding the structure and function of the system. However, existing methods fail to accurately characterize and balance the connectivity and specificity of these modules. To address this issue, a joint learning graph clustering algorithm (DRDF) is proposed, which learns the deep representation and discriminative features of the multi-layer network, and balances the connectivity and specificity of the layer-specific modules through joint learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Boundary uncertainty aware network for automated polyp segmentation

Guanghui Yue, Guibin Zhuo, Weiqing Yan, Tianwei Zhou, Chang Tang, Peng Yang, Tianfu Wang

Summary: This paper proposes a novel boundary uncertainty aware network (BUNet) for precise and robust colorectal polyp segmentation. BUNet utilizes a pyramid vision transformer encoder to learn multi-scale features and incorporates a boundary exploration module (BEM) and a boundary uncertainty aware module (BUM) to handle boundary areas. Experimental results demonstrate that BUNet outperforms other methods in terms of performance and generalization ability.

NEURAL NETWORKS (2024)