4.6 Article

Silicon spiking neurons for hardware implementation of extreme learning machines

期刊

NEUROCOMPUTING
卷 102, 期 -, 页码 125-134

出版社

ELSEVIER
DOI: 10.1016/j.neucom.2012.01.042

关键词

Spiking neural network; Extreme learning machine; Asynchronous communication; Silicon neuron; Neuromorphic

资金

  1. MOE AcRF Tier 1 [RG 21/10, RG 22/08]

向作者/读者索取更多资源

In this paper, we propose a silicon implementation of extreme learning machines (ELM) using spiking neural circuits. The major components of a silicon spiking neural network, neuron, synapse and 'Address Event Representation' (AER) for asynchronous spike based communication, are described. The benefits of using this hardware to implement an ELM as opposed to other single layer feedforward networks (SLFN) are explained. Several possible architectures for efficient implementation of ELM using these circuits are presented and their possible impact on ELM performance is discussed. (C) 2012 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Multidisciplinary Sciences

Halide perovskite memristors as flexible and reconfigurable physical unclonable functions

Rohit Abraham John, Nimesh Shah, Sujaya Kumar Vishwanath, Si En Ng, Benny Febriansyah, Metikoti Jagadeeswararao, Chip-Hong Chang, Arindam Basu, Nripan Mathews

Summary: The study explores the use of one-dimensional halide perovskite memristors to design security primitives for key generation and device authentication, offering a new solution to the challenge of efficient roots of trust for resource-constrained hardware.

NATURE COMMUNICATIONS (2021)

Article Engineering, Electrical & Electronic

Introducing Recurrence in Strong PUFs for Enhanced Machine Learning Attack Resistance

Nimesh Shah, Durba Chatterjee, Brojogopal Sapui, Debdeep Mukhopadhyay, Arindam Basu

Summary: This paper introduces a Recurrence-based PUF circuit that utilizes feedback and XOR function to enhance ML-attack resistance while maintaining reliability, suitable for both analog and digital PUF cores.

IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS (2021)

Article Engineering, Electrical & Electronic

A 51.3-TOPS/W, 134.4-GOPS In-Memory Binary Image Filtering in 65-nm CMOS

Sumon Kumar Bose, Deepak Singla, Arindam Basu

Summary: This article introduces an in-memory filtering technology that utilizes 6T-SRAM in-memory computing for image denoising, improving processing efficiency and energy savings. The new technology demonstrates excellent energy-saving performance while maintaining high algorithm accuracy and has promising application prospects.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2022)

Article Neurosciences

Dendritic Computing: Branching Deeper into Machine Learning

Jyotibdha Acharya, Arindam Basu, Robert Legenstein, Thomas Limbacher, Panayiota Poirazi, Xundong Wu

Summary: In this paper, the nonlinear computational power provided by dendrites in biological and artificial neurons is discussed. Biological evidence, plasticity rules, and their impact on biological learning assessed by computational models are briefly presented. The computational implications include improved expressivity, efficient resource utilization, utilization of internal learning signals, and enabling continual learning. Examples of using dendritic computations to solve real-world classification problems are discussed, categorized based on the methods of plasticity used. The convergence between concepts of deep learning and dendritic computations is highlighted, along with future research directions.

NEUROSCIENCE (2022)

Article Computer Science, Information Systems

EBBINNOT: A Hardware-Efficient Hybrid Event-Frame Tracker for Stationary Dynamic Vision Sensors

Vivek Mohan, Deepak Singla, Tarun Pulluri, Andres Ussa, Pradeep Kumar Gopalakrishnan, Pao-Sheng Sun, Bharath Ramesh, Arindam Basu

Summary: This article presents a hybrid event-frame approach for low-power traffic monitoring using dynamic vision sensors (DVS). By optimizing memory and computational needs, a hardware-efficient processing pipeline is proposed. Experimental results show that the proposed method achieves similar accuracy to existing methods while significantly reducing computational requirements.

IEEE INTERNET OF THINGS JOURNAL (2022)

Article Engineering, Electrical & Electronic

A 389 TOPS/W, Always ON Region Proposal Integrated Circuit Using In-Memory Computing in 65 nm CMOS

Sumon Kumar Bose, Arindam Basu

Summary: This article proposes a region proposal network based on neuromorphic vision sensors for energy savings in Internet of Things traffic monitoring systems. The algorithm utilizes one-dimensional projection of images for edge detection, leading to high energy efficiency and throughput.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2023)

Article Engineering, Civil

Real-Time Illegal Parking Detection Algorithm in Urban Environments

Xinggan Peng, Rongzihan Song, Qi Cao, Yue Li, Dongshun Cui, Xiaofan Jia, Zhiping Lin, Guang-Bin Huang

Summary: This paper proposes a novel detection algorithm using in-vehicle cameras for illegal parking detection. A new dataset and a labeling method are also introduced. The experiments show that the proposed algorithm has strong illumination robustness in different operating environments.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Electrical & Electronic

A 915-1220 TOPS/W, 976-1301 GOPS Hybrid In-Memory Computing Based Always-On Image Processing for Neuromorphic Vision Sensors

Xueyong Zhang, Arindam Basu

Summary: Neuromorphic vision sensors (NVS) save energy and reduce data by asynchronously recording changes in temporal contrast. This article proposes a hybrid memory bitcell for event-based binary image (EBBI) frame from NVS, achieving better performance in image restoration and object region proposals.

IEEE JOURNAL OF SOLID-STATE CIRCUITS (2023)

Article Engineering, Biomedical

DeeptDCS: Deep Learning-Based Estimation of Currents Induced During Transcranial Direct Current Stimulation

Xiaofan Jia, Sadeed Bin Sayed, Nahian Ibn Hasan, Luis J. Gomez, Guang-Bin Huang, Abdulkadir C. Yucel

Summary: This paper proposes a deep learning-based emulator called DeeptDCS for rapidly evaluating the current density induced by transcranial direct current stimulation (tDCS). The emulator utilizes Attention U-net model to generate the three-dimensional current density distribution across the entire head based on the volume conductor models of head tissues. By fine-tuning the model, the generalization ability of DeeptDCS to non-trained electrode configurations can be greatly enhanced. DeeptDCS provides satisfactorily accurate results and is significantly faster than a physics-based open-source simulator.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Architectural Exploration of Neuromorphic Compression based Neural Sensing for Next-Gen Wireless implantable-BMI

Vivek Mohan, Wee Peng Tay, Arindam Basu

Summary: This study explores a neural sensing architecture with neuromorphic compression and an address-event representation inspired readout protocol for next-gen, massively parallel wireless iBMI. The effects of neuromorphic compression on spike shape, spike detection accuracy, sensitivity, and false detection rate are assessed using quantitative metrics such as root-mean-square error and correlation coefficient between the original and recovered signal, to understand the impact of compression on downstream iBMI tasks. The results demonstrate that a data compression ratio of > 50 can be achieved by selectively transmitting event pulses generated in different modes, with a correlation coefficient of approximately 0.9 and a spike detection accuracy of over 90%.

2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Reconfigurable Leakage-based Weak PUF in 65nm CMOS with 0.63% instability

Nimesh Shah, Arindam Basu

Summary: The reliability of hardware security devices in a System-On-Chip with IoT sensor nodes is crucial. A weak PUF fabricated in 65nm CMOS is designed for chip ID applications, utilizing OFF devices to achieve low instability and BER. The measurements show high reproducibility and throughput, making it a promising choice for integration with IoT devices.

2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS (2023)

Article Computer Science, Artificial Intelligence

A Hybrid Neuromorphic Object Tracking and Classification Framework for Real-Time Systems

Andres Ussa, Chockalingam Senthil Rajen, Tarun Pulluri, Deepak Singla, Jyotibdha Acharya, Gideon Fu Chuanrong, Arindam Basu, Bharath Ramesh

Summary: This article proposes a real-time, hybrid neuromorphic framework for object tracking and classification using event-based cameras. It addresses the challenge of deep learning inference on low-power, embedded platforms. A hardware-friendly object tracking scheme is implemented using a frame-based region proposal method and the frame-based object track input is converted back to spikes for classification. The proposed neuromorphic system is also compared to state-of-the-art methods and demonstrated in real-time and embedded applications.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Proceedings Paper Engineering, Electrical & Electronic

A 389TOPS/W, 1262fps at 1Meps Region Proposal Integrated Circuit for Neuromorphic Vision Sensors in 65nm CMOS

Sumon Kumar Bose, Arindam Basu

IEEE ASIAN SOLID-STATE CIRCUITS CONFERENCE (A-SSCC 2021) (2021)

Proceedings Paper Computer Science, Hardware & Architecture

DeepFreeze: Cold Boot Attacks and High Fidelity Model Recovery on Commercial EdgeML Device

Yoo-Seung Won, Soham Chatterjee, Dirmanto Jap, Arindam Basu, Shivam Bhasin

Summary: This study demonstrates a cold boot attack method on NCS for recovering model architecture and some weights successfully, although there are errors in correcting the weights, they can be corrected using the knowledge distillation method.

2021 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN (ICCAD) (2021)

Proceedings Paper Computer Science, Hardware & Architecture

Time to Leak: Cross-Device Timing Attack On Edge Deep Learning Accelerator

Yoo-Seung Won, Soham Chatterjee, Dirmanto Jap, Shivam Bhasin, Arindam Basu

Summary: This paper demonstrates the vulnerability of deployed deep learning models to timing side-channel attacks, where adversaries can reconstruct the model by measuring the execution time of the inference. The attack is validated on Intel Compute Stick 2 and is highlighted for its high success rate in cross-device setting.

2021 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC) (2021)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)