4.6 Article

Optimizing the Energy Consumption of Spiking Neural Networks for Neuromorphic Applications

期刊

FRONTIERS IN NEUROSCIENCE
卷 14, 期 -, 页码 -

出版社

FRONTIERS MEDIA SA
DOI: 10.3389/fnins.2020.00662

关键词

neuromorphic computing; spiking networks; loss function; synaptic operations; energy consumption; convolutional networks; CIFAR10; MNIST-DVS

资金

  1. H2020 ECSEL grant TEMPO [826655]

向作者/读者索取更多资源

In the last few years, spiking neural networks (SNNs) have been demonstrated to perform on par with regular convolutional neural networks. Several works have proposed methods to convert a pre-trained CNN to a Spiking CNN without a significant sacrifice of performance. We demonstrate first that quantization-aware training of CNNs leads to better accuracy in SNNs. One of the benefits of converting CNNs to spiking CNNs is to leverage the sparse computation of SNNs and consequently perform equivalent computation at a lower energy consumption. Here we propose an optimization strategy to train efficient spiking networks with lower energy consumption, while maintaining similar accuracy levels. We demonstrate results on the MNIST-DVS and CIFAR-10 datasets.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Chemistry, Analytical

Reservoir computing compensates slow response of chemosensor arrays exposed to fast varying gas concentrations in continuous monitoring

Jordi Fonollosa, Sadique Sheik, Ramon Huerta, Santiago Marco

SENSORS AND ACTUATORS B-CHEMICAL (2015)

Editorial Material Neurosciences

Editorial: Synaptic Plasticity for Neuromorphic Systems

Christian G. Mayr, Sadique Sheik, Chiara Bartolozzi, Elisabetta Chicca

FRONTIERS IN NEUROSCIENCE (2016)

Article Neurosciences

Hardware-Efficient On-line Learning through Pipelined Truncated-Error Backpropagation in Binary-State Networks

Hesham Mostafa, Bruno Pedroni, Sadique Sheik, Gert Cauwenberghs

FRONTIERS IN NEUROSCIENCE (2017)

Article Neurosciences

Neural and Synaptic Array Transceiver: A Brain-Inspired Computing Framework for Embedded Learning

Georgios Detorakis, Sadique Sheik, Charles Augustine, Somnath Paul, Bruno U. Pedroni, Nikil Dutt, Jeffrey Krichmar, Gert Cauwenberghs, Emre Neftci

FRONTIERS IN NEUROSCIENCE (2018)

Article Neurosciences

Memory-Efficient Synaptic Connectivity for Spike-Timing-Dependent Plasticity

Bruno U. Pedroni, Siddharth Joshi, Stephen R. Deissl, Sadique Sheik, Georgios Detorakis, Somnath Paul, Charles Augustine, Emre O. Neftci, Gert Cauwenberghs

FRONTIERS IN NEUROSCIENCE (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Live Demonstration: Face Recognition on an Ultra-low Power Event-driven Convolutional Neural Network ASIC

Qian Liu, Ole Richter, Carsten Nielsen, Sadique Sheik, Giacomo Indiveri, Ning Qiao

2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019) (2019)

Proceedings Paper Computer Science, Information Systems

Small-footprint Spiking Neural Networks for Power-efficient Keyword Spotting

Bruno U. Pedroni, Sadique Sheik, Hesham Mostafa, Somnath Paul, Charles Augustine, Gert Cauwenberghs

2018 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS): ADVANCED SYSTEMS FOR ENHANCING HUMAN HEALTH (2018)

Proceedings Paper Computer Science, Information Systems

Unsupervised Synaptic Pruning Strategies for Restricted Boltzmann Machines

Surabhi Kalyan, Siddharth Joshi, Sadique Sheik, Bruno U. Pedroni, Gert Cauwenberghs

2018 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS): ADVANCED SYSTEMS FOR ENHANCING HUMAN HEALTH (2018)

Proceedings Paper Engineering, Electrical & Electronic

Spike Based Information Processing in Spiking Neural Networks

Sadique Sheik

PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON APPLICATIONS IN NONLINEAR DYNAMICS (ICAND 2016) (2017)

Proceedings Paper Engineering, Electrical & Electronic

Pipelined parallel contrastive divergence for continuous generative model learning

Bruno U. Pedroni, Sadique Sheik, Gert Cauwenberghs

2017 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) (2017)

Proceedings Paper Computer Science, Information Systems

Forward Table-Based Presynaptic Event-Triggered Spike-Timing-Dependent Plasticity

Bruno U. Pedroni, Sadique Sheik, Siddharth Joshi, Georgios Detorakis, Somnath Paul, Charles Augustine, Emre Neftci, Gert Cauwenberghs

PROCEEDINGS OF 2016 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS) (2016)

Proceedings Paper Computer Science, Information Systems

Membrane-Dependent Neuromorphic Learning Rule for Unsupervised Spike Pattern Detection

Sadique Sheik, Somnath Paul, Charles Augustine, Gert Cauwenberghs

PROCEEDINGS OF 2016 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS) (2016)

Proceedings Paper Engineering, Electrical & Electronic

Synaptic Sampling in Hardware Spiking Neural Networks

Sadique Sheik, Somnath Paul, Charles Augustine, Chinnikrishna Kothapalli, Muhammad M. Khellah, Gert Cauwenberghs, Emre Neftci

2016 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) (2016)

暂无数据