A survey on modern trainable activation functions

A simple and efficient architecture for trainable activation functions

(2019) Andrea Apicella et al.   NEUROCOMPUTING

Learning with Type-2 Fuzzy activation functions to improve the performance of Deep Neural Networks

(2019) Aykut Beke et al.   ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE

Sigmoid-weighted linear units for neural network function approximation in reinforcement learning

(2018) Stefan Elfwing et al.   NEURAL NETWORKS

A novel type of activation function in artificial neural networks: Trained activation function

(2018) Ömer Faruk Ertuğrul   NEURAL NETWORKS

Adaptive activation functions in convolutional neural networks

(2018) Sheng Qian et al.   NEUROCOMPUTING

Improving deep neural networks with multi-layer maxout networks and a novel initialization method

(2018) Weichen Sun et al.   NEUROCOMPUTING

Convolution in Convolution for Network in Network

(2018) Yanwei Pang et al.   IEEE Transactions on Neural Networks and Learning Systems

A comparison of deep networks with ReLU activation function and linear spline-type methods

(2018) Konstantin Eckle et al.   NEURAL NETWORKS

Kafnets: Kernel-based non-parametric activation functions for neural networks

(2018) Simone Scardapane et al.   NEURAL NETWORKS

A novel activation function for multilayer feed-forward neural networks

(2016) Aboubakar Nasser Samatin Njikam et al.   APPLIED INTELLIGENCE

ImageNet Large Scale Visual Recognition Challenge

(2015) Olga Russakovsky et al.   INTERNATIONAL JOURNAL OF COMPUTER VISION

A linear approach for sparse coding by a two-layer neural network

(2015) Alessandro Montalto et al.   NEUROCOMPUTING

Enhanced Higgs Boson toτ+τ−Search with Deep Learning

(2015) P. Baldi et al.   PHYSICAL REVIEW LETTERS

What are Extreme Learning Machines? Filling the Gap Between Frank Rosenblatt’s Dream and John von Neumann’s Puzzle

(2015) Guang-Bin Huang   Cognitive Computation

Searching for exotic particles in high-energy physics with deep learning

(2014) P. Baldi et al.   Nature Communications

Local minima in hierarchical structures of complex-valued neural networks

(2013) Tohru Nitta   NEURAL NETWORKS