期刊
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS
卷 48, 期 2, 页码 787-794出版社
ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.acha.2019.06.004
关键词
Deep learning; Convolutional neural network; Universality; Approximation theory
资金
- Research Grants Council of Hong Kong [11303915]
- National Nature Science Foundation of China [11461161006]
Deep learning has been widely applied and brought breakthroughs in speech recognition, computer vision, and many other domains. Deep neural network architectures and computational issues have been well studied in machine learning. But there lacks a theoretical foundation for understanding the approximation or generalization ability of deep learning methods generated by the network architectures such as deep convolutional neural networks. Here we show that a deep convolutional neural network (CNN) is universal, meaning that it can be used to approximate any continuous function to an arbitrary accuracy when the depth of the neural network is large enough. This answers an open question in learning theory. Our quantitative estimate, given tightly in terms of the number of free parameters to be computed, verifies the efficiency of deep CNNs in dealing with large dimensional data. Our study also demonstrates the role of convolutions in deep CNNs. (C) 2019 Elsevier Inc. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据