Entropy and mutual information in models of deep neural networks

Optimal errors and phase transitions in high-dimensional generalized linear models

(2019) Jean Barbier et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA

Information Dropout: Learning Optimal Representations Through Noisy Computation

(2018) Alessandro Achille et al.   IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

The adaptive interpolation method: a simple scheme to prove replica formulas in Bayesian inference

(2018) Jean Barbier et al.   PROBABILITY THEORY AND RELATED FIELDS

Estimating Mixture Entropy with Pairwise Distances

(2017) Artemy Kolchinsky et al.   Entropy

Statistical physics of inference: thresholds and algorithms

(2016) Lenka Zdeborová et al.   ADVANCES IN PHYSICS

Deep Neural Networks with Random Gaussian Weights: A Universal Classification Strategy?

(2016) Raja Giryes et al.   IEEE TRANSACTIONS ON SIGNAL PROCESSING

High dimensional robust M-estimation: asymptotic variance via approximate message passing

(2015) David Donoho et al.   PROBABILITY THEORY AND RELATED FIELDS

Support Recovery With Sparsely Sampled Free Random Matrices

(2013) Antonia M. Tulino et al.   IEEE TRANSACTIONS ON INFORMATION THEORY

Message-passing algorithms for compressed sensing

(2009) David L. Donoho et al.   PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA