4.6 Article

A sharp upper bound for sampling numbers in L2

Journal

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS
Volume 63, Issue -, Pages 113-134

Publisher

ACADEMIC PRESS INC ELSEVIER SCIENCE
DOI: 10.1016/j.acha.2022.12.001

Keywords

L2-approximation; Information-based complexity; Least squares; Rate of convergence; Random matrices; Kadison-Singer

Ask authors/readers for more resources

This article discusses the sampling numbers of a class of complex-valued functions, which represent the minimal worst-case error that can be achieved with a recovery algorithm based on n function evaluations in the L2 norm. It is proven that for the unit ball of a separable reproducing kernel Hilbert space, there exists a constant c such that gcn(F)2 ≤ 1 E n k >= n dk(F)2, where dk(F) represents the Kolmogorov widths of F in L2. Similar upper bounds are also obtained for more general function classes, including compact subsets of the space of continuous functions on a bounded domain. Examples are provided to show the sharpness of these bounds by establishing the converse inequality. The results are built upon the solution to the Kadison-Singer problem, which is extended to the subsampling of a sum of infinite rank-one matrices.
For a class F of complex-valued functions on a set D, we denote by gn(F) its sampling numbers, i.e., the minimal worst-case error on F, measured in L2, that can be achieved with a recovery algorithm based on n function evaluations. We prove that there is a universal constant c is an element of N such that, if F is the unit ball of a separable reproducing kernel Hilbert space, then gcn(F)2 <= 1 E n k >= n dk(F )2, where dk(F) are the Kolmogorov widths (or approximation numbers) of F in L2. We also obtain similar upper bounds for more general classes F, including all compact subsets of the space of continuous functions on a bounded domain D subset of Rd, and show that these bounds are sharp by providing examples where the converse inequality holds up to a constant. The results rely on the solution to the Kadison-Singer problem, which we extend to the subsampling of a sum of infinite rank-one matrices. (c) 2022 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Mathematics

Optimal Monte Carlo Methods for L2-Approximation

David Krieg

CONSTRUCTIVE APPROXIMATION (2019)

Article Computer Science, Theory & Methods

Tensor power sequences and the approximation of tensor product operators

David Krieg

JOURNAL OF COMPLEXITY (2018)

Article Mathematics

Recovery algorithms for high-dimensional rank one tensors

David Krieg, Daniel Rudolf

JOURNAL OF APPROXIMATION THEORY (2019)

Article Computer Science, Theory & Methods

Uniform recovery of high-dimensional Cr-functions

David Krieg

JOURNAL OF COMPLEXITY (2019)

Article Computer Science, Theory & Methods

Expected dispersion of uniformly distributed points

Aicke Hinrichs, David Krieg, Robert J. Kunsch, Daniel Rudolf

JOURNAL OF COMPLEXITY (2020)

Article Computer Science, Theory & Methods

Function Values Are Enough for L2-Approximation

David Krieg, Mario Ullrich

Summary: The study examines the L-2-approximation of functions from a Hilbert space and compares the sampling numbers with the approximation numbers. It shows that the sampling numbers decay with the same polynomial rate as the approximation numbers, particularly for Sobolev spaces with dominating mixed smoothness. This result improves upon previous bounds and disproves the prevalent conjecture about the optimality of Smolyak's algorithm.

FOUNDATIONS OF COMPUTATIONAL MATHEMATICS (2021)

Article Computer Science, Theory & Methods

Lower bounds for the error of quadrature formulas for Hilbert spaces

Aicke Hinrichs, David Krieg, Erich Novak, Jan Vybiral

Summary: We investigate the lower bounds for the worst case error of quadrature formulas using given sample points, focusing on optimal point sets and independently and uniformly distributed points. By utilizing recent results on the positive semi-definiteness of certain matrices related to the product theorem of Schur by Vybiral, our new technique extends to spaces of analytic functions where traditional methods are not applicable.

JOURNAL OF COMPLEXITY (2021)

Article Computer Science, Theory & Methods

Function values are enough for L2-approximation: Part II

David Krieg, Mario Ullrich

Summary: In this paper, a similar result is proven for separable Banach spaces and other classes of functions in the worst-case setting for L-2 approximation. It shows that linear algorithms based on function values can achieve the same polynomial rate of convergence as arbitrary linear algorithms if the linear widths are square-summable.

JOURNAL OF COMPLEXITY (2021)

Article Mathematics

RANDOM SECTIONS OF ELLIPSOIDS AND THE POWER OF RANDOM INFORMATION

Aicke Hinrichs, David Krieg, Erich Novak, Joscha Prochno, Mario Ullrich

Summary: The study focuses on the circumradius of the intersection of random subspaces with an rn-dimensional ellipsoid, showing that the random radius R-n can be of the same order as the minimal radius under certain conditions. The research delves into the worst-case error of algorithms based on random information for function approximation, with implications in different scenarios depending on the characteristics of the random variable. Various mathematical tools such as Gaussian processes are utilized in the proofs and analysis.

TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY (2021)

Article Computer Science, Theory & Methods

Lower bounds for integration and recovery in L2

Aicke Hinrichs, David Krieg, Erich Novak, Jan Vybiral

Summary: Function values are almost as informative as general linear information for L2-approximation of functions, and this paper mainly focuses on proving new lower bounds for this behavior. It is shown that sampling numbers can behave worse than approximation numbers, especially for Sobolev spaces with low smoothness. Additionally, new lower bounds for the integration problem are proven.

JOURNAL OF COMPLEXITY (2022)

Article Mathematics, Applied

RECOVERY OF SOBOLEV FUNCTIONS RESTRICTED TO IID SAMPLING

David Krieg, Erich Novak, Mathias Sonnleitner

Summary: This paper studies Lq-approximation and integration for functions from the Sobolev space W-s (p) (Omega) and compares optimal randomized algorithms with algorithms that can only use identically distributed sample points. The main result is that the same optimal rate of convergence can be achieved if we restrict to identically distributed sampling, except when p = q = infinity.

MATHEMATICS OF COMPUTATION (2022)

Article Mathematics, Applied

Exponential tractability of L2-approximation with function values

David Krieg, Pawel Siedlecki, Mario Ullrich, Henryk Wozniakowski

Summary: In this paper, we study high-dimensional approximation and compare the power of function evaluations and arbitrary continuous linear measurements when different classes of information are available. We find that the number of linear measurements required for a given accuracy depends only on epsilon(-1) in a poly-logarithmic manner. It is shown that allowing only function evaluation instead of arbitrary linear information does not result in a significant loss and even allows for linear algorithms. Both types of available information satisfy several notions of tractability simultaneously.

ADVANCES IN COMPUTATIONAL MATHEMATICS (2023)

Article Mathematics, Applied

Random points are optimal for the approximation of Sobolev functions

David Krieg, Mathias Sonnleitner

Summary: We demonstrate that independent and uniformly distributed sampling points are almost as effective as optimal sampling points for approximating functions from Sobolev spaces on bounded convex domains in the Lq-norm if q < p. More generally, we characterize the quality of arbitrary sampling point sets via the L-? (O)-norm of the distance function dist(., P), where ? = s(1/q - 1/p)(-1) if q < p and ? = 8 if q = p. This improvement surpasses previous characterizations based on the covering radius of P.

IMA JOURNAL OF NUMERICAL ANALYSIS (2023)

Article Mathematics, Applied

New Lower Bounds for the Integration of Periodic Functions

David Krieg, Jan Vybiral

Summary: This paper focuses on the integration problem of periodic functions in Hilbert spaces, presenting a new technique that utilizes the Hilbert space structure and a variant of the Schur product theorem. The results obtained using this technique have proven to be superior to the traditional bump-function technique.

JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS (2023)

Article Mathematics, Applied

Learning ability of interpolating deep convolutional neural networks

Tian-Yi Zhou, Xiaoming Huo

Summary: This paper investigates the learning ability of deep convolutional neural networks (DCNNs) under both underparameterized and overparameterized settings. The study establishes the learning rates of underparameterized DCNNs without restrictions on parameter or function variable structure. Furthermore, it demonstrates that by adding well-defined layers to a non-interpolating DCNN, some interpolating DCNNs can maintain the good learning rates.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Image denoising based on a variable spatially exponent PDE

Amine Laghrib, Lekbir Afraites

Summary: This paper proposes a new PDE-based image denoising model that effectively deals with images contaminated by multiplicative noise. The model takes into account the gray level information by introducing a gray level indicator function in the diffusion coefficient, and has shown promising theoretical and numerical results.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

The metaplectic action on modulation spaces

Hartmut Fuehr, Irina Shafkulovska

Summary: In this article, we study the mapping properties of metaplectic operators on modulation spaces and provide a full characterization of the pairs for which the operator is well-defined and bounded. We also show that these two properties are equivalent and imply that the operator is a Banach space automorphism. Furthermore, we provide a simple criterion to determine the transferability of well-definedness and boundedness for polynomially bounded weight functions.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

On the intermediate value property of spectra for a class of Moran spectral measures

Jinjun Li, Zhiyi Wu

Summary: We prove that the Beurling dimensions of the spectra for a class of Moran spectral measures are between 0 and their upper entropy dimensions. Moreover, for such a Moran spectral measure, we show that the Beurling dimension for the spectra of the measure has the intermediate value property. Furthermore, we prove that the set of the spectra whose Beurling dimensions are equal to any fixed value in 0 and the upper entropy dimension has the cardinality of the continuum.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Time and band limiting for exceptional polynomials

M. M. Castro, F. A. Gruenbaum, I. Zurrian

Summary: This article introduces the existence of commuting differential operators for families of exceptional orthogonal polynomials, which can be found and exploited. The concept of Fourier Algebras is used, and the application of the result is illustrated through two examples.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

On the relation between Fourier and Walsh-Rademacher spectra for random fields

Anton Kutsenko, Sergey Danilov, Stephan Juricke, Marcel Oliver

Summary: This paper discusses the relations between the expansion coefficients of a discrete random field analyzed with different hierarchical bases. The focus is on comparing Walsh-Rademacher basis and trigonometric Fourier basis, and it is proven that the rate of spectral decay computed in one basis can be translated to the other in a statistical sense. Explicit expressions for this translation on quadrilateral meshes are provided, and numerical examples are used to illustrate the results.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

On generalizations of the nonwindowed scattering transform

Albert Chua, Matthew Hirn, Anna Little

Summary: In this paper, we generalize and study finite depth wavelet scattering transforms. We provide norms for these operators and prove their continuity and invariance under specific conditions.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Gradient descent for deep matrix factorization: Dynamics and implicit bias towards low rank

Hung-Hsu Chou, Carsten Gieshoff, Johannes Maly, Holger Rauhut

Summary: In deep learning, over-parameterization is commonly used and leads to implicit bias. This paper analyzes the dynamics of gradient descent and provides insights into implicit bias. The study also explores time intervals for early stopping and presents empirical evidence for implicit bias in various scenarios.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Metaplectic Gabor frames and symplectic analysis of time-frequency spaces

Elena Cordero, Gianluca Giacchi

Summary: This article introduces metaplectic Gabor frames as a natural extension of Gabor frames within the framework of metaplectic Wigner distributions. The authors develop the theory of metaplectic atoms and prove an inversion formula for metaplectic Wigner distributions on Rd. The discretization of this formula yields metaplectic Gabor frames. The study also reveals the relationship between shift-invertible metaplectic Wigner distributions and rescaled short-time Fourier transforms, providing a new characterization of modulation and Wiener amalgam spaces.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Diffusion maps for embedded manifolds with boundary with applications to PDEs

Ryan Vaughn, Tyrus Berry, Harbir Antil

Summary: In this paper, we propose a new method to solve elliptic and parabolic partial differential equations (PDEs) with boundary conditions using a finite collection of points sampled from a Riemannian manifold embedded in a Euclidean space. Unlike traditional methods that rely on triangulations, our approach defines quadrature formulas on the unknown manifold using only sample points. Our main result is the consistency of the variational diffusion maps graph Laplacian as an estimator of the Dirichlet energy on the manifold, which improves upon previous results and justifies the relationship between diffusion maps and the Neumann eigenvalue problem. Additionally, we derive the first uniform asymptotic expansion of the diffusion maps kernel integral operator for manifolds with boundary using semigeodesic coordinates. By combining various estimators, we demonstrate how to impose Dirichlet and Neumann conditions for common PDEs based on the Laplacian.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)

Article Mathematics, Applied

Spatiotemporal analysis using Riemannian composition of diffusion operators

Tal Shnitzer, Hau-Tieng Wu, Ronen Talmon

Summary: This paper proposes an operator-based approach for spatiotemporal analysis of multivariate time-series data. The approach combines manifold learning, Riemannian geometry, and spectral analysis techniques to extract different dynamic modes.

APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS (2024)