4.6 Article

ON THE ORACLE COMPLEXITY OF FIRST-ORDER AND DERIVATIVE-FREE ALGORITHMS FOR SMOOTH NONCONVEX MINIMIZATION

Journal

SIAM JOURNAL ON OPTIMIZATION
Volume 22, Issue 1, Pages 66-86

Publisher

SIAM PUBLICATIONS
DOI: 10.1137/100812276

Keywords

oracle complexity; worst-case analysis; finite differences; first-order methods; derivative-free optimization; nonconvex optimization

Funding

  1. EPSRC [EP/E053351/1]
  2. Royal Society [14265]
  3. Engineering and Physical Sciences Research Council [EP/I013067/1, EP/E053351/1] Funding Source: researchfish
  4. EPSRC [EP/I013067/1, EP/E053351/1] Funding Source: UKRI

Ask authors/readers for more resources

The (optimal) function/gradient evaluations worst-case complexity analysis available for the adaptive regularization algorithms with cubics (ARC) for nonconvex smooth unconstrained optimization is extended to finite-difference versions of this algorithm, yielding complexity bounds for first-order and derivative-free methods applied on the same problem class. A comparison with the results obtained for derivative-free methods by Vicente [Worst Case Complexity of Direct Search, Technical report, Preprint 10-17, Department of Mathematics, University of Coimbra, Coimbra, Portugal, 2010] is also discussed, giving some theoretical insight into the relative merits of various methods in this popular class of algorithms.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available