Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

Automated Benchmark-Driven Design and Explanation of Hyperparameter Optimizers

(2022) Julia Moosbauer et al.   IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION

Auto-Pytorch: Multi-Fidelity MetaLearning for Efficient and Robust AutoDL

(2021) Lucas Zimmer et al.   IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

A Comparison of Optimization Algorithms for Deep Learning

(2020) Derya Soydaner   INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE

COCO: a platform for comparing continuous optimizers in a black-box setting

(2020) Nikolaus Hansen et al.   OPTIMIZATION METHODS & SOFTWARE

A survey on hyperparameters optimization algorithms of forecasting models in smart grid

(2020) Rabiya Khalid et al.   Sustainable Cities and Society

General-purpose hierarchical optimisation of machine learning pipelines with grammatical evolution

(2020) Suilan Estevez-Velarde et al.   INFORMATION SCIENCES

AutoML: A survey of the state-of-the-art

(2020) Xin He et al.   KNOWLEDGE-BASED SYSTEMS

Pitfalls and Best Practices in Algorithm Configuration

(2019) Katharina Eggensperger et al.   JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH

Dealing with categorical and integer-valued variables in Bayesian Optimization with Gaussian processes

(2019) Eduardo C. Garrido-Merchán et al.   NEUROCOMPUTING

A note on the validity of cross-validation for evaluating autoregressive time series prediction

(2018) Christoph Bergmeir et al.   COMPUTATIONAL STATISTICS & DATA ANALYSIS

ML-Plan: Automated machine learning via hierarchical planning

(2018) Felix Mohr et al.   MACHINE LEARNING

SATzilla: Portfolio-based Algorithm Selection for SAT

(2018) L. Xu et al.   JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH

ParamILS: An Automatic Algorithm Configuration Framework

(2018) F. Hutter et al.   JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH

Comparison of Kriging-based algorithms for simulation optimization with heterogeneous noise

(2017) Hamed Jalali et al.   EUROPEAN JOURNAL OF OPERATIONAL RESEARCH

ASlib: A benchmark library for algorithm selection

(2016) Bernd Bischl et al.   ARTIFICIAL INTELLIGENCE

A parameterized lower confidence bounding scheme for adaptive metamodel-based design optimization

(2016) Jun Zheng et al.   ENGINEERING COMPUTATIONS

Bayesian Optimization in a Billion Dimensions via Random Embeddings

(2016) Ziyu Wang et al.   JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH

A measure of the impact of CV incompleteness on prediction error estimation with application to PCA and normalization

(2015) Roman Hornung et al.   BMC Medical Research Methodology

Building Predictive Models inRUsing thecaretPackage

(2015) Max Kuhn   Journal of Statistical Software

Genetic Optimization Using Derivatives: ThergenoudPackage forR

(2015) Walter R. Mebane et al.   Journal of Statistical Software

DEoptim: AnRPackage for Global Optimization by Differential Evolution

(2015) Katharine Mullen et al.   Journal of Statistical Software

DiceKriging,DiceOptim: TwoRPackages for the Analysis of Computer Experiments by Kriging-Based Metamodeling and Optimization

(2015) Olivier Roustant et al.   Journal of Statistical Software

Automatic model selection for high-dimensional survival analysis

(2014) M. Lang et al.   JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION

A benchmark of kriging-based infill criteria for noisy optimization

(2013) Victor Picheny et al.   STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION

Resampling Methods for Meta-Model Validation with Recommendations for Evolutionary Computation

(2012) B. Bischl et al.   EVOLUTIONARY COMPUTATION

Optimally splitting cases for training and testing high dimensional classifiers

(2011) Kevin K Dobbin et al.   BMC Medical Genomics

Mixed Integer Evolution Strategies for Parameter Optimization

(2011) Rui Li et al.   EVOLUTIONARY COMPUTATION

The Correlated Knowledge Gradient for Simulation Optimization of Continuous Parameters using Gaussian Process Regression

(2011) Warren Scott et al.   SIAM JOURNAL ON OPTIMIZATION

Standard errors for bagged and random forest estimators

(2008) Joseph Sexton et al.   COMPUTATIONAL STATISTICS & DATA ANALYSIS