4.4 Article

A framework for expensive many-objective optimization with Pareto-based bi-indicator infill sampling criterion

期刊

MEMETIC COMPUTING
卷 14, 期 2, 页码 179-191

出版社

SPRINGER HEIDELBERG
DOI: 10.1007/s12293-021-00351-8

关键词

Pareto-based bi-indicatior infill sampling criterion; Surrogate-assisted evolutionary algorithm; Expensive many-objective optimization

资金

  1. National Natural Science Foundation of China [61976165]
  2. Fundamental Research Funds for the Central Universities

向作者/读者索取更多资源

This paper proposes a generic framework for expensive many-objective optimization using a Pareto-based bi-indicator infill sampling criterion. Empirical studies demonstrate the effectiveness and superiority of this framework and the incorporated algorithm in handling DTLZ problems with more than three objectives.
Surrogate-assisted many-objective optimization is to locate Pareto optimal solutions using a limited number of function evaluations. Most existing surrogate-assisted evolutionary algorithms are designed to embed in a specific many-objective evolutionary algorithm. The Pareto-based bi-indicator infill sampling criterion has been proven to be effective in saving expensive evaluations in surrogate-assisted multi-objective evolutionary algorithms. It introduces two indicators measuring the convergence and diversity as two optimization objectives. In this paper, we extend our previous work to propose a generic framework with a Pareto-based bi-indicator infill sampling criterion for expensive many-objective optimization. The proposed framework gives a general method for traditional MOEAs to solve the expensive optimization task. We incorporate the proposed framework into the reference vectors guided evolutionary algorithm and compare it with another surrogate-assisted reference vectors guided evolutionary algorithm. Empirical studies on DTLZ problems with more than three objectives demonstrate the effectiveness and superiority of the proposed framework and the incorporated algorithm.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.4
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

A Surrogate-Assisted Evolutionary Feature Selection Algorithm With Parallel Random Grouping for High-Dimensional Classification

Shulei Liu, Handing Wang, Wei Peng, Wen Yao

Summary: This study proposes a surrogate-assisted evolutionary algorithm (SAEA) for expensive feature selection problems. By employing parallel random grouping and a constraint-based sampling strategy, the algorithm effectively optimizes high-dimensional discrete decision variables. Experimental results demonstrate that the proposed algorithm outperforms traditional and ensemble feature selection methods on multiple datasets.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2022)

Article Computer Science, Artificial Intelligence

A surrogate-assisted evolutionary algorithm with hypervolume triggered fidelity adjustment for noisy multiobjective integer programming

Shulei Liu, Handing Wang, Wen Yao

Summary: This paper proposes a novel surrogate-assisted evolutionary algorithm (SAEA) for addressing computationally expensive and noisy combinatorial multi-objective optimization problems. The algorithm uses an averaging method for denoising and constructs multi-fidelity surrogate models based on averaged evaluation results. The fidelity level of surrogate models is determined by the number of independent repeated evaluations. The hypervolume indicator is employed as a trigger to increase the fidelity level during the optimization process. Additionally, a lightweight local search method, the semi-variable neighborhood search, is proposed to enhance global search efficiency in discrete decision spaces.

APPLIED SOFT COMPUTING (2022)

Article Computer Science, Artificial Intelligence

Surrogate-assisted hybrid evolutionary algorithm with local estimation of distribution for expensive mixed-variable optimization problems

Yongcun Liu, Handing Wang

Summary: This study proposes a novel algorithm that combines global and local search strategies to address the challenge of multiple disconnected regions in the search space. The algorithm achieves competitive results with only hundreds of function evaluations and can handle mixed-variable optimization problems. The global module uses hybrid evolutionary operators and a Gower distance based surrogate model, while the local module performs competitive switching in different local regions and improves evaluation accuracy with local surrogate models. The algorithm is demonstrated to be effective through artificial benchmark tests and convolutional neural network hyperparameter optimization problems.

APPLIED SOFT COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Adaptive momentum variance for attention-guided sparse adversarial attacks

Chao Li, Wen Yao, Handing Wang, Tingsong Jiang

Summary: It has been found that deep neural networks are vulnerable to adversarial examples for several years. Existing transfer-based methods have weak transferability for black-box models and sparse attacks mainly focus on the number of attacked pixels without restricting the size of perturbations. To address these issues, this study proposes a transfer-based sparse attack method that improves transferability through adaptive momentum variance and refining perturbation mechanism, and uses a class activation map to explore the relationship between the number of perturbed pixels and attack performance.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

A data augmentation based Kriging-assisted reference vector guided evolutionary algorithm for expensive dynamic multi-objective optimization

Zhening Liu, Handing Wang

Summary: This paper proposes two strategies (training data augmentation and sampling pool expansion) to be incorporated in the Kriging-assisted reference vector guided evolutionary algorithm, aiming to solve expensive dynamic multi-objective optimization problems. The experiment results validate the effectiveness of these two strategies and show promising potential for the proposed algorithm in solving EXDMOPs.

SWARM AND EVOLUTIONARY COMPUTATION (2022)

Article Computer Science, Artificial Intelligence

Surrogate-assisted evolutionary neural architecture search with network embedding

Liang Fan, Handing Wang

Summary: To accelerate performance estimation in neural architecture search, a surrogate-assisted evolutionary algorithm with network embedding (SAENAS-NE) is proposed. Unsupervised learning generates meaningful representation for each architecture, making architecture with similar structures closer in the embedding space, benefiting surrogate model training. A new environmental selection based on reference population and an infill criterion for balancing convergence and model uncertainty are introduced. Experimental results demonstrate the superiority of SAENAS-NE over other state-of-the-art algorithms.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Cooperative Coevolutionary CMA-ES With Landscape-Aware Grouping in Noisy Environments

Yapei Wu, Xingguang Peng, Handing Wang, Yaochu Jin, Demin Xu

Summary: Many real-world optimization tasks suffer from noise, but current research on noise-tolerant algorithms is limited to low-dimensional problems. This article proposes a landscape-aware grouping method for cooperative coevolutionary algorithms to solve high-dimensional problems under noisy environments. Experimental results show that the proposed method is able to effectively identify interactive decision variables in the presence of noise.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Surrogate-assisted multi-objective optimization via knee-oriented Pareto front estimation

Junfeng Tang, Handing Wang, Lin Xiong

Summary: In preference-based multi-objective optimization, knee solutions are the implicit preferred promising solutions. However, finding knee solutions is difficult and computationally expensive. To address this issue, we propose a surrogate-assisted evolutionary multi-objective optimization algorithm that uses surrogate models to replace expensive evaluations. Experimental results show that our proposed algorithm outperforms state-of-the-art knee identification evolutionary algorithms on most test problems within a limited computational budget.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

A two-stage evolutionary algorithm for noisy bi-objective optimization

Nan Zheng, Handing Wang

Summary: For noisy bi-objective optimization problems, the algorithm is affected differently by noise in different stages of optimization. The proposed adaptive switch strategy enables the algorithm to adaptively switch among different noise treatments based on the noise impact. Additionally, data selection and model performance estimation methods are employed to enhance the denoising process, and reliable non-dominated solutions are selected as the final output. Experimental results demonstrate that the proposed algorithm is highly competitive for solving noisy bi-objective optimization problems.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Bayesian evolutionary optimization for crafting high-quality adversarial examples with limited query budget

Chao Li, Wen Yao, Handing Wang, Tingsong Jiang, Xiaoya Zhang

Summary: Due to the importance of security, adversarial attacks in deep learning, especially the black-box adversarial attack, which mimics real-world scenarios, have gained popularity. Query-based methods are commonly used for black-box attacks but suffer from needing excessive queries. To overcome this, a Bayesian evolutionary optimization (BEO) based black-box attack method using differential evolution is proposed, employing Gaussian processes model and adaptive acquisition functions. Experimental results show that this method can effectively generate high-quality adversarial examples using only 200 queries.

APPLIED SOFT COMPUTING (2023)

Article Automation & Control Systems

Performance Indicator-Based Adaptive Model Selection for Offline Data-Driven Multiobjective Evolutionary Optimization

Zhening Liu, Handing Wang, Yaochu Jin

Summary: Offline data-driven multiobjective optimization problems are common in practice. To address the issue of error accumulation when using surrogate models for optimization, a new surrogate-assisted indicator-based evolutionary algorithm is proposed. This algorithm can select the appropriate type of surrogate models based on the error, and it performs well in practical problems.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

A Surrogate-Assisted Evolutionary Framework With Regions of Interests-Based Data Selection for Expensive Constrained Optimization

Zhenshou Song, Handing Wang, Yaochu Jin

Summary: Expensive constrained optimization problems can be solved by evolutionary algorithms in conjunction with computationally cheap surrogates. However, existing methods neglect the differences between different surrogate models, resulting in unsatisfactory performance.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

An online surrogate-assisted neighborhood search algorithm based on deep neural network for thermal layout optimization

Jiliang Zhao, Handing Wang, Wen Yao, Wei Peng, Zhiqiang Gong

Summary: Thermal layout optimization problems are common in integrated circuit design, where optimizing the positions of electronic components is essential for achieving low temperatures. Surrogate models are used to reduce evaluation costs, but they often have large prediction errors in discrete decision spaces such as thermal layout problems. A deep neural network is proposed in this work to better approximate the relation between layout schemes and temperature fields, leading to an online deep surrogate-assisted optimization algorithm that effectively manages parameters for improved performance within limited computational budgets.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Evolutionary auto-design for aircraft engine cycle

Xudong Feng, Zhening Liu, Feng Wu, Handing Wang

Summary: Traditional engine cycle innovation is limited by human experiences, imagination, and currently available engine component performance expectations. In this study, a mixed variable multi-objective evolutionary optimization method is proposed for automatic engine cycle design. Through experimental research, new engine cycle solutions have been discovered that surpass the performance of known turbojet and turbofan engines.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Engineering, Aerospace

A Surrogate-Assisted Evolutionary Algorithm for Space Component Thermal Layout Optimization

Lei Han, Handing Wang, Shuo Wang

Summary: The study proposes a surrogate-assisted evolutionary algorithm that can find the optimal solution in expensive electronic component layout optimization problems. By combining local search and global search, and designing a restart strategy, the algorithm converges to the optimal solution more quickly.

SPACE: SCIENCE & TECHNOLOGY (2022)

暂无数据