4.6 Article

Objective reduction based on nonlinear correlation information entropy

期刊

SOFT COMPUTING
卷 20, 期 6, 页码 2393-2407

出版社

SPRINGER
DOI: 10.1007/s00500-015-1648-y

关键词

Multi-objective optimization; Objective reduction; Nonlinear correlation information entropy; Multi-objective evolutionary algorithm; Dimension reduction

资金

  1. National Basic Research Program (973 Program) of China [2013CB329402]
  2. EU FP7 IRSES Grant on Nature Inspired Computation and its Applications (NICaiA) [247619]
  3. EPSRC grant on DAASE: Dynamic Adaptive Automated Software Engineering [EP/J017515/1]
  4. Program for Cheung Kong Scholars and Innovative Research Team in University [IRT1170]
  5. National Natural Science Foundation of China [61329302]
  6. National Science Foundation of China [91438103, 91438201]
  7. Fund for Foreign Scholars in University Research and Teaching Programs (the 111 Project) [B07048]
  8. Royal Society Wolfson Research Merit Award
  9. EPSRC [EP/J017515/1] Funding Source: UKRI
  10. Engineering and Physical Sciences Research Council [EP/J017515/1] Funding Source: researchfish

向作者/读者索取更多资源

It is hard to obtain the entire solution set of a many-objective optimization problem (MaOP) by multi-objective evolutionary algorithms (MOEAs) because of the difficulties brought by the large number of objectives. However, the redundancy of objectives exists in some problems with correlated objectives (linearly or nonlinearly). Objective reduction can be used to decrease the difficulties of some MaOPs. In this paper, we propose a novel objective reduction approach based on nonlinear correlation information entropy (NCIE). It uses the NCIE matrix to measure the linear and nonlinear correlation between objectives and a simple method to select the most conflicting objectives during the execution of MOEAs. We embed our approach into both Pareto-based and indicator-based MOEAs to analyze the impact of our reduction method on the performance of these algorithms. The results show that our approach significantly improves the performance of Pareto-based MOEAs on both reducible and irreducible MaOPs, but does not much help the performance of indicator-based MOEAs.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

An Approximated Gradient Sign Method Using Differential Evolution for Black-Box Adversarial Attack

Chao Li, Handing Wang, Jun Zhang, Wen Yao, Tingsong Jiang

Summary: This article discusses the adversarial attack problem faced by deep neural networks and the limitations of existing solutions. An approximated gradient sign method using differential evolution is proposed to solve the black-box adversarial attack problem. By transforming the pixel-based decision space into a dimension-reduced decision space and introducing different neighbor selection and optimization search strategies, multiple variants of the proposed method are developed. Experimental results demonstrate the superior performance of the method in solving black-box adversarial attack problems.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2022)

Article Computer Science, Artificial Intelligence

A framework for expensive many-objective optimization with Pareto-based bi-indicator infill sampling criterion

Zhenshou Song, Handing Wang, Hongbin Xu

Summary: This paper proposes a generic framework for expensive many-objective optimization using a Pareto-based bi-indicator infill sampling criterion. Empirical studies demonstrate the effectiveness and superiority of this framework and the incorporated algorithm in handling DTLZ problems with more than three objectives.

MEMETIC COMPUTING (2022)

Article Computer Science, Artificial Intelligence

An adaptive model switch-based surrogate-assisted evolutionary algorithm for noisy expensive multi-objective optimization

Nan Zheng, Handing Wang, Bo Yuan

Summary: This paper proposes an adaptive model switch-based surrogate-assisted evolutionary algorithm, which utilizes radial basis function networks for denoising and adaptively selects sampling strategies based on maximizing the improvement in convergence, diversity, and approximation uncertainty to address noisy and expensive multi-objective optimization problems. The experimental results demonstrate that the proposed algorithm outperforms the five most advanced surrogate-assisted evolutionary algorithms.

COMPLEX & INTELLIGENT SYSTEMS (2022)

Editorial Material Computer Science, Artificial Intelligence

Evolutionary optimization of large complex problems

Handing Wang, Chaoli Sun, Jinliang Ding, Yew-soon Ong

COMPLEX & INTELLIGENT SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Surrogate-assisted hybrid evolutionary algorithm with local estimation of distribution for expensive mixed-variable optimization problems

Yongcun Liu, Handing Wang

Summary: This study proposes a novel algorithm that combines global and local search strategies to address the challenge of multiple disconnected regions in the search space. The algorithm achieves competitive results with only hundreds of function evaluations and can handle mixed-variable optimization problems. The global module uses hybrid evolutionary operators and a Gower distance based surrogate model, while the local module performs competitive switching in different local regions and improves evaluation accuracy with local surrogate models. The algorithm is demonstrated to be effective through artificial benchmark tests and convolutional neural network hyperparameter optimization problems.

APPLIED SOFT COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Adaptive momentum variance for attention-guided sparse adversarial attacks

Chao Li, Wen Yao, Handing Wang, Tingsong Jiang

Summary: It has been found that deep neural networks are vulnerable to adversarial examples for several years. Existing transfer-based methods have weak transferability for black-box models and sparse attacks mainly focus on the number of attacked pixels without restricting the size of perturbations. To address these issues, this study proposes a transfer-based sparse attack method that improves transferability through adaptive momentum variance and refining perturbation mechanism, and uses a class activation map to explore the relationship between the number of perturbed pixels and attack performance.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

Surrogate-assisted evolutionary neural architecture search with network embedding

Liang Fan, Handing Wang

Summary: To accelerate performance estimation in neural architecture search, a surrogate-assisted evolutionary algorithm with network embedding (SAENAS-NE) is proposed. Unsupervised learning generates meaningful representation for each architecture, making architecture with similar structures closer in the embedding space, benefiting surrogate model training. A new environmental selection based on reference population and an infill criterion for balancing convergence and model uncertainty are introduced. Experimental results demonstrate the superiority of SAENAS-NE over other state-of-the-art algorithms.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Cooperative Coevolutionary CMA-ES With Landscape-Aware Grouping in Noisy Environments

Yapei Wu, Xingguang Peng, Handing Wang, Yaochu Jin, Demin Xu

Summary: Many real-world optimization tasks suffer from noise, but current research on noise-tolerant algorithms is limited to low-dimensional problems. This article proposes a landscape-aware grouping method for cooperative coevolutionary algorithms to solve high-dimensional problems under noisy environments. Experimental results show that the proposed method is able to effectively identify interactive decision variables in the presence of noise.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Surrogate-assisted multi-objective optimization via knee-oriented Pareto front estimation

Junfeng Tang, Handing Wang, Lin Xiong

Summary: In preference-based multi-objective optimization, knee solutions are the implicit preferred promising solutions. However, finding knee solutions is difficult and computationally expensive. To address this issue, we propose a surrogate-assisted evolutionary multi-objective optimization algorithm that uses surrogate models to replace expensive evaluations. Experimental results show that our proposed algorithm outperforms state-of-the-art knee identification evolutionary algorithms on most test problems within a limited computational budget.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

A two-stage evolutionary algorithm for noisy bi-objective optimization

Nan Zheng, Handing Wang

Summary: For noisy bi-objective optimization problems, the algorithm is affected differently by noise in different stages of optimization. The proposed adaptive switch strategy enables the algorithm to adaptively switch among different noise treatments based on the noise impact. Additionally, data selection and model performance estimation methods are employed to enhance the denoising process, and reliable non-dominated solutions are selected as the final output. Experimental results demonstrate that the proposed algorithm is highly competitive for solving noisy bi-objective optimization problems.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Bayesian evolutionary optimization for crafting high-quality adversarial examples with limited query budget

Chao Li, Wen Yao, Handing Wang, Tingsong Jiang, Xiaoya Zhang

Summary: Due to the importance of security, adversarial attacks in deep learning, especially the black-box adversarial attack, which mimics real-world scenarios, have gained popularity. Query-based methods are commonly used for black-box attacks but suffer from needing excessive queries. To overcome this, a Bayesian evolutionary optimization (BEO) based black-box attack method using differential evolution is proposed, employing Gaussian processes model and adaptive acquisition functions. Experimental results show that this method can effectively generate high-quality adversarial examples using only 200 queries.

APPLIED SOFT COMPUTING (2023)

Article Automation & Control Systems

Performance Indicator-Based Adaptive Model Selection for Offline Data-Driven Multiobjective Evolutionary Optimization

Zhening Liu, Handing Wang, Yaochu Jin

Summary: Offline data-driven multiobjective optimization problems are common in practice. To address the issue of error accumulation when using surrogate models for optimization, a new surrogate-assisted indicator-based evolutionary algorithm is proposed. This algorithm can select the appropriate type of surrogate models based on the error, and it performs well in practical problems.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

A Surrogate-Assisted Evolutionary Framework With Regions of Interests-Based Data Selection for Expensive Constrained Optimization

Zhenshou Song, Handing Wang, Yaochu Jin

Summary: Expensive constrained optimization problems can be solved by evolutionary algorithms in conjunction with computationally cheap surrogates. However, existing methods neglect the differences between different surrogate models, resulting in unsatisfactory performance.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

An online surrogate-assisted neighborhood search algorithm based on deep neural network for thermal layout optimization

Jiliang Zhao, Handing Wang, Wen Yao, Wei Peng, Zhiqiang Gong

Summary: Thermal layout optimization problems are common in integrated circuit design, where optimizing the positions of electronic components is essential for achieving low temperatures. Surrogate models are used to reduce evaluation costs, but they often have large prediction errors in discrete decision spaces such as thermal layout problems. A deep neural network is proposed in this work to better approximate the relation between layout schemes and temperature fields, leading to an online deep surrogate-assisted optimization algorithm that effectively manages parameters for improved performance within limited computational budgets.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Evolutionary auto-design for aircraft engine cycle

Xudong Feng, Zhening Liu, Feng Wu, Handing Wang

Summary: Traditional engine cycle innovation is limited by human experiences, imagination, and currently available engine component performance expectations. In this study, a mixed variable multi-objective evolutionary optimization method is proposed for automatic engine cycle design. Through experimental research, new engine cycle solutions have been discovered that surpass the performance of known turbojet and turbofan engines.

COMPLEX & INTELLIGENT SYSTEMS (2023)

暂无数据