4.7 Article

Surrogate-Assisted Multipopulation Particle Swarm Optimizer for High-Dimensional Expensive Optimization

期刊

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TSMC.2021.3102298

关键词

Optimization; Particle swarm optimization; Iron; Adaptation models; Maintenance engineering; Statistics; Sociology; High-dimensional expensive optimization; multipopulation particle swarm optimizer (PSO); surrogate-assisted evolutionary algorithm (SAEA)

资金

  1. National Natural Science Foundation of China [61773106]

向作者/读者索取更多资源

This paper proposes a novel surrogate-assisted evolutionary algorithm (SAEA) for high-dimensional expensive optimization. The algorithm uses affinity propagation clustering to generate multiple subswarms and employs a surrogate-assisted learning strategy to guide the search. Techniques such as model management, subswarm diversity maintenance, and surrogate-based local search are introduced to enhance exploration and exploitation. Experimental results demonstrate the superiority of the proposed algorithm over state-of-the-art methods.
Surrogate-assisted evolutionary algorithms (SAEAs) are well suited for computationally expensive optimization. However, most existing SAEAs only focus on low- or medium-dimensional expensive optimization. Thus, a novel SAEA for high-dimensional expensive optimization, denoted as surrogate-assisted multipopulation particle swarm optimizer (SA-MPSO), is proposed and fully investigated in this work. The proposed algorithm employs a parameter-free clustering technique, denoted as affinity propagation clustering, to generate several subswarms. A surrogate-assisted learning strategy-based particle swarm optimizer is proposed for guiding the search of each subswarm. Furthermore, a model management strategy is adapted to choose the promising particles for real fitness evaluations. Finally, a subswarm diversity maintenance scheme and a surrogate-based trust region local search technique are introduced to enhance both exploration and exploitation. The experimental results on commonly used benchmark test problems with dimensions varying from 30 to 100 and airfoil design problem have shown that SA-MPSO outperforms some state-of-the-art methods.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Deep learning based brain tumor segmentation: a survey

Zhihua Liu, Lei Tong, Long Chen, Zheheng Jiang, Feixiang Zhou, Qianni Zhang, Xiangrong Zhang, Yaochu Jin, Huiyu Zhou

Summary: Brain tumor segmentation is a challenging problem in medical image analysis, and deep learning methods have shown promising results in this field. This survey provides a comprehensive study of recently developed deep learning techniques for brain tumor segmentation, covering technical aspects such as network architecture design, segmentation under imbalanced conditions, and multi-modality processes. It also offers insightful discussions for future development directions.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

An environment-driven hybrid evolutionary algorithm for dynamic multi-objective optimization problems

Meirong Chen, Yinan Guo, Yaochu Jin, Shengxiang Yang, Dunwei Gong, Zekuan Yu

Summary: This study proposes an environment-driven hybrid dynamic multi-objective evolutionary optimization method to balance the quality of obtained solutions and the computation cost, and select an appropriate optimization method based on the characteristics of the dynamic environment.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Theory & Methods

Recent Advances in Bayesian Optimization

Xilu Wang, Yaochu Jin, Sebastian Schmitt, Markus Olhofer

Summary: This article provides a comprehensive survey of recent advances in Bayesian optimization based on Gaussian processes. It categorizes the existing work into nine main groups and discusses the open questions and promising future research directions in the field.

ACM COMPUTING SURVEYS (2023)

Editorial Material Computer Science, Artificial Intelligence

Guest editorial: Robust, explainable, and privacy-preserving deep learning

Nian Zhang, Zhigang Zeng, Yaochu Jin

Summary: This special issue presents robust, explainable, and efficient next-generation deep learning algorithms with data privacy and theoretical guarantees to improve the understanding and explainability of deep neural networks; improve the accuracy of deep learning leveraging new stochastic optimization and neural architecture search; and increase the computational efficiency and stability of the deep learning training process with new algorithms that will scale.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

An adaptive Gaussian process based manifold transfer learning to expensive dynamic multi-objective optimization

Xi Zhang, Guo Yu, Yaochu Jin, Feng Qian

Summary: This paper proposes a transfer learning based surrogate assisted evolutionary algorithm (TrSA-DMOEA) to efficiently solve expensive dynamic multi-objective optimization problems (EDMOPs). By utilizing the knowledge from previous high-quality solutions, Gaussian process models are built to improve the computational complexity and solution quality. Furthermore, an adaptive acquisition function based surrogate-assisted mechanism is introduced to balance convergence and diversity. Experimental results demonstrate the superiority of the proposed method in solving EDMOPs.

NEUROCOMPUTING (2023)

Article Computer Science, Information Systems

A Self-Organizing IoT Service Perception Algorithm Based on Human Visual Direction-Sensitive System

Zhen Yang, Jie Zhang, Yunliang Jiang, Yaochu Jin

Summary: This article proposes an intelligent directional sensitivity-based perception algorithm (DSPA) for the IoT service. The perception range of each node is divided into multiple regions, and the perception direction is represented by an arrow. Inspired by the human visual direction-sensitive system, the DSPA optimizes the perception direction and prevents getting stuck in local optimums with the help of region weight. Simulation results show that DSPA achieves better energy maintenance and faster perception rate compared to other algorithms.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Computer Science, Artificial Intelligence

A Surrogate-Assisted Two-Stage Differential Evolution for Expensive Constrained Optimization

Yuanchao Liu, Jianchang Liu, Yaochu Jin, Fei Li, Tianzi Zheng

Summary: This work proposes a novel surrogate-assisted two-stage differential evolution (SA-TSDE) algorithm for expensive constrained optimization. It combines a hybrid differential evolution with a repair strategy in the first stage, and a clustering strategy with local surrogates in the second stage. Experimental results show that SA-TSDE is highly competitive compared with state-of-the-art methods.

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

An adaptive n-gram transformer for multi-scale scene text recognition

Xueming Yan, Zhihang Fang, Yaochu Jin

Summary: This paper proposes an adaptive n-gram transformer, ANT-STR, for multi-scale scene text recognition. ANT-STR leverages adaptive n-gram embedding and patch-based n-gram attention mechanism to extract and process features from multi-scale texts. It also rectifies the loss function to consider both character-based identification and contextual coherence. Experimental results demonstrate the considerable superiority of ANT-STR in handling complex multi-scale scene texts.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Optimized compressed sensing for communication efficient federated learning

Leming Wu, Yaochu Jin, Kuangrong Hao

Summary: This work proposes an enhanced compressed sensing federated learning algorithm that reduces communication resources by compressing and reconstructing local network models trained on clients using compressed sensing. It optimizes the measurement matrix in compressed sensing using a genetic algorithm to enhance the accuracy of reconstructed models. Additionally, an interleaving training and reconstruction method is suggested to improve the learning performance of compressed models in federated learning.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Automation & Control Systems

Decomposition-Based Multiobjective Optimization for Variable-Length Mixed-Variable Pareto Optimization and Its Application in Cloud Service Allocation

Lianbo Ma, Yang Liu, Guo Yu, Xinzhe Wang, Hongwei Mo, Gai-Ge Wang, Yaochu Jin, Ying Tan

Summary: In real-world applications, a specific class of multiobjective optimization problems, known as variable multiobjective optimization problems (VMMOPs), with variable-length and mixed variables, such as the cloud service allocation problem (CSAOPs), have been under-researched. To address this gap, a tailored enhanced decomposition-based algorithm is proposed to handle VMMOPs. The algorithm utilizes a variable-length coding structure to represent the solutions of VMMOPs and incorporates a dimensionality incremental learning strategy to generate representative solutions for training two learning models. Experimental results demonstrate the effectiveness and competitiveness of the proposed method in handling VMMOPs.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Engineering, Electrical & Electronic

DRL Router: Distributional Reinforcement Learning-Based Router for Reliable Shortest Path Problems

Hongliang Guo, Wenda Sheng, Chen Gao, Yaochu Jin

Summary: This article investigates reliable shortest path (RSP) problems in stochastic transportation networks. It develops a universal algorithm, DRL-Router, based on distributional reinforcement learning (DRL), which can handle various RSP objectives.

IEEE INTELLIGENT TRANSPORTATION SYSTEMS MAGAZINE (2023)

Article Computer Science, Artificial Intelligence

Automated pattern generation for swarm robots using constrained multi-objective genetic programming

Zhun Fan, Zhaojun Wang, Wenji Li, Xiaomin Zhu, Bingliang Hu, An-Min Zou, Weidong Bao, Minqiang Gu, Zhifeng Hao, Yaochu Jin

Summary: Swarm robotic systems (SRSs) are used in various fields, and designing local interaction rules for self-organization of robots is a challenging task. This study proposes a modular design automation framework for gene regulatory network (GRN) models that can generate entrapping patterns without the need for expertise. The framework utilizes basic network motifs and multi-objective genetic programming to optimize the structures and parameters of the GRN models. Simulation results show that the framework can generate novel GRN models with simpler structures and better performance in complex environments. Proof-of-concept experiments using e-puck robots validate the feasibility and effectiveness of the proposed GRN models.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Automation & Control Systems

Integrating Visual Perception With Decision Making in Neuromorphic Fault-Tolerant Quadruplet-Spike Learning Framework

Shuangming Yang, Haowen Wang, Yanwei Pang, Yaochu Jin, Bernabe Linares-Barranco

Summary: The brain's ability to integrate perception and decision making in a fault-tolerant, end-to-end manner offers a compelling solution for brain-inspired intelligence. This article introduces a comprehensive neuromorphic computing framework for end-to-end intelligence, including spike-timing-dependent plasticity and a fault-tolerant routing strategy. Empirical results demonstrate the framework's high accuracy, robustness, and minimal computational latency.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Geochemistry & Geophysics

Triple Change Detection Network via Joint Multifrequency and Full-Scale Swin-Transformer for Remote Sensing Images

Dinghua Xue, Tao Lei, Shuangming Yang, Zhiyong Lv, Tongfei Liu, Yaochu Jin, Asoke K. Nandi

Summary: In this study, we propose a triple CD network (TCD-Net) with joint multifrequency and full-scale swin-transformer (FST) to address the challenges in remote sensing image change detection. The TCD-Net incorporates a multifrequency channel attention module and a joint multifrequency difference feature enhancement guiding block to enhance feature representation and improve the discriminative ability of features. Additionally, an FST module is proposed to model and aggregate the long-range dependency of multiscale changed objects. Experimental results demonstrate that TCD-Net achieves better change detection accuracy with smaller model complexity compared to state-of-the-art methods.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Computer Science, Artificial Intelligence

A fast density peak clustering based particle swarm optimizer for dynamic optimization

Fei Li, Qiang Yue, Yuanchao Liu, Haibin Ouyang, Fangqing Gu

Summary: This paper proposes a fast density peak clustering based particle swarm optimizer (DPCPSO) to solve dynamic optimization problems (DOPs). DPCPSO addresses DOPs by applying fast density peak clustering to create multiple sub-populations, using stagnation detection to handle loss of diversity, and proposing an optimal particle calibration strategy for environmental changes. Experimental results demonstrate that the proposed algorithm performs competitively in solving DOPs.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

暂无数据