4.7 Article

Efficient hierarchical surrogate-assisted differential evolution for high-dimensional expensive optimization

期刊

INFORMATION SCIENCES
卷 542, 期 -, 页码 228-246

出版社

ELSEVIER SCIENCE INC
DOI: 10.1016/j.ins.2020.06.045

关键词

Evolutionary optimization; Radial basis function; Differential evolution; Surrogate model; High-dimensional expensive optimization

资金

  1. National Natural Science Foundation of China [51722406, 51874335, 51674280]
  2. Shandong Provincial Natural Science Foundation [JQ201808, ZR2019JQ21]
  3. Fundamental Research Funds for the Central Universities [18CX02097A]
  4. Major Scientific and Technological Projects of CNPC [ZD2019-183-008]
  5. Science and Technology Support Plan for Youth Innovation of University in Shandong Province [2019KJH002]
  6. National Science and Technology Major Project of China [2016ZX05025001-006]
  7. 111 Project [B08028]

向作者/读者索取更多资源

The study proposes a novel and efficient hierarchical surrogate-assisted differential evolution (EHSDE) algorithm for high-dimensional expensive optimization problems. By balancing exploration and exploitation using a hierarchical framework and utilizing global and local surrogate models to accelerate convergence speed, the algorithm demonstrates effectiveness and efficiency on benchmark functions and production optimization problems.
Surrogate-assisted evolutionary algorithms have gained increasingly attention due to the promising search capabilities for solving computationally expensive optimization problems. However, when dealing with high-dimensional expensive optimization problems, the effectiveness of surrogate-assisted algorithms deteriorates drastically. In this paper, a novel and efficient hierarchical surrogate-assisted differential evolution (EHSDE) algorithm is proposed towards high-dimensional expensive optimization problems. To balance the exploration and exploitation during the optimization process, EHSDE utilizes a hierarchical framework. In the first phase, the best and the most uncertain offspring are identified respectively. The best offspring is prescreened by a global surrogate model which is built by using a radial basis function network with all the sample points, while the most uncertain offspring is built by the Euclidean distance between offspring and existing sample points. Subsequently, two local surrogate models, which are built by using the most promising sample points and the sample points surrounding the current best solution respectively, are utilized to accelerate the convergence speed. Moreover, experimental studies are conducted on the benchmark functions from 20D to 100D and on an oil reservoir production optimization problem. The results show that the proposed method is effective and efficient for most benchmark functions and for the production optimization problem compared with other state-of-the-art algorithms. (C) 2020 Elsevier Inc. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Energy & Fuels

An Efficient Infill Well Placement Optimization Approach for Extra-Low Permeability Reservoir

Qinyang Dai, Liming Zhang, Kai Zhang, Guodong Chen, Xiaopeng Ma, Jian Wang, Huaqing Zhang, Xia Yan, Piyang Liu, Yongfei Yang

Summary: In this study, an infill well optimization strategy based on the divide-and-conquer principle is proposed. The large-scale realistic reservoir model is divided into several types of small-scale conceptual models using human knowledge, and the surrogate-assisted evolutionary algorithm is used to obtain the infill well placement laws for this reservoir. The results demonstrate the strong engineering potential and application value of the proposed method in determining the optimal infill well placement in a realistic extra-low permeability reservoir development scenario.

JOURNAL OF ENERGY RESOURCES TECHNOLOGY-TRANSACTIONS OF THE ASME (2023)

Article Computer Science, Artificial Intelligence

A hybrid algorithm based on state-adaptive slime mold model and fractional-order ant system for the travelling salesman problem

Xiaoling Gong, Ziheng Rong, Jian Wang, Kai Zhang, Shengxiang Yang

Summary: In this paper, a hybrid algorithm based on state-adaptive slime mold model and fractional-order ant system (SSMFAS) is proposed to solve the travelling salesman problem (TSP). The SSMFAS algorithm emphasizes critical connections and balances exploration and exploitation ability through two targeted auxiliary strategies in the state-adaptive slime mold (SM) model. The incorporation of fractional-order calculus in the ant system (AS) takes advantage of neighboring information. The modified pheromone update rule of AS dynamically integrates the flux information of SM. Convergence analysis is provided through mathematical proofs to understand the search behavior of the proposed algorithm. Experimental results show the efficiency of the hybridization and demonstrate the competitive ability of the proposed algorithm in finding better solutions for TSP instances compared to state-of-the-art algorithms.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Engineering, Civil

A Reinforcement Learning Paradigm of Configuring Visual Enhancement for Object Detection in Underwater Scenes

Hao Wang, Shixin Sun, Xiao Bai, Jian Wang, Peng Ren

Summary: This article investigates the problem of enhancing underwater visual observations for accurate underwater object detection. Existing algorithms tend to follow human vision preference and may not be effective for object detection. The study proposes a reinforcement learning paradigm to configure visual enhancement for object detection in underwater scenes. Experimental results validate the effectiveness of the proposed method in improving detection results.

IEEE JOURNAL OF OCEANIC ENGINEERING (2023)

Article Environmental Sciences

Hyperspectral Image Classification Based on Dense Pyramidal Convolution and Multi-Feature Fusion

Junsan Zhang, Li Zhao, Hongzhao Jiang, Shigen Shen, Jian Wang, Peiying Zhang, Wei Zhang, Leiquan Wang

Summary: Hyperspectral image classification techniques have received considerable attention due to their ability to model the development of cities and guide urban planning and construction. However, limited training samples pose a challenge in adequately extracting and utilizing the spatial and spectral information of hyperspectral images. To address this, a method called DPCMF is proposed, which uses dense pyramidal convolution and multi-feature fusion to extract spatial and spectral features. Experimental results demonstrate significant improvements compared to other methods, indicating the effectiveness of the proposed approach in extracting spatial and spectral information with limited training samples.

REMOTE SENSING (2023)

Article Computer Science, Information Systems

Node Selection Algorithm for Federated Learning Based on Deep Reinforcement Learning for Edge Computing in IoT

Shuai Yan, Peiying Zhang, Siyu Huang, Jian Wang, Hao Sun, Yi Zhang, Amr Tolba

Summary: The rapid development of IoT and edge computing technologies has led to new challenges in privacy and security, especially concerning personal privacy and data leakage in IoT edge computing environments. Federated learning has been proposed as a solution, but the heterogeneity of devices in these environments presents a significant implementation challenge. To address this, this paper proposes a novel node selection strategy based on deep reinforcement learning to optimize federated learning in heterogeneous device IoT environments. Additionally, a metric model for evaluating the performance of IoT devices is presented. Experimental results show a 30% improvement in training accuracy using the proposed method in a heterogeneous device IoT environment.

ELECTRONICS (2023)

Article Computer Science, Artificial Intelligence

An Adaptive Neuro-Fuzzy System With Integrated Feature Selection and Rule Extraction for High-Dimensional Classification Problems

Guangdong Xue, Qin Chang, Jian Wang, Kai Zhang, Nikhil Ranjan Pal

Summary: This study proposes a neuro-fuzzy framework that can handle high-dimensional datasets by introducing adaptive softmin (Ada-softmin) and integrated feature selection and rule extraction. The system consists of three sequential phases: feature selection, rule extraction, and fine tuning, demonstrating effectiveness on datasets with more than 7000 features without the need for separate feature selection or dimensionality reduction methods.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

DG-ALETSK: A High-Dimensional Fuzzy Approach With Simultaneous Feature Selection and Rule Extraction

Guangdong Xue, Jian Wang, Bin Yuan, Caili Dai

Summary: This article proposes a novel adaptive Ln-Exp softmin operator for approximating the minimum T-norm, which is applied in TSK fuzzy systems to solve high-dimensional problems. The gate function is improved with an enhanced scheme, and a double groups of gates-based fuzzy approach is proposed for simultaneous feature selection and rule extraction. Numerical experiments verify the effectiveness and time-saving nature of the proposed method.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2023)

Article Computer Science, Information Systems

Pseudo inverse versus iterated projection: Novel learning approach and its application on broad learning system

Faliang Yin, Weiguo Li, Kai Zhang, Jian Wang, Nikhil R. Pal

Summary: The Broad Learning System (BLS) is a concise and efficient learning system that has gained attention. However, it struggles with high computational costs and memory usage when dealing with complex problems and large networks. This work proposes an improved iterative projection learning method for training BLS without using pseudo-inverse. Additionally, an evolutionary bilevel programming method is presented to optimize the hyperparameters of the network structure. Experimental results demonstrate that the proposed methods improve efficiency, robustness, and generalization ability compared to existing approaches.

INFORMATION SCIENCES (2023)

Article Computer Science, Artificial Intelligence

An interpretable neural network for robustly determining the location and number of cluster centers

Xuetao Xie, Yi-Fei Pu, Huaqing Zhang, Jacek Mandziuk, El-Sayed M. El-Alfy, Jian Wang

Summary: K-meaNet is a method that combines the interpretable mechanism of K-means and the powerful information representation ability of neural networks. It can adaptively determine the number of cluster centers and is robust to the location and number of initial cluster centers as well as the number of features.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Review Mathematics

Progress and Challenges of Integrated Machine Learning and Traditional Numerical Algorithms: Taking Reservoir Numerical Simulation as an Example

Xu Chen, Kai Zhang, Zhenning Ji, Xiaoli Shen, Piyang Liu, Liming Zhang, Jian Wang, Jun Yao

Summary: Machine learning techniques have garnered significant attention in various engineering disciplines, especially in reservoir numerical simulations. By integrating traditional numerical methods with machine learning, the precision of partial differential equation discretization can be improved. Machine learning algorithms can directly solve partial differential equations, resulting in rapid convergence, heightened computational efficiency, and accuracies surpassing 95%.

MATHEMATICS (2023)

Article Engineering, Electrical & Electronic

Robust Low-Rank Matrix Recovery as Mixed Integer Programming via l(0)-Norm Optimization

Zhang-Lei Shi, Xiao Peng Li, Weiguo Li, Tongjiang Yan, Jian Wang, Yaru Fu

Summary: This letter focuses on robust low-rank matrix recovery (RLRMR) in the presence of gross sparse outliers. Instead of using l(1)-norm to reduce or suppress the influence of anomalies, the authors aim to eliminate their impact. They model the RLRMR as a mixed integer programming (MIP) problem based on the l(0)-norm and develop a block coordinate descent (BCD) algorithm to iteratively solve the resultant MIP. The proposed method demonstrates superiority over five state-of-the-art RLRMR algorithms based on simulation results.

IEEE SIGNAL PROCESSING LETTERS (2023)

Article Energy & Fuels

A transfer learning framework for well placement optimization based on denoising autoencoder

Ji Qi, Yanqing Liu, Yafeng Ju, Kai Zhang, Lu Liu, Yuanyuan Liu, Xiaoming Xue, Liming Zhang, Huaqing Zhang, Haochen Wang, Jun Yao, Weidong Zhang

Summary: This paper proposes a novel transfer learning framework for well placement optimization by using the feature extraction capability of a single-layer denoising autoencoder. By establishing a reconstruction mapping between previous and present tasks, the randomly generated well locations can inherit knowledge from optimal well locations, which helps the evolutionary algorithm quickly bias towards the optimal solution and accelerate the solving process of the present task.

GEOENERGY SCIENCE AND ENGINEERING (2023)

Article Energy & Fuels

Evolutionary-assisted reinforcement learning for reservoir real-time production optimization under uncertainty

Zhong-Zheng Wang, Kai Zhang, Guo-Dong Chen, Jin-Ding Zhang, Wen-Dong Wang, Hao-Chen Wang, Li -Ming Zhang, Xia Yan, Jun Yao

Summary: Production optimization is crucial in the smart oilfield community for maximizing economic benefits and oil recovery. This study proposes an efficient and robust method, evolutionary-assisted reinforcement learning (EARL), to achieve real-time production optimization under uncertainty. The approach models the optimization problem as a Markov decision process and uses a deep convolutional neural network to adaptively adjust well controls based on reservoir states. Simulation results demonstrate that EARL outperforms prior methods in terms of optimization efficiency, robustness, and real-time decision-making capability.

PETROLEUM SCIENCE (2023)

Article Computer Science, Artificial Intelligence

Unsupervised image enhancement under non-uniform illumination based on CNNs

Feng Lin, Huaqing Zhang, Jian Wang, Jun Wang

Summary: This paper presents two CNN-based systems for unsupervised image enhancement under non-uniform illumination, and demonstrates their superiority in terms of enhancement quality, model complexity, and convergence efficiency through experimental results.

NEURAL NETWORKS (2024)

Article Computer Science, Information Systems

An Attention Mechanism-Based Microservice Placement Scheme for On-Star Edge Computing Nodes

Xiangyu Su, Amr Tolba, Yuxi Lu, Lizhuang Tan, Jian Wang, Peiying Zhang

Summary: This paper addresses the problem of microservice placement in satellite edge nodes and improves the placement performance using the attention mechanism in graph neural networks. The simulation experimental results demonstrate the effectiveness of the research content for the automatic management of microservices in satellite networks, and the proposed scheme performs well in terms of success rate and the benefit-overhead ratio of microservice placement.

IEEE ACCESS (2023)

Article Computer Science, Information Systems

A consensus model considers managing manipulative and overconfident behaviours in large-scale group decision-making

Xia Liang, Jie Guo, Peide Liu

Summary: This paper investigates a novel consensus model based on social networks to manage manipulative and overconfident behaviors in large-scale group decision-making. By proposing a novel clustering model and improved methods, the consensus reaching is effectively facilitated. The feedback mechanism and management approach are employed to handle decision makers' behaviors. Simulation experiments and comparative analysis demonstrate the effectiveness of the model.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

CGN: Class gradient network for the construction of adversarial samples

Xiang Li, Haiwang Guo, Xinyang Deng, Wen Jiang

Summary: This paper proposes a method based on class gradient networks for generating high-quality adversarial samples. By introducing a high-level class gradient matrix and combining classification loss and perturbation loss, the method demonstrates superiority in the transferability of adversarial samples on targeted attacks.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Distinguishing latent interaction types from implicit feedbacks for recommendation

Lingyun Lu, Bang Wang, Zizhuo Zhang, Shenghao Liu

Summary: Many recommendation algorithms only rely on implicit feedbacks due to privacy concerns. However, the encoding of interaction types is often ignored. This paper proposes a relation-aware neural model that classifies implicit feedbacks by encoding edges, thereby enhancing recommendation performance.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Proximity-based density description with regularized reconstruction algorithm for anomaly detection

Jaehong Yu, Hyungrok Do

Summary: This study discusses unsupervised anomaly detection using one-class classification, which determines whether a new instance belongs to the target class by constructing a decision boundary. The proposed method uses a proximity-based density description and a regularized reconstruction algorithm to overcome the limitations of existing one-class classification methods. Experimental results demonstrate the superior performance of the proposed algorithm.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Non-iterative border-peeling clustering algorithm based on swap strategy

Hui Tu, Shifei Ding, Xiao Xu, Haiwei Hou, Chao Li, Ling Ding

Summary: Border-Peeling algorithm is a density-based clustering algorithm, but its complexity and issues on unbalanced datasets restrict its application. This paper proposes a non-iterative border-peeling clustering algorithm, which improves the clustering performance by distinguishing and associating core points and border points.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A two-stage denoising framework for zero-shot learning with noisy labels

Long Tang, Pan Zhao, Zhigeng Pan, Xingxing Duan, Panos M. Pardalos

Summary: In this work, a two-stage denoising framework (TSDF) is proposed for zero-shot learning (ZSL) to address the issue of noisy labels. The framework includes a tailored loss function to remove suspected noisy-label instances and a ramp-style loss function to reduce the negative impact of remaining noisy labels. In addition, a dynamic screening strategy (DSS) is developed to efficiently handle the nonconvexity of the ramp-style loss.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Selection of a viable blockchain service provider for data management within the internet of medical things: An MCDM approach to Indian healthcare

Raghunathan Krishankumar, Sundararajan Dhruva, Kattur S. Ravichandran, Samarjit Kar

Summary: Health 4.0 is gaining global attention for better healthcare through digital technologies. This study proposes a new decision-making framework for selecting viable blockchain service providers in the Internet of Medical Things (IoMT). The framework addresses the limitations in previous studies and demonstrates its applicability in the Indian healthcare sector. The results show the top ranking BSPs, the importance of various criteria, and the effectiveness of the developed model.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Q-learning with heterogeneous update strategy

Tao Tan, Hong Xie, Liang Feng

Summary: This paper proposes a heterogeneous update idea and designs HetUp Q-learning algorithm to enlarge the normalized gap by overestimating the Q-value corresponding to the optimal action and underestimating the Q-value corresponding to the other actions. To address the limitation, a softmax strategy is applied to estimate the optimal action, resulting in HetUpSoft Q-learning and HetUpSoft DQN. Extensive experimental results show significant improvements over SOTA baselines.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Dyformer: A dynamic transformer-based architecture for multivariate time series classification

Chao Yang, Xianzhi Wang, Lina Yao, Guodong Long, Guandong Xu

Summary: This paper proposes a dynamic transformer-based architecture called Dyformer for multivariate time series classification. Dyformer captures multi-scale features through hierarchical pooling and adaptive learning strategies, and improves model performance by introducing feature-map-wise attention mechanisms and a joint loss function.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

ESSENT: an arithmetic optimization algorithm with enhanced scatter search strategy for automated test case generation

Xiguang Li, Baolu Feng, Yunhe Sun, Ammar Hawbani, Saeed Hammod Alsamhi, Liang Zhao

Summary: This paper proposes an enhanced scatter search strategy, using opposition-based learning, to solve the problem of automated test case generation based on path coverage (ATCG-PC). The proposed ESSENT algorithm selects the path with the lowest path entropy among the uncovered paths as the target path and generates new test cases to cover the target path by modifying the dimensions of existing test cases. Experimental results show that the ESSENT algorithm outperforms other state-of-the-art algorithms, achieving maximum path coverage with fewer test cases.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

An attention based approach for automated account linkage in federated identity management

Shirin Dabbaghi Varnosfaderani, Piotr Kasprzak, Aytaj Badirova, Ralph Krimmel, Christof Pohl, Ramin Yahyapour

Summary: Linking digital accounts belonging to the same user is crucial for security, user satisfaction, and next-generation service development. However, research on account linkage is mainly focused on social networks, and there is a lack of studies in other domains. To address this, we propose SmartSSO, a framework that automates the account linkage process by analyzing user routines and behavior during login processes. Our experiments on a large dataset show that SmartSSO achieves over 98% accuracy in hit-precision.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A memetic algorithm with fuzzy-based population control for the joint order batching and picker routing problem

Renchao Wu, Jianjun He, Xin Li, Zuguo Chen

Summary: This paper proposes a memetic algorithm with fuzzy-based population control (MA-FPC) to solve the joint order batching and picker routing problem (JOBPRP). The algorithm incorporates batch exchange crossover and a two-level local improvement procedure. Experimental results show that MA-FPC outperforms existing algorithms in terms of solution quality.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Refining one-class representation: A unified transformer for unsupervised time-series anomaly detection

Guoxiang Zhong, Fagui Liu, Jun Jiang, Bin Wang, C. L. Philip Chen

Summary: In this study, we propose the AMFormer framework to address the problem of mixed normal and anomaly samples in deep unsupervised time-series anomaly detection. By refining the one-class representation and introducing the masked operation mechanism and cost sensitive learning theory, our approach significantly improves anomaly detection performance.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A data-driven optimisation method for a class of problems with redundant variables and indefinite objective functions

Jin Zhou, Kang Zhou, Gexiang Zhang, Ferrante Neri, Wangyang Shen, Weiping Jin

Summary: In this paper, the authors focus on the issue of multi-objective optimisation problems with redundant variables and indefinite objective functions (MOPRVIF) in practical problem-solving. They propose a dual data-driven method for solving this problem, which consists of eliminating redundant variables, constructing objective functions, selecting evolution operators, and using a multi-objective evolutionary algorithm. The experiments conducted on two different problem domains demonstrate the effectiveness, practicality, and scalability of the proposed method.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A Monte Carlo fuzzy logistic regression framework against imbalance and separation

Georgios Charizanos, Haydar Demirhan, Duygu Icen

Summary: This article proposes a new fuzzy logistic regression framework that addresses the problems of separation and imbalance while maintaining the interpretability of classical logistic regression. By fuzzifying binary variables and classifying subjects based on a fuzzy threshold, the framework demonstrates superior performance on imbalanced datasets.

INFORMATION SCIENCES (2024)