4.6 Article

Distributed Differential Evolution With Adaptive Resource Allocation

Journal

IEEE TRANSACTIONS ON CYBERNETICS
Volume 53, Issue 5, Pages 2791-2804

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCYB.2022.3153964

Keywords

Statistics; Sociology; Optimization; Iron; Resource management; Computers; Indexes; Adaptive fitness evaluation budget resource allocation; differential evolution (DE); distributed differential evolution (DDE)

Ask authors/readers for more resources

This article proposes a novel three-layer DDE framework, along with three novel methods, for solving the resource allocation and search efficiency problems in distributed differential evolution. The effectiveness and efficiency of the framework and methods are demonstrated through theoretical analysis and extensive experiments.
Distributed differential evolution (DDE) is an efficient paradigm that adopts multiple populations for cooperatively solving complex optimization problems. However, how to allocate fitness evaluation (FE) budget resources among the distributed multiple populations can greatly influence the optimization ability of DDE. Therefore, this article proposes a novel three-layer DDE framework with adaptive resource allocation (DDE-ARA), including the algorithm layer for evolving various differential evolution (DE) populations, the dispatch layer for dispatching the individuals in the DE populations to different distributed machines, and the machine layer for accommodating distributed computers. In the DDE-ARA framework, three novel methods are further proposed. First, a general performance indicator (GPI) method is proposed to measure the performance of different DEs. Second, based on the GPI, a FE allocation (FEA) method is proposed to adaptively allocate the FE budget resources from poorly performing DEs to well-performing DEs for better search efficiency. This way, the GPI and FEA methods achieve the ARA in the algorithm layer. Third, a load balance strategy is proposed in the dispatch layer to balance the FE burden of different computers in the machine layer for improving load balance and algorithm speedup. Moreover, theoretical analyses are provided to show why the proposed DDE-ARA framework can be effective and to discuss the lower bound of its optimization error. Extensive experiments are conducted on all the 30 functions of CEC 2014 competitions at 10, 30, 50, and 100 dimensions, and some state-of-the-art DDE algorithms are adopted for comparisons. The results show the great effectiveness and efficiency of the proposed framework and the three novel methods.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Multi-objective multi-criteria evolutionary algorithm for multi-objective multi-task optimization

Ke-Jing Du, Jian-Yu Li, Hua Wang, Jun Zhang

Summary: Evolutionary multi-objective multi-task optimization is an emerging paradigm for solving multi-objective multi-task optimization problems using evolutionary computation. This paper proposes treating these problems as multi-objective multi-criteria optimization problems and develops an algorithm framework that utilizes the knowledge of all tasks in the same population. The algorithm selects fitness evaluation functions as criteria, guided by a probability-based selection strategy and an adaptive parameter learning method. Extensive experiments show the effectiveness and efficiency of the proposed algorithm. Treating MO-MTOP as MO-MCOP is a potential and promising direction for solving these problems.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Computer Science, Information Systems

A knowledge graph empowered online learning framework for access control decision-making

Mingshan You, Jiao Yin, Hua Wang, Jinli Cao, Kate Wang, Yuan Miao, Elisa Bertino

Summary: This paper proposes an algorithm for constructing an access control knowledge graph based on user and resource attributes, and introduces an online learning framework. The experimental results demonstrate that topological features extracted from the knowledge graph can enhance access control performance in scenarios with varying degrees of class imbalance.

WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS (2023)

Article Engineering, Biomedical

Epilepsy Detection From EEG Using Complex Network Techniques: A Review

Supriya Supriya, Siuly Siuly, Hua Wang, Yanchun Zhang

Summary: Epilepsy, a chronic brain disorder, poses challenges in diagnosis and treatment. Graph-theory based automated epilepsy detection methods have emerged as a promising approach to analyze the complex nature of EEG signals and understand brain activity. This paper provides a comprehensive review of such methods, aiming to assist neurologists and researchers in improving epilepsy diagnosis and developing intelligent systems.

IEEE REVIEWS IN BIOMEDICAL ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

Fitness and Distance Based Local Search With Adaptive Differential Evolution for Multimodal Optimization Problems

Zi-Jia Wang, Zhi-Hui Zhan, Yun Li, Sam Kwong, Sang-Woon Jeon, Jun Zhang

Summary: This paper proposes a novel local search technique, named FDLS, based on individual information including fitness and distance, to execute precise local search operations on global optima in multimodal algorithms, avoiding meaningless local search operations on local optima or similar areas. The proposed FDLS technique is integrated with an adaptive differential evolution algorithm called ADE, and the experiments on the CEC2015 multimodal competition demonstrate its effectiveness and superiority compared to other multimodal algorithms.

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Distributed and Expensive Evolutionary Constrained Optimization With On-Demand Evaluation

Feng-Feng Wei, Wei-Neng Chen, Qing Li, Sang-Woon Jeon, Jun Zhang

Summary: This article defines distributed expensive constrained optimization problems (DECOPs) and proposes a distributed evolutionary constrained optimization algorithm with on-demand evaluation (DEAOE). DEAOE adaptively evolves different constraints in an asynchronous way through on-demand evaluation, improving population convergence and diversity. Experimental results demonstrate that DEAOE outperforms centralized state-of-the-art surrogate-assisted evolutionary algorithms (SAEAs) in terms of performance and efficiency.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2023)

Article Engineering, Civil

Travel Time Distribution Estimation by Learning Representations Over Temporal Attributed Graphs

Wanyi Zhou, Xiaolin Xiao, Yue-Jiao Gong, Jia Chen, Jun Fang, Naiqiang Tan, Nan Ma, Qun Li, Chai Hua, Sang-Woon Jeon, Jun Zhang

Summary: This study proposes a method of formulating the traffic network as a temporal attributed graph and performing node representation learning on it to address the problem of travel time estimation. The learned representation can jointly exploit dynamic traffic conditions and the topology of the road network, and estimate travel time using a route-based spatio-temporal dependence learning module.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2023)

Article Engineering, Civil

MTrajPlanner: A Multiple-Trajectory Planning Algorithm for Autonomous Underwater Vehicles

Yue-Jiao Gong, Ting Huang, Yi-Ning Ma, Sang-Woon Jeon, Jun Zhang

Summary: This paper focuses on the multiple-trajectory planning problem for automatic underwater vehicles (AUVs) and proposes a comprehensive model that considers the complexity of underwater environments, efficiency of each trajectory, and diversity among different trajectories. To solve this problem, an ant colony-based trajectory optimizer is developed, incorporating a niching strategy, decayed alarm pheromone measure, and diversified heuristic measure for improved search effectiveness and efficiency. Experimental results demonstrate that the proposed algorithm not only provides multiple AUV trajectories for flexible choice, but also outperforms state-of-the-art algorithms in terms of single trajectory efficiency.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Proximity ranking-based multimodal differential evolution

Junna Zhang, Degang Chen, Qiang Yang, Yiqiao Wang, Dong Liu, Sang-Woon Jeon, Jun Zhang

Summary: This paper proposes a novel differential evolution framework called proximity ranking-based multimodal differential evolution (PRMDE) for multimodal optimization. Through the cooperative cooperation among three main mechanisms, PRMDE is capable of locating multiple global optima simultaneously. Experimental results show that PRMDE is effective and achieves competitive or even better optimization performance than several representative methods.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Function value ranking aware differential evolution for global numerical optimization

Dong Liu, Hao He, Qiang Yang, Yiqiao Wang, Sang-Woon Jeon, Jun Zhang

Summary: This paper proposes a simple and effective mutation scheme named DE/current-to-rwrand/1 to enhance the optimization ability of differential evolution (DE) in solving complex optimization problems. The proposed mutation strategy, called function value ranking aware differential evolution (FVRADE), balances high diversity and fast convergence of the population. Experimental results demonstrate that FVRADE outperforms several state-of-the-art methods and shows promise in solving real-world optimization problems.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

A Long Short-Term Memory Based Framework for Early Detection of Mild Cognitive Impairment From EEG Signals

Ashik Mostafa Alvi, Siuly Siuly, Hua Wang

Summary: Mild cognitive impairment (MCI) is an irreversible degenerative disorder that may lead to dementia in elderly people. Early identification is crucial for effective treatment. This research proposes a deep learning-based framework using EEG data to identify MCI individuals from healthy volunteers, achieving high accuracy and sensitivity. The proposed model provides a robust biomarker and can guide the development of an automatic diagnosis system for MCI detection.

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Gene Targeting Differential Evolution: A Simple and Efficient Method for Large-Scale Optimization

Zi-Jia Wang, Jun-Rong Jian, Zhi-Hui Zhan, Yun Li, Sam Kwong, Jun Zhang

Summary: This article proposes a method called GT-based DE to solve large-scale optimization problems by targeting and modifying certain values in bottleneck dimensions. Experimental results show that GTDE is efficient and performs better or at least comparable to other state-of-the-art algorithms in solving LSOPs.

IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION (2023)

Article Computer Science, Artificial Intelligence

Enhanced Multi-Task Learning and Knowledge Graph-Based Recommender System

Min Gao, Jian-Yu Li, Chun-Hua Chen, Yun Li, Jun Zhang, Zhi-Hui Zhan

Summary: In this study, an enhanced MKR (EMKR) approach is proposed to address the two difficult issues in knowledge graph-based recommender systems. The attention mechanism and relation-aware graph convolutional neural network are utilized to capture users' historical behavior patterns and deep multi-relation semantic information. Additionally, a two-part modeling strategy is introduced for better representation of users in datasets with different sparsity. Experimental results show that EMKR outperforms state-of-the-art approaches, especially in sparse user-item interactions.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Article Automation & Control Systems

An Efficient Two-Stage Surrogate-Assisted Differential Evolution for Expensive Inequality Constrained Optimization

Feng-Feng Wei, Wei-Neng Chen, Wentao Mao, Xiao-Min Hu, Jun Zhang

Summary: This article proposes an efficient two-stage surrogate-assisted differential evolution (eToSA-DE) algorithm to handle expensive inequality constraints. The algorithm trains a surrogate model for the degree of constraint violation, with the type of surrogate changing during the evolution process. Both types of surrogates are constructed using individuals selected by the boundary training data selection strategy. A feasible exploration strategy is devised to search for promising areas. Extensive experiments demonstrate that the proposed method can achieve satisfactory optimization results and significantly improve the efficiency of the algorithm.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Automation & Control Systems

Cooperative Differential Evolution With an Attention-Based Prediction Strategy for Dynamic Multiobjective Optimization

Xiao-Fang Liu, Jun Zhang, Jun Wang

Summary: This article presents a cooperative differential evolution algorithm with an attention-based prediction strategy for dynamic multiobjective optimization. Multiple populations are used to optimize multiple objectives and find subparts of the Pareto front. The algorithm achieves a balanced approximation of the Pareto front and adapts to changes in the environment by using a new attention-based prediction strategy. Experimental results demonstrate the superiority of the proposed method to state-of-the-art algorithms.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Scale adaptive fitness evaluation-based particle swarm optimisation for hyperparameter and architecture optimisation in neural networks and deep learning

Ye-Qun Wang, Jian-Yu Li, Chun-Hua Chen, Jun Zhang, Zhi-Hui Zhan

Summary: This research proposes a particle swarm optimization approach called SAFE-PSO that tackles the optimization problem of neural networks. Experimental results show that SAFE-PSO is effective and efficient on widely used datasets.

CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY (2023)

No Data Available