4.6 Article

Generation-Level Parallelism for Evolutionary Computation: A Pipeline-Based Parallel Particle Swarm Optimization

Journal

IEEE TRANSACTIONS ON CYBERNETICS
Volume 51, Issue 10, Pages 4848-4859

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TCYB.2020.3028070

Keywords

Pipelines; Clocks; Parallel processing; Sociology; Statistics; Central Processing Unit; Approximation algorithms; Evolutionary computation (EC); parallel; particle swarm optimization (PSO); pipeline technique

Funding

  1. National Key Research and Development Program of China [2019YFB2102102]
  2. Outstanding Youth Science Foundation [61822602]
  3. National Natural Science Foundations of China [61772207, 61873097]
  4. Key-Area Research and Development of Guangdong Province [2020B010166002]
  5. Guangdong Natural Science Foundation Research Team [2018B030312003]
  6. Hong Kong GRF-RGC General Research Fund [9042489, CityU 11206317]

Ask authors/readers for more resources

This article introduces a new paradigm of parallel EC algorithm by attempting to parallelize the algorithm at the generation level. The generation-level parallelism in EC algorithms shows potential applications in optimizing time consumption problems.
Due to the population-based and iterative-based characteristics of evolutionary computation (EC) algorithms, parallel techniques have been widely used to speed up the EC algorithms. However, the parallelism usually performs in the population level where multiple populations (or subpopulations) run in parallel or in the individual level where the individuals are distributed to multiple resources. That is, different populations or different individuals can be executed simultaneously to reduce running time. However, the research into generation-level parallelism for EC algorithms has seldom been reported. In this article, we propose a new paradigm of the parallel EC algorithm by making the first attempt to parallelize the algorithm in the generation level. This idea is inspired by the industrial pipeline technique. Specifically, a kind of EC algorithm called local version particle swarm optimization (PSO) is adopted to implement a pipeline-based parallel PSO (PPPSO, i.e., (PSO)-S-3). Due to the generation-level parallelism in (PSO)-S-3, when some particles still perform their evolutionary operations in the current generation, some other particles can simultaneously go to the next generation to carry out the new evolutionary operations, or even go to further next generation(s). The experimental results show that the problem-solving ability of (PSO)-S-3 is not affected while the evolutionary speed has been substantially accelerated in a significant fashion. Therefore, generation-level parallelism is possible in EC algorithms and may have significant potential applications in time-consumption optimization problems.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available