4.7 Article

A novel direct measure of exploration and exploitation based on attraction basins

Journal

EXPERT SYSTEMS WITH APPLICATIONS
Volume 167, Issue -, Pages -

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.eswa.2020.114353

Keywords

Metaheuristics; Exploration and exploitation; Diversity; Attraction basins

Funding

  1. Slovenian Research Agency [P2-0041]

Ask authors/readers for more resources

This paper introduces a novel direct measure based on attraction basins to address the lack of direct measures of exploration and exploitation. Through this new technique, it is shown to be more accurate than previously proposed direct measures and common indirect measures.
Exploration, the process of visiting a new region in a search space, and exploitation, the process of searching in the neighborhood of previously visited regions, are two centerpieces of any metaheuristic algorithm. It is a common belief that good results can be obtained only if there is a good balance between exploration and exploitation. Hence, there is an urgent need to control the balance between exploration and exploitation in a direct manner. But, currently, direct measures of exploration and exploitation are almost non-existent, and researchers rely on indirect measures of exploration and exploitation, such as diversity, entropy, and fitness improvements. To remedy this situation, in this paper, a novel direct measure of exploration and exploitation is proposed that is based on attraction basins - parts of a search space where each part has its own point called an attractor, to which neighboring points tend to evolve. Each search point can be associated with a particular attraction basin. If a newly generated search point belongs to the same attraction basin as its parent then the search process is identified as exploitation, otherwise as exploration. In this paper, a new technique to compute attraction basins is presented, as well as a novel direct measure (ExaBas) of exploration and exploitation based on attraction basins. On the selected set of unimodal and multimodal optimization problems it is shown that the newly proposed direct measure of exploration and exploitation is more accurate than our previously proposed direct measure (ExpDist), as well as the common indirect measure based on diversity (Diversity).

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Searching for soil models' parameters using metaheuristics

Marko Jesenik, Marjan Mernik, Matej Crepinsek, Miha Ravber, Mladen Trlep

APPLIED SOFT COMPUTING (2018)

Article Mathematics

Tuning Multi-Objective Evolutionary Algorithms on Different Sized Problem Sets

Matej Crepinsek, Miha Ravber, Marjan Mernik, Tomaz Kosar

MATHEMATICS (2019)

Article Mathematics

Long Term Memory Assistance for Evolutionary Algorithms

Matej Crepinsek, Shih-Hsi Liu, Marjan Mernik, Miha Ravber

MATHEMATICS (2019)

Article Mathematics

From Grammar Inference to Semantic Inference-An Evolutionary Approach

Zeljko Kovacevic, Marjan Mernik, Miha Ravber, Matej Crepinsek

MATHEMATICS (2020)

Article Computer Science, Artificial Intelligence

Inferring Absolutely Non-Circular Attribute Grammars with a Memetic Algorithm

Miha Ravber, Zeljko Kovacevic, Matej Crepinsek, Marjan Mernik

Summary: This paper explores the generation of a complete compiler/interpreter for small Domain-Specific Languages (DSLs) through Semantic Inference, showing efficiency improvements and the ability to learn more complex attribute grammars compared to previous methods. Experimental results indicate that the proposed Memetic Algorithm is at least four times faster than the previous method in the selected benchmark tests.

APPLIED SOFT COMPUTING (2021)

Article Mathematics

Attraction Basins in Metaheuristics: A Systematic Mapping Study

Mihael Baketaric, Marjan Mernik, Tomaz Kosar

Summary: Attraction basins in discrete domains are better understood than those in continuous domains. Research on attraction basins in dynamic problems is scarce. Multi-objective problems are poorly investigated in both domains, with slightly more focus on continuous domains. There is a lack of parallel and scalable algorithms for computing attraction basins, as well as a general framework to unify different definitions/implementations.

MATHEMATICS (2021)

Article Computer Science, Software Engineering

Automatic compiler/interpreter generation from programs for Domain-Specific Languages: Code bloat problem and performance improvement

Zeljko Kovacevic, Miha Ravber, Shih-Hsi Liu, Matej Crepinsek

Summary: This paper introduces how to use AI methods to provide development support for domain experts who are not proficient in programming languages. By improving the technique, code bloat and evaluation time can be reduced, thus improving development efficiency.

JOURNAL OF COMPUTER LANGUAGES (2022)

Article Computer Science, Artificial Intelligence

Maximum number of generations as a stopping criterion considered harmful

Miha Ravber, Shih-Hsi Liu, Marjan Mernik, Matej Crepinsek

Summary: Evolutionary algorithms are effective in solving complex optimization problems, leading to the development of more efficient algorithms. Comparing these algorithms is a complex task, and stopping criteria play a vital role in ensuring fair and unbiased comparisons. This paper focuses on the impact of stopping criteria and shows that they can significantly affect the rankings of evolutionary algorithms.

APPLIED SOFT COMPUTING (2022)

Article Mathematics

A Graph Pointer Network-Based Multi-Objective Deep Reinforcement Learning Algorithm for Solving the Traveling Salesman Problem

Jeewaka Perera, Shih-Hsi Liu, Marjan Mernik, Matej Crepinsek, Miha Ravber

Summary: This paper introduces a multi-objective deep graph pointer network-based reinforcement learning (MODGRL) algorithm for solving multi-objective TSPs. MODGRL improves an earlier deep reinforcement learning algorithm, called DRL-MOA, by utilizing a graph pointer network to learn the graphical structures of TSPs. The results show that MODGRL outperforms the competitors on convergence and diversity measured by the hypervolume indicator.

MATHEMATICS (2023)

Article Engineering, Electrical & Electronic

Comparison of evolutionary algorithms implemented in different programming languages

Miha Ravber, Matej Moravec, Marjan Mernik

Summary: To evaluate the performance of evolutionary algorithms, they are compared with existing algorithms. However, it is not guaranteed that the experiments are conducted fairly, so it is recommended to repeat the experiments. Challenges may arise if the algorithm's source code is unavailable or needs to be implemented in a different programming language. The differences between programming languages used for algorithm implementation are often overlooked.

ELEKTROTEHNISKI VESTNIK (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

Ranking Multi-Objective Evolutionary Algorithms using a Chess Rating System with Quality Indicator Ensemble

Miha Ravber, Marjan Mernik, Matej Crepinsek

2017 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC) (2017)

Article Computer Science, Artificial Intelligence

The impact of Quality Indicators on the rating of Multi-objective Evolutionary Algorithms

Miha Ravber, Marjan Mernik, Matej Crepinkek

APPLIED SOFT COMPUTING (2017)

Review Computer Science, Artificial Intelligence

A comprehensive review of slope stability analysis based on artificial intelligence methods

Wei Gao, Shuangshuang Ge

Summary: This study provides a comprehensive review of slope stability research based on artificial intelligence methods, focusing on slope stability computation and evaluation. The review covers studies using quasi-physical intelligence methods, simulated evolutionary methods, swarm intelligence methods, hybrid intelligence methods, artificial neural network methods, vector machine methods, and other intelligence methods. The merits, demerits, and state-of-the-art research advancement of these studies are analyzed, and possible research directions for slope stability investigation based on artificial intelligence methods are suggested.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Machine learning approaches for lateral strength estimation in squat shear walls: A comparative study and practical implications

Khuong Le Nguyen, Hoa Thi Trinh, Saeed Banihashemi, Thong M. Pham

Summary: This study investigated the influence of input parameters on the shear strength of RC squat walls and found that ensemble learning models, particularly XGBoost, can effectively predict the shear strength. The axial load had a greater influence than reinforcement ratio, and longitudinal reinforcement had a more significant impact compared to horizontal and vertical reinforcement. The performance of XGBoost model outperforms traditional design models and reducing input features still yields reliable predictions.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

DHESN: A deep hierarchical echo state network approach for algal bloom prediction

Bo Hu, Huiyan Zhang, Xiaoyi Wang, Li Wang, Jiping Xu, Qian Sun, Zhiyao Zhao, Lei Zhang

Summary: A deep hierarchical echo state network (DHESN) is proposed to address the limitations of shallow coupled structures. By using transfer entropy, candidate variables with strong causal relationships are selected and a hierarchical reservoir structure is established to improve prediction accuracy. Simulation results demonstrate that DHESN performs well in predicting algal bloom.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Learning high-dependence Bayesian network classifier with robust topology

Limin Wang, Lingling Li, Qilong Li, Kuo Li

Summary: This paper discusses the urgency of learning complex multivariate probability distributions due to the increase in data variability and quantity. It introduces a highly scalable classifier called TAN, which utilizes maximum weighted spanning tree (MWST) for graphical modeling. The paper theoretically proves the feasibility of extending one-dependence MWST to model high-dependence relationships and proposes a heuristic search strategy to improve the fitness of the extended topology to data. Experimental results demonstrate that this algorithm achieves a good bias-variance tradeoff and competitive classification performance compared to other high-dependence or ensemble learning algorithms.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Make a song curative: A spatio-temporal therapeutic music transfer model for anxiety reduction

Zhejing Hu, Gong Chen, Yan Liu, Xiao Ma, Nianhong Guan, Xiaoying Wang

Summary: Anxiety is a prevalent issue and music therapy has been found effective in reducing anxiety. To meet the diverse needs of individuals, a novel model called the spatio-temporal therapeutic music transfer model (StTMTM) is proposed.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm

Nur Ezlin Zamri, Mohd. Asyraf Mansor, Mohd Shareduwan Mohd Kasihmuddin, Siti Syatirah Sidik, Alyaa Alway, Nurul Atiqah Romli, Yueling Guo, Siti Zulaikha Mohd Jamaludin

Summary: In this study, a hybrid logic mining model was proposed by combining the logic mining approach with the Modified Niche Genetic Algorithm. This model improves the generalizability and storage capacity of the retrieved induced logic. Various modifications were made to address other issues. Experimental results demonstrate that the proposed model outperforms baseline methods in terms of accuracy, precision, specificity, and correlation coefficient.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

On taking advantage of opportunistic meta-knowledge to reduce configuration spaces for automated machine learning

David Jacob Kedziora, Tien-Dung Nguyen, Katarzyna Musial, Bogdan Gabrys

Summary: The paper addresses the problem of efficiently optimizing machine learning solutions by reducing the configuration space of ML pipelines and leveraging historical performance. The experiments conducted show that opportunistic/systematic meta-knowledge can improve ML outcomes, and configuration-space culling is optimal when balanced. The utility and impact of meta-knowledge depend on various factors and are crucial for generating informative meta-knowledge bases.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Optimal location for an EVPL and capacitors in grid for voltage profile and power loss: FHO-SNN approach

G. Sophia Jasmine, Rajasekaran Stanislaus, N. Manoj Kumar, Thangamuthu Logeswaran

Summary: In the context of a rapidly expanding electric vehicle market, this research investigates the ideal locations for EV charging stations and capacitors in power grids to enhance voltage stability and reduce power losses. A hybrid approach combining the Fire Hawk Optimizer and Spiking Neural Network is proposed, which shows promising results in improving system performance. The optimization approach has the potential to enhance the stability and efficiency of electric grids.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

NLP-based approach for automated safety requirements information retrieval from project documents

Zhijiang Wu, Guofeng Ma

Summary: This study proposes a natural language processing-based framework for requirement retrieval and document association, which can help to mine and retrieve documents related to project managers' requirements. The framework analyzes the ontology relevance and emotional preference of requirements. The results show that the framework performs well in terms of iterations and threshold, and there is a significant matching between the retrieved documents and the requirements, which has significant managerial implications for construction safety management.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Dog nose-print recognition based on the shape and spatial features of scales

Yung-Kuan Chan, Chuen-Horng Lin, Yuan-Rong Ben, Ching-Lin Wang, Shu-Chun Yang, Meng-Hsiun Tsai, Shyr-Shen Yu

Summary: This study proposes a novel method for dog identification using nose-print recognition, which can be applied to controlling stray dogs, locating lost pets, and pet insurance verification. The method achieves high recognition accuracy through two-stage segmentation and feature extraction using a genetic algorithm.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Fostering supply chain resilience for omni-channel retailers: A two-phase approach for supplier selection and demand allocation under disruption risks

Shaohua Song, Elena Tappia, Guang Song, Xianliang Shi, T. C. E. Cheng

Summary: This study aims to optimize supplier selection and demand allocation decisions for omni-channel retailers in order to achieve supply chain resilience. It proposes a two-phase approach that takes into account various factors such as supplier evaluation and demand allocation.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Accelerating Benders decomposition approach for shared parking spaces allocation considering parking unpunctuality and no-shows

Jinyan Hu, Yanping Jiang

Summary: This paper examines the allocation problem of shared parking spaces considering parking unpunctuality and no-shows. It proposes an effective approach using sample average approximation (SAA) combined with an accelerating Benders decomposition (ABD) algorithm to solve the problem. The numerical experiments demonstrate the significance of supply-demand balance for the operation and user satisfaction of the shared parking system.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Financial fraud detection using graph neural networks: A systematic review

Soroor Motie, Bijan Raahemi

Summary: Financial fraud is a persistent problem in the finance industry, but Graph Neural Networks (GNNs) have emerged as a powerful tool for detecting fraudulent activities. This systematic review provides a comprehensive overview of the current state-of-the-art technologies in using GNNs for financial fraud detection, identifies gaps and limitations in existing research, and suggests potential directions for future research.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Occluded person re-identification with deep learning: A survey and perspectives

Enhao Ning, Changshuo Wang, Huang Zhang, Xin Ning, Prayag Tiwari

Summary: This review provides a detailed overview of occluded person re-identification methods and conducts a systematic analysis and comparison of existing deep learning-based approaches. It offers important theoretical and practical references for future research in the field.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A hierarchical attention detector for bearing surface defect detection

Jiajun Ma, Songyu Hu, Jianzhong Fu, Gui Chen

Summary: The article presents a novel visual hierarchical attention detector for multi-scale defect location and classification, utilizing texture, semantic, and instance features of defects through a hierarchical attention mechanism, achieving multi-scale defect detection in bearing images with complex backgrounds.

EXPERT SYSTEMS WITH APPLICATIONS (2024)