4.7 Article

A hierarchical genetic fuzzy system based on genetic programming for addressing classification with highly imbalanced and borderline data-sets

Journal

KNOWLEDGE-BASED SYSTEMS
Volume 38, Issue -, Pages 85-104

Publisher

ELSEVIER
DOI: 10.1016/j.knosys.2012.08.025

Keywords

Fuzzy rule based classification systems; Hierarchical fuzzy partitions; Genetic rule selection; Tuning; Imbalanced data-sets; Borderline examples

Funding

  1. Spanish Ministry of Science and Technology [TIN2011-28488, TIN2008-06681-C06-02]
  2. Andalusian Research Plan [P10-TIC-6858, TIC-3928]

Ask authors/readers for more resources

Lots of real world applications appear to be a matter of classification with imbalanced data-sets. This problem arises when the number of instances from one class is quite different to the number of instances from the other class. Traditionally, classification algorithms are unable to correctly deal with this issue as they are biased towards the majority class. Therefore, algorithms tend to misclassify the minority class which usually is the most interesting one for the application that is being sorted out. Among the available learning approaches, fuzzy rule-based classification systems have obtained a good behavior in the scenario of imbalanced data-sets. In this work, we focus on some modifications to further improve the performance of these systems considering the usage of information granulation. Specifically, a positive synergy between data sampling methods and algorithmic modifications is proposed, creating a genetic programming approach that uses linguistic variables in a hierarchical way. These linguistic variables are adapted to the context of the problem with a genetic process that combines rule selection with the adjustment of the lateral position of the labels based on the 2-tuples linguistic model. An experimental study is carried out over highly imbalanced and borderline imbalanced data-sets which is completed by a statistical comparative analysis. The results obtained show that the proposed model outperforms several fuzzy rule based classification systems, including a hierarchical approach and presents a better behavior than the C4.5 decision tree. (c) 2012 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Choosing the proper autoencoder for feature fusion based on data complexity and classifiers: Analysis, tips and guidelines

Francisco J. Pulgar, Francisco Charte, Antonio J. Rivera, Maria J. del Jesus

INFORMATION FUSION (2020)

Article Genetics & Heredity

Paternal and maternal mutations in X-STRs: A GHEP-ISFG collaborative study

Nadia Pinto, Vania Pereira, Carmen Tomas, Silvia Loiola, Elizeu F. Carvalho, Nidia Modesti, Mariana Maxzud, Valeria Marcucci, Hortensia Cano, Regina Cicarelli, Bianca Januario, Ana Bento, Pedro Brito, German Burgos, Elius Paz-Cruz, Laura Diez-Juarez, Silvia Vannelli, Maria de Lurdes Pontes, Gabriela Berardi, Sandra Furfuro, Alberto Fernandez, Denilce Sumita, Cecilia Bobillo, Maria Gabriela Garcia, Leonor Gusmao

FORENSIC SCIENCE INTERNATIONAL-GENETICS (2020)

Article Computer Science, Information Systems

ClEnDAE: A classifier based on ensembles with built-in dimensionality reduction through denoising autoencoders

Francisco J. Pulgar, Francisco Charte, Antonio J. Rivera, Maria J. del Jesus

Summary: The paper introduces a new classifier, ClEnDAE, which uses ensemble methods and DAE to reduce dimensionality of input space and improve predictive performance. Experimental results show that the algorithm outperforms other traditional methods in classification.

INFORMATION SCIENCES (2021)

Article Computer Science, Artificial Intelligence

Revisiting data complexity metrics based on morphology for overlap and imbalance: snapshot, new overlap number of balls metrics and singular problems prospect

Jose Daniel Pascual-Triana, David Charte, Marta Andres Arroyo, Alberto Fernandez, Francisco Herrera

Summary: Data Science and Machine Learning play crucial roles for companies and research institutions, with supervised classification allowing for class prediction of new samples but certain properties may make datasets challenging to classify. Data complexity metrics are extensively used to evaluate datasets, providing information on intrinsic data characteristics to assess classifier compatibility. However, most metrics focus on a single aspect of the data, potentially inadequate for comprehensive dataset evaluation. This research revisits complexity metrics based on data morphology, proposing a new family of metrics named Overlap Number of Balls which aim to provide better estimates for class overlap and correlate with classification performance.

KNOWLEDGE AND INFORMATION SYSTEMS (2021)

Article Computer Science, Information Systems

FDR2-BD: A Fast Data Reduction Recommendation Tool for Tabular Big Data Classification Problems

Maria Jose Basgall, Marcelo Naiouf, Alberto Fernandez

Summary: FDR2-BD presents a methodological data condensation approach for reducing tabular big datasets in classification problems, which combines feature selection and uniform sampling reduction to maintain predictive quality within a user-defined threshold. The method shows robustness and scalability, outperforming existing solutions in reduction percentages while maintaining representativeness of the original data information.

ELECTRONICS (2021)

Article Computer Science, Artificial Intelligence

Learning interpretable multi-class models by means of hierarchical decomposition: Threshold Control for Nested Dichotomies

J. A. Fdez-Sanchez, J. D. Pascual-Triana, A. Fernandez, F. Herrera

Summary: The study introduces a novel method TC-ND based on hierarchical decompositions for obtaining interpretable multi-class models. This method creates a binary-based hierarchical class structure and discards meta-classes based on confidence levels, achieving a modular and easily understandable decomposition of multi-class problems.

NEUROCOMPUTING (2021)

Article Automation & Control Systems

The impact of heterogeneous distance functions on missing data imputation and classification performance

Miriam Seoane Santos, Pedro Henriques Abreu, Alberto Fernandez, Julian Luengo, Joao Santos

Summary: This work examines the impact of distance functions on K-Nearest Neighbours imputation of incomplete datasets. The experiments show that distance computation is significantly affected by missing data, and provide guidelines for selecting appropriate distance functions based on data characteristics and research objectives.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

IFC-BD: An Interpretable Fuzzy Classifier for Boosting Explainable Artificial Intelligence in Big Data

Fatemeh Aghaeipoor, Mohammad Masoud Javidi, Alberto Fernandez

Summary: This article introduces an interpretable fuzzy classifier for Big Data, aiming to boost explainability by learning a compact yet accurate fuzzy model. Developed in a cell-based distributed framework, IFC-BD goes through three working stages of initial rule learning, rule generalization, and heuristic rule selection to move from a high number of specific rules to fewer, more general and confident rules. The proposed algorithm was found to improve the explainability and predictive performance of fuzzy rule-based classifiers in comparison to state-of-the-art approaches.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

FW-SMOTE: A feature-weighted oversampling approach for imbalanced classification

Sebastian Maldonado, Carla Vairetti, Alberto Fernandez, Francisco Herrera

Summary: This paper introduces a novel SMOTE variant based on the weighted Minkowski distance, which is used to address the class-imbalance problem in high-dimensional settings. By prioritizing features that are more relevant for the classification task, the proposed method provides a better definition of the neighborhood. Furthermore, it offers the additional advantage of feature selection and performs well in handling class overlap and hubness issues.

PATTERN RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

A distributed evolutionary fuzzy system-based method for the fusion of descriptive emerging patterns in data streams

A. M. Garcia-Vico, C. J. Carmona, P. Gonzalez, M. J. del Jesus

Summary: This paper presents a distributed method based on evolutionary fuzzy systems for extracting and fusing patterns from data streams, and analyzes the adaptability and quality of the proposed method.

INFORMATION FUSION (2023)

Article Pharmacology & Pharmacy

Multiplex Analysis of CircRNAs from Plasma Extracellular Vesicle-Enriched Samples for the Detection of Early-Stage Non-Small Cell Lung Cancer

Carlos Pedraz-Valdunciel, Stavros Giannoukakos, Ana Gimenez-Capitan, Diogo Fortunato, Martyna Filipska, Jordi Bertran-Alamillo, Jillian W. P. Bracht, Ana Drozdowskyj, Joselyn Valarezo, Natasa Zarovni, Alberto Fernandez-Hilario, Michael Hackenberg, Andres Aguilar-Hernandez, Miguel Angel Molina-Vila, Rafael Rosell

Summary: This study validates the use of the nCounter platform for multiplexed EV-circRNA expression studies in LC patient samples and successfully develops a prognostic signature for LC.

PHARMACEUTICS (2022)

Article Engineering, Biomedical

Interpreting Deep Machine Learning Models: An Easy Guide for Oncologists

Jose P. Amorim, Pedro H. Abreu, Alberto Fernandez, Mauricio Reyes, Joao Santos, Miguel H. Abreu

Summary: Healthcare agents are collecting large amounts of patient data, particularly in oncology. Decision-support systems based on deep learning techniques have been approved for clinical use, but their interpretability remains a barrier to their widespread adoption. This article aims to provide oncologists with a guide on how these methods make decisions and strategies to explain them. Theoretical concepts were illustrated using oncological examples and a literature review was conducted to identify research works in the field. The majority of studies focused on explaining the importance of tumor characteristics in predictions using multilayer perceptrons and convolutional neural networks. However, achieving interpretability while maintaining performance remains a significant challenge for artificial intelligence.

IEEE REVIEWS IN BIOMEDICAL ENGINEERING (2023)

Article Biochemistry & Molecular Biology

Combinatorial Blood Platelets-Derived circRNA and mRNA Signature for Early-Stage Lung Cancer Detection

Silvia D'Ambrosi, Stavros Giannoukakos, Mafalda Antunes-Ferreira, Carlos Pedraz-Valdunciel, Jillian W. P. Bracht, Nicolas Potie, Ana Gimenez-Capitan, Michael Hackenberg, Alberto Fernandez Hilario, Miguel A. Molina-Vila, Rafael Rosell, Thomas Wurdinger, Danijela Koppers-Lalic

Summary: This study investigates the synergistic contribution of circRNA and mRNA derived from blood platelets as biomarkers for lung cancer detection. Using a comprehensive bioinformatics pipeline, platelet-derived circRNA and mRNA from non-cancer individuals and lung cancer patients were analyzed. Machine learning algorithms were used to generate predictive classification models based on an optimal selected signature. The study demonstrates the potential of a multi-analyte-based approach using platelet-derived biomarkers for lung cancer detection.

INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES (2023)

Article Computer Science, Artificial Intelligence

Fuzzy Rule-Based Explainer Systems for Deep Neural Networks: From Local Explainability to Global Understanding

Fatemeh Aghaeipoor, Mohammad Sabokrou, Alberto Fernandez

Summary: The explainability of deep neural networks has become a topic of interest, and this article proposes a fuzzy rule-based explainer system that helps understand the functioning of these networks. These systems maintain accuracy while reducing complexity and improving comprehensibility.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2023)

Article Clinical Neurology

Addressing neuropsychological diagnostics in adults with epilepsy: Introducing the International Classification of Cognitive Disorders in Epilepsy: The IC CODE Initiative

Marc Norman, Sarah J. Wilson, Sallie Baxendale, William Barr, Cady Block, Robyn M. Busch, Alberto Fernandez, Erik Hessen, David W. Loring, Carrie R. McDonald, Bruce P. Hermann

Summary: This paper addresses the lack of an international diagnostic taxonomy for cognitive disorders in epilepsy and proposes a consensus-based classification system framework as a solution.

EPILEPSIA OPEN (2021)

Article Computer Science, Artificial Intelligence

Confidence-based and sample-reweighted test-time adaptation

Hao Yang, Min Wang, Zhengfei Yu, Hang Zhang, Jinshen Jiang, Yun Zhou

Summary: In this paper, a novel method called CSTTA is proposed for test time adaptation (TTA), which utilizes confidence-based optimization and sample reweighting to better utilize sample information. Extensive experiments demonstrate the effectiveness of the proposed method.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

A novel method for generating a canonical basis for decision implications based on object-induced three-way operators

Jin Liu, Ju-Sheng Mi, Dong-Yun Niu

Summary: This article focuses on a novel method for generating a canonical basis for decision implications based on object-induced operators (OE operators). The logic of decision implication based on OE operators is described, and a method for obtaining the canonical basis for decision implications is given. The completeness, nonredundancy, and optimality of the canonical basis are proven. Additionally, a method for generating true premises based on OE operators is proposed.

KNOWLEDGE-BASED SYSTEMS (2024)

Review Computer Science, Artificial Intelligence

Efficient utilization of pre-trained models: A review of sentiment analysis via prompt learning

Kun Bu, Yuanchao Liu, Xiaolong Ju

Summary: This paper discusses the importance of sentiment analysis and pre-trained models in natural language processing, and explores the application of prompt learning. The research shows that prompt learning is more suitable for sentiment analysis tasks and can achieve good performance.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

M-EDEM: A MNN-based Empirical Decomposition Ensemble Method for improved time series forecasting

Xiangjun Cai, Dagang Li

Summary: This paper presents a new decomposition mechanism based on learned decomposition mapping. By using a neural network to learn the relationship between original time series and decomposed results, the repetitive computation overhead during rolling decomposition is relieved. Additionally, extended mapping and partial decomposition methods are proposed to alleviate boundary effects on prediction performance. Comparative studies demonstrate that the proposed method outperforms existing RDEMs in terms of operation speed and prediction accuracy.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Privacy-preserving trust management method based on blockchain for cross-domain industrial IoT

Xu Wu, Yang Liu, Jie Tian, Yuanpeng Li

Summary: This paper proposes a blockchain-based privacy-preserving trust management architecture, which adopts federated learning to train task-specific trust models and utilizes differential privacy to protect device privacy. In addition, a game theory-based incentive mechanism and a parallel consensus protocol are proposed to improve the accuracy of trust computing and the efficiency of consensus.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MV-ReID: 3D Multi-view Transformation Network for Occluded Person Re-Identification

Zaiyang Yu, Prayag Tiwari, Luyang Hou, Lusi Li, Weijun Li, Limin Jiang, Xin Ning

Summary: This study introduces a 3D view-based approach that effectively handles occlusions and leverages the geometric information of 3D objects. The proposed method achieves state-of-the-art results on occluded ReID tasks and exhibits competitive performance on holistic ReID tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

City-scale continual neural semantic mapping with three-layer sampling and panoptic representation

Yongliang Shi, Runyi Yang, Zirui Wu, Pengfei Li, Caiyun Liu, Hao Zhao, Guyue Zhou

Summary: Neural implicit representations have gained attention due to their expressive, continuous, and compact properties. However, there is still a lack of research on city-scale continual implicit dense mapping based on sparse LiDAR input. In this study, a city-scale continual neural mapping system with a panoptic representation is developed, incorporating environment-level and instance-level modeling. A tailored three-layer sampling strategy and category-specific prior are proposed to address the challenges of representing geometric information in city-scale space and achieving high fidelity mapping of instances under incomplete observation.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MDSSN: An end-to-end deep network on triangle mesh parameterization

Ruihan Hu, Zhi-Ri Tang, Rui Yang, Zhongjie Wang

Summary: Mesh data is crucial for 3D computer vision applications worldwide, but traditional deep learning frameworks have struggled with handling meshes. This paper proposes MDSSN, a simple mesh computation framework that models triangle meshes and represents their shape using face-based and edge-based Riemannian graphs. The framework incorporates end-to-end operators inspired by traditional deep learning frameworks, and includes dedicated modules for addressing challenges in mesh classification and segmentation tasks. Experimental results demonstrate that MDSSN outperforms other state-of-the-art approaches.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Semi-supervised learning with missing values imputation

Buliao Huang, Yunhui Zhu, Muhammad Usman, Huanhuan Chen

Summary: This paper proposes a novel semi-supervised conditional normalizing flow (SSCFlow) algorithm that combines unsupervised imputation and supervised classification. By estimating the conditional distribution of incomplete instances, SSCFlow facilitates imputation and classification simultaneously, addressing the issue of separated tasks ignoring data distribution and label information in traditional methods.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Emotion-and-knowledge grounded response generation in an open-domain dialogue setting

Deeksha Varshney, Asif Ekbal, Erik Cambria

Summary: This paper focuses on the neural-based interactive dialogue system that aims to engage and retain humans in long-lasting conversations. It proposes a new neural generative model that combines step-wise co-attention, self-attention-based transformer network, and an emotion classifier to control emotion and knowledge transfer during response generation. The results from quantitative, qualitative, and human evaluation show that the proposed models can generate natural and coherent sentences, capturing essential facts with significant improvement over emotional content.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MvTS-library: An open library for deep multivariate time series forecasting

Junchen Ye, Weimiao Li, Zhixin Zhang, Tongyu Zhu, Leilei Sun, Bowen Du

Summary: Modeling multivariate time series has long been a topic of interest for scholars in various fields. This paper introduces MvTS, an open library based on Pytorch, which provides a unified framework for implementing and evaluating these models. Extensive experiments on public datasets demonstrate the effectiveness and universality of the models reproduced by MvTS.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

An adaptive hybrid mutated differential evolution feature selection method for low and high-dimensional medical datasets

Reham R. Mostafa, Ahmed M. Khedr, Zaher Al Aghbari, Imad Afyouni, Ibrahim Kamel, Naveed Ahmed

Summary: Feature selection is crucial in classification procedures, but it faces challenges in high-dimensional datasets. To overcome these challenges, this study proposes an Adaptive Hybrid-Mutated Differential Evolution method that incorporates the mechanics of the Spider Wasp Optimization algorithm and the concept of Enhanced Solution Quality. Experimental results demonstrate the effectiveness of the method in terms of accuracy and convergence speed, and it outperforms contemporary cutting-edge algorithms.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

TCM Model for improving track sequence classification in real scenarios with Multi-Feature Fusion and Transformer Block

Ti Xiang, Pin Lv, Liguo Sun, Yipu Yang, Jiuwu Hao

Summary: This paper introduces a Track Classification Model (TCM) based on marine radar, which can effectively recognize and classify shipping tracks. By using a feature extraction network with multi-feature fusion and a dataset production method to address missing labels, the classification accuracy is improved, resulting in successful engineering application in real scenarios.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Language model as an Annotator: Unsupervised context-aware quality phrase generation

Zhihao Zhang, Yuan Zuo, Chenghua Lin, Junjie Wu

Summary: This paper proposes a novel unsupervised context-aware quality phrase mining framework called LMPhrase, which is built upon large pre-trained language models. The framework mines quality phrases as silver labels using a parameter-free probing technique on the pre-trained language model BERT, and formalizes the phrase tagging task as a sequence generation problem by fine-tuning on the Sequence to-Sequence pre-trained language model BART. The results of extensive experiments show that LMPhrase consistently outperforms existing competitors in two different granularity phrase mining tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Stochastic Gradient Descent for matrix completion: Hybrid parallelization on shared- and distributed-memory systems

Kemal Buyukkaya, M. Ozan Karsavuran, Cevdet Aykanat

Summary: The study aims to investigate the hybrid parallelization of the Stochastic Gradient Descent (SGD) algorithm for solving the matrix completion problem on a high-performance computing platform. A hybrid parallel decentralized SGD framework with asynchronous inter-process communication and a novel flexible partitioning scheme is proposed to achieve scalability up to hundreds of processors. Experimental results on real-world benchmark datasets show that the proposed algorithm achieves 6x higher throughput on sparse datasets compared to the state-of-the-art, while achieving comparable throughput on relatively dense datasets.

KNOWLEDGE-BASED SYSTEMS (2024)