4.6 Article

Classifier Subset Selection to construct multi-classifiers by means of estimation of distribution algorithms

Journal

NEUROCOMPUTING
Volume 157, Issue -, Pages 46-60

Publisher

ELSEVIER
DOI: 10.1016/j.neucom.2015.01.036

Keywords

Machine Learning; Multiple-Classifier Systems; Evolutionary computation; Classifier Subset Selection

Funding

  1. Basque Government [IT395-10, IT313-10]
  2. University of the Basque Country UPV/EHU [UFI11/45]

Ask authors/readers for more resources

This paper proposes a novel approach to select the individual classifiers to take part in a Multiple-Classifier System. Individual classifier selection is a key step in the development of multi-classifiers. Several works have shown the benefits of fusing complementary classifiers. Nevertheless, the selection of the base classifiers to be used is still an open question, and different approaches have been proposed in the literature. This work is based on the selection of the appropriate single classifiers by means of an evolutionary algorithm. Different base classifiers, which have been chosen from different classifier families, are used as candidates in order to obtain variability in the classifications given. Experimental results carried out with 20 databases from the UCI Repository show how adequate the proposed approach is; Stacked Generalization multi-classifier has been selected to perform the experimental comparisons. (C) 2015 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Chemistry, Analytical

3D Convolutional Neural Networks Initialized from Pretrained 2D Convolutional Neural Networks for Classification of Industrial Parts

Ibon Merino, Jon Azpiazu, Anthony Remazeilles, Basilio Sierra

Summary: In this study, transferring pretrained weights from 2D networks to their corresponding 3D versions improved the performance of 3D deep learning methods. EfficientNetB0 achieved the highest accuracy in industrial object recognition using extrusion, which is comparable to state-of-the art methods.

SENSORS (2021)

Article Chemistry, Analytical

Measurement Time Reduction by Means of Mathematical Modeling of Enzyme Mediated RedOx Reaction in Food Samples Biosensors

Arantzazu Florez, Elena Murga, Itziar Ortiz de Zarate, Arrate Jaureguibeitia, Arkaitz Artetxe, Basilio Sierra

Summary: The use of biosensors in the food industry is increasingly necessary for real-time measurement of different analytes in food. By modeling the kinetic reaction and adjusting an exponential decay model to the biosensor response, a novel mathematical approach is proposed to estimate the measurement output in advance, reducing the required measurement time by about 40% while maintaining low error rates to meet industry accuracy standards.

SENSORS (2021)

Article Chemistry, Analytical

A Cyber-Physical Data Collection System Integrating Remote Sensing and Wireless Sensor Networks for Coffee Leaf Rust Diagnosis

David Velasquez, Alejandro Sanchez, Sebastian Sarmiento, Camilo Velasquez, Mauricio Toro, Edwin Montoya, Helmuth Trefftz, Mikel Maiza, Basilio Sierra

Summary: Coffee Leaf Rust (CLR) is a fungal epidemic disease affecting coffee trees globally since the 1980s. An integrated cyber-physical data-collection system was developed using Remote Sensing and Wireless Sensor Networks to gather CLR data on a test bench coffee-crop. This system can automatically collect, structure, store, and transfer reliable multi-type data from various field sensors and cameras for CLR diagnosis.

SENSORS (2021)

Article Computer Science, Information Systems

A Real Application of an Autonomous Industrial Mobile Manipulator within Industrial Context

Jose Luis Outon, Ibon Merino, Ivan Villaverde, Aitor Ibarguren, Hector Herrero, Paul Daelman, Basilio Sierra

Summary: The SHERLOCK project aims to integrate an autonomous industrial mobile manipulator (AIMM) to perform cooperative tasks between a robot and a human. By combining autonomous navigation and 3D perception technology, AIMM achieved pose estimation and manipulation of industrial objects in a real environment with a success rate of 83.33%.

ELECTRONICS (2021)

Article Automation & Control Systems

Adaptive Dendritic Cell-Deep Learning Approach for Industrial Prognosis Under Changing Conditions

Alberto Diez-Olivan, Patxi Ortego, Javier Del Ser, Itziar Landa-Torres, Diego Galar, David Camacho, Basilio Sierra

Summary: Industrial prognosis involves predicting failures of industrial assets based on data collected by IoT sensors, but concept drift can impact the data over time. To address this, contextual and operational changes must be detected and managed to trigger rapid model adaptation mechanisms. The proposed adaptive learning approach using a dendritic cell algorithm and neural network model demonstrated superior performance compared to other drift detectors and classification models in experimental results on a real-world industrial problem.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2021)

Article Automation & Control Systems

Efficient large-scale face clustering using an online Mixture of Gaussians

David Montero, Naiara Aginako, Basilio Sierra, Marcos Nieto

Summary: The demand for real-time face clustering algorithms has increased in recent years, especially for security and surveillance purposes. However, current methods are not suitable for real-time applications and online methods are less accurate. To address these limitations, researchers propose an online gaussian mixture-based clustering method (OGMC) that reduces dependency on data order and size and can handle complex data distributions.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2022)

Review Chemistry, Analytical

RANSAC for Robotic Applications: A Survey

Jose Maria Martinez-Otzeta, Itsaso Rodriguez-Moreno, Inigo Mendialdua, Basilio Sierra

Summary: Random Sample Consensus (RANSAC) is a robust estimation method for models contaminated by outliers. It starts with sample selection, evaluates the adequacy of the estimation, and repeats the process until a stopping criterion is met. RANSAC is widely used in robotics, particularly for finding geometric shapes in point clouds or estimating camera view transformations.

SENSORS (2023)

Article Computer Science, Artificial Intelligence

CatSight, a direct path to proper multi-variate time series change detection: perceiving a concept drift through common spatial pattern

Arantzazu Florez, Itsaso Rodriguez-Moreno, Arkaitz Artetxe, Igor Garcia Olaizola, Basilio Sierra

Summary: Detecting changes in data streams is a crucial problem in Industry 4.0. Traditional machine learning algorithms are often static and lack the ability to generalize to new concepts, resulting in a deterioration of predictive performance when there is a change in data distribution. Drift detecting methods offer a solution to identify concept drift in data. This paper introduces CatSight, a new approach for detecting sudden or abrupt drift in industrial processes, which combines Common Spatial Patterns with traditional machine learning algorithms and demonstrates its effectiveness through evaluation on a real use case.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Article Engineering, Electrical & Electronic

Semi-Automatic Validation and Verification Framework for CV&AI-Enhanced Railway Signaling and Landmark Detector

Mikel Labayen, Xabier Mendialdua, Naiara Aginako, Basilio Sierra

Summary: The automation of railway operations is growing, but there are no accepted certification rules for computer vision and AI-enhanced perception technologies. To meet the needs for trusted AI solutions, a semi-automatic system based on virtual scenarios is being developed to evaluate performance under different visibility conditions.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Computer Science, Information Systems

On the Evaluation, Management and Improvement of Data Quality in Streaming Time Series

Meritxell Gomez-Omella, Basilio Sierra, Susana Ferreiro

Summary: The Internet of Things (IoT) technologies play a crucial role in Industry 4.0, digitizing industries and services for enhanced productivity. This research proposes metrics to measure Data Quality (DQ) in streaming time series and implements techniques and tools for monitoring and improving information quality.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

A Hybrid Machine-Learning Ensemble for Anomaly Detection in Real-Time Industry 4.0 Systems

David Velasquez, Enrique Perez, Xabier Oregui, Arkaitz Artetxe, Jorge Manteca, Jordi Escayola Mansilla, Mauricio Toro, Mikel Maiza, Basilio Sierra

Summary: This research proposes a hybrid machine learning model for real-time fault and anomaly detection in industrial systems. The results show that the model performs well in improving anomaly detection.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

A New Approach for Video Action Recognition: CSP-Based Filtering for Video to Image Transformation

Itsaso Rodriguez-Moreno, Jose Maria Martinez-Otzeta, Izaro Goienetxea, Igor Rodriguez, Basilio Sierra

Summary: This paper introduces an approach using CSP algorithm to classify videos based on skeleton joints signals, and ultimately achieve action recognition through image classification techniques. The results of the tests indicate promising outcomes on two data sets.

IEEE ACCESS (2021)

Article Computer Science, Information Systems

Online Student Authentication and Proctoring System Based on Multimodal Biometrics Technology

Mikel Labayen, Ricardo Vea, Julian Florez, Naiara Aginako, Basilio Sierra

Summary: Identity verification and proctoring are key challenges in online learning, especially for certification. Various technologies with different levels of automation are available to address these issues.

IEEE ACCESS (2021)

Article Computer Science, Information Systems

Enhancing VTOL Multirotor Performance With a Passive Rotor Tilting Mechanism

Imanol Iriarte, Inaki Iglesias, Joseba Lasa, Hodei Calvo-Soraluze, Basilio Sierra

Summary: This article discusses the benefits of introducing a simple passive mechanism to enable rotor tilting in VTOL multirotor vehicles. By comparing two different architectures of vehicles in a vehicle simulator, it is shown that introducing a passive rotor tilting mechanism can improve vehicle stability, reduce energy consumption, increase passenger comfort, and improve position tracking precision.

IEEE ACCESS (2021)

Article Computer Science, Information Systems

Towards Smart Data Selection From Tithe Series Using Statistical Methods

Amaia Gil, Marco Quartulli, Igor G. Olaizola, Basilio Sierra

Summary: This paper proposes a method for adaptively selecting optimal data points for sensor time series on a window-by-window basis, focusing on quantifying the effect of applying data selection algorithms to time series windows. The approach is validated on synthetically generated time series and the entire UCR time series public data archive.

IEEE ACCESS (2021)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)