4.6 Article

Weighted extreme learning machine for imbalance learning

Journal

NEUROCOMPUTING
Volume 101, Issue -, Pages 229-242

Publisher

ELSEVIER
DOI: 10.1016/j.neucom.2012.08.010

Keywords

Extreme learning machine; Imbalanced learning; Single hidden layer feedforward networks; Weighted extreme learning machine

Funding

  1. Natural Science Foundation of China [61173066]
  2. Beijing Natural Science Foundation [4112056]

Ask authors/readers for more resources

Extreme learning machine (ELM) is a competitive machine learning technique, which is simple in theory and fast in implementation. The network types are generalized single hidden layer feedforward networks, which are quite diversified in the form of variety in feature mapping functions or kernels. To deal with data with imbalanced class distribution, a weighted ELM is proposed which is able to generalize to balanced data. The proposed method maintains the advantages from original ELM: (1) it is simple in theory and convenient in implementation; (2) a wide type of feature mapping functions or kernels are available for the proposed framework; (3) the proposed method can be applied directly into multiclass classification tasks. In addition, after integrating with the weighting scheme, (1) the weighted ELM is able to deal with data with imbalanced class distribution while maintain the good performance on well balanced data as unweighted ELM; (2) by assigning different weights for each example according to users' needs, the weighted ELM can be generalized to cost sensitive learning. (C) 2012 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Optics

Face recognition using total loss function on face database with ID photos

Dongshun Cui, Guanghao Zhang, Kai Hu, Wei Han, Guang-Bin Huang

OPTICS AND LASER TECHNOLOGY (2019)

Article Automation & Control Systems

Content-Insensitive Blind Image Blurriness Assessment Using Weibull Statistics and Sparse Extreme Learning Machine

Chenwei Deng, Shuigen Wang, Zhen Li, Guang-Bin Huang, Weisi Lin

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2019)

Editorial Material Computer Science, Artificial Intelligence

Hierarchical extreme learning machines

Guang-Bin Huang, Jonathan Wu, Donald C. Wunsch

NEUROCOMPUTING (2018)

Article Computer Science, Artificial Intelligence

Extreme Learning Machine for Joint Embedding and Clustering

Tianchi Liu, Chamara Kasun Liyanaarachchi Lekamalage, Guang-Bin Huang, Zhiping Lin

NEUROCOMPUTING (2018)

Article Computer Science, Artificial Intelligence

ELM based smile detection using Distance Vector

Dongshun Cui, Guang-Bin Huang, Tianchi Liu

PATTERN RECOGNITION (2018)

Article Automation & Control Systems

Taste Recognition in E-Tongue Using Local Discriminant Preservation Projection

Lei Zhang, Xuehan Wang, Guang-Bin Huang, Tao Liu, Xiaoheng Tan

IEEE TRANSACTIONS ON CYBERNETICS (2019)

Editorial Material Engineering, Electrical & Electronic

Learning Algorithms and Signal Processing for Brain-Inspired Computing

Osvaldo Simeone, Bipin Rajendran, Andre Gruning, Evangelos S. Eleftheriou, Mike Davies, Sophie Deneve, Guang-Bin Huang

IEEE SIGNAL PROCESSING MAGAZINE (2019)

Article Automation & Control Systems

Learning Representations With Local and Global Geometries Preserved for Machine Fault Diagnosis

Yue Li, Chamara Kasun Liyanaarachchi Lekamalage, Tianchi Liu, Pin-An Chen, Guang-Bin Huang

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2020)

Article Computer Science, Artificial Intelligence

Manifold Criterion Guided Transfer Learning via Intermediate Domain Generation

Lei Zhang, Shanshan Wang, Guang-Bin Huang, Wangmeng Zuo, Jian Yang, David Zhang

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2019)

Article Automation & Control Systems

Blind Noisy Image Quality Assessment Using Sub-Band Kurtosis

Chenwei Deng, Shuigen Wang, Alan C. Bovik, Guang-Bin Huang, Baojun Zhao

IEEE TRANSACTIONS ON CYBERNETICS (2020)

Article Automation & Control Systems

Slice-Based Online Convolutional Dictionary Learning

Yijie Zeng, Jichao Chen, Guang-Bin Huang

Summary: The article introduces a novel online CDL algorithm based on a local, slice-based representation that is efficient in handling large datasets and achieving superior performance. Theoretical analysis and experiments demonstrate that the algorithm has lower time complexity and better reconstruction objectives compared to existing methods.

IEEE TRANSACTIONS ON CYBERNETICS (2021)

Article Engineering, Civil

Real-Time Illegal Parking Detection Algorithm in Urban Environments

Xinggan Peng, Rongzihan Song, Qi Cao, Yue Li, Dongshun Cui, Xiaofan Jia, Zhiping Lin, Guang-Bin Huang

Summary: This paper proposes a novel detection algorithm using in-vehicle cameras for illegal parking detection. A new dataset and a labeling method are also introduced. The experiments show that the proposed algorithm has strong illumination robustness in different operating environments.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Engineering, Biomedical

DeeptDCS: Deep Learning-Based Estimation of Currents Induced During Transcranial Direct Current Stimulation

Xiaofan Jia, Sadeed Bin Sayed, Nahian Ibn Hasan, Luis J. Gomez, Guang-Bin Huang, Abdulkadir C. Yucel

Summary: This paper proposes a deep learning-based emulator called DeeptDCS for rapidly evaluating the current density induced by transcranial direct current stimulation (tDCS). The emulator utilizes Attention U-net model to generate the three-dimensional current density distribution across the entire head based on the volume conductor models of head tissues. By fine-tuning the model, the generalization ability of DeeptDCS to non-trained electrode configurations can be greatly enhanced. DeeptDCS provides satisfactorily accurate results and is significantly faster than a physics-based open-source simulator.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2023)

Proceedings Paper Automation & Control Systems

Robust Real-time Face Tracking for People Wearing Face Masks

Xinggan Peng, Huiping Zhuang, Guang-Bin Huang, Haizhou Li, Zhiping Lin

16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020) (2020)

Article Engineering, Electrical & Electronic

NOx Measurements in Vehicle Exhaust Using Advanced Deep ELM Networks

Tinghui Ouyang, Chongwu Wang, Zhangjun Yu, Robert Stach, Boris Mizaikoff, Guang-Bin Huang, Qi-Jie Wang

Summary: This study suggests utilizing spectroscopic gas sensing methods and a deep learning network algorithm to measure NOx concentrations in sustainable developments, showing the effectiveness of the approach in emission monitoring.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2021)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)