4.6 Review

Twin support vector machine: theory, algorithm and applications

Journal

NEURAL COMPUTING & APPLICATIONS
Volume 28, Issue 11, Pages 3119-3130

Publisher

SPRINGER LONDON LTD
DOI: 10.1007/s00521-016-2245-4

Keywords

Twin support vector machine; Proximal support vector machine; Generalized eigenvalue proximal support vector machine

Funding

  1. National Natural Science Foundation of China [61379101]

Ask authors/readers for more resources

Twin support vector machine (TWSVM) has gained increasing interest from various research fields recently. In this paper, we aim to report the current state of the theoretical research and practical advances on TWSVM. We first give the basic thought and theory of TWSVM, including the theory of proximal support vector machine, generalized eigenvalue proximal support vector machine, and TWSVM. Then, we focus on the various improvements made to TWSVM, mainly including least squares twin support vector machine, smooth twin support vector machine, regularized twin support vector machine, projection twin support vector machine, and modified TWSVM on the model selection problem. These newly emerging algorithms greatly expand the applications of TWSVM. In recent years, there is a lot of research on application of TWSVM. Next, we list some research on application of TWSVM in detail. Finally, we try to provide a comprehensive view of these advances in TWSVM and discuss the direction of future research.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Hypergraph based semi-supervised support vector machine for binary and multi-category classifications

Yuting Sun, Shifei Ding, ZiChen Zhang, Chenglong Zhang

Summary: A semi-supervised support vector machine algorithm based on hypergraph was proposed in this study to effectively utilize unlabeled data for semi-supervised learning, introducing manifold regularization term to capture the complex relations between data. Experiments demonstrated the effectiveness of the algorithm in binary and multi-category classification tasks.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2022)

Article Computer Science, Artificial Intelligence

Incomplete multiview nonnegative representation learning with multiple graphs

Nan Zhang, Shiliang Sun

Summary: Multiview clustering is an important research topic, and incomplete views of data instances are common in real-world scenarios. To address this issue, we propose an effective incomplete multiview nonnegative representation learning framework that can handle incomplete multiview clustering in various situations and achieves better results compared to other state-of-the-art algorithms.

PATTERN RECOGNITION (2022)

Article Computer Science, Artificial Intelligence

A Gaussian RBM with binary auxiliary units

Jian Zhang, Shifei Ding, Tongfeng Sun, Lili Guo

Summary: The paper proposes a Gaussian Restricted Boltzmann Machine with binary Auxiliary units (GARBM) for image processing, which can extract real-valued features and alleviate the overfitting problem. By designing binary auxiliary units in the visible layer and constructing parameterized real-valued features in the hidden layer, the proposed GARBM-based deep neural networks achieve effective image recognition and generation tasks.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2022)

Article Automation & Control Systems

Multiview Graph Restricted Boltzmann Machines

Nan Zhang, Shiliang Sun

Summary: The study introduces a novel multiview graph RBM model that simultaneously conducts local structural learning and multiview representation learning, achieving superior performance in multiview classification tasks compared to other state-of-the-art multiview classification algorithms.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Computer Science, Artificial Intelligence

Density peaks clustering algorithm based on improved similarity and allocation strategy

Shifei Ding, Wei Du, Chao Li, Xiao Xu, Lijuan Wang, Ling Ding

Summary: The improved density peaks clustering algorithms (DPCV and MDDPC) based on the density peaks clustering algorithm have improved clustering accuracy by using methods such as variance and Manhattan distance, while solving problems such as the inability to effectively identify cluster centers and the chain reaction caused by error allocation.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Article Computer Science, Artificial Intelligence

Maximum density minimum redundancy based hypergraph regularized support vector regression

Shifei Ding, Yuting Sun, Jian Zhang, Lili Guo, Xiao Xu, Zichen Zhang

Summary: Semi-supervised learning is widely used in machine learning, but most methods are not suitable for regression. This paper proposes a hypergraph regularized support vector regression (HGSVR) method which utilizes the hypergraph to represent the geometric structure of data. Additionally, a two-layer maximum density minimum redundancy method (MDMR) is introduced to pre-select initial labeled data, and a second semi-supervised regression called MDMR-HGSVR is proposed. Experimental results on 9 UCI datasets demonstrate the superiority of HGSVR and MDMR-HGSVR over other compared methods.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Article Computer Science, Artificial Intelligence

Widely-activated network merging perceptual loss via discrete wavelet transform for image super-resolution

Lili Guo, Yanru Wang, Fanchao Wang, Ling Ding, Shifei Ding

Summary: This article proposes a new image super-resolution reconstruction method called P-WAN, which can improve the utilization of image features from different layers and overcome the problem of blurred texture edges in reconstructed images due to lack of high frequency information. Based on P-WAN, a DP-WAN method is further proposed, which reconstructs better high frequency information and higher quality texture edges by adding discrete wavelet transform. Experimental results demonstrate that the proposed method achieves the best performance in objective evaluation and provides a good visual experience in subjective visual evaluation.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Article Computer Science, Artificial Intelligence

Incremental Multilayer Broad Learning System With Stochastic Configuration Algorithm for Regression

Shifei Ding, Chenglong Zhang, Jian Zhang, Lili Guo, Ling Ding

Summary: Broad learning system (BLS) is a faster modeling framework. However, the incremental mode lacks self-supervision mechanism, which limits its adaptability. In this study, a novel incremental multilayer BLS based on the stochastic configuration (SC) algorithm is proposed for regression, named IMLBLS-SC. Experimental results show that IMLBLS-SC outperforms other models.

IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Multiagent Reinforcement Learning With Heterogeneous Graph Attention Network

Wei Du, Shifei Ding, Chenglong Zhang, Zhongzhi Shi

Summary: Most recent research on MARL has focused on deploying cooperative policies for homogeneous agents, but realistic multiagent environments may have heterogeneous agents. To tackle the challenges posed by heterogeneity and diverse relationships, the researchers propose a novel method that uses a heterogeneous graph attention network to model the relationships between heterogeneous agents.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

DSTCNet: Deep Spectro-Temporal-Channel Attention Network for Speech Emotion Recognition

Lili Guo, Shifei Ding, Longbiao Wang, Jianwu Dang

Summary: This article introduces a deep spectro-temporal-channel network (DSTCNet) for speech emotion recognition, which improves the representation ability by integrating multiple spectro-temporal-channel attention modules. Experimental results show that DSTCNet outperforms traditional CNN-based methods and several state-of-the-art methods in emotion recognition.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Multiview Unsupervised Shapelet Learning for Multivariate Time Series Clustering

Nan Zhang, Shiliang Sun

Summary: Multivariate time series clustering is a significant research topic in time series learning, aiming to discover correlations among multiple sequences and divide multimodal time series data into subsets. This paper proposes a novel unsupervised shapelet learning with adaptive neighbors (USLA) model for learning salient multivariate subsequences. The paper also introduces a multiview USLA (MUSLA) model which treats different-length shapelets as different views, achieving better performance on real-world multivariate time series datasets.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Multiagent Reinforcement Learning With Graphical Mutual Information Maximization

Shifei Ding, Wei Du, Ling Ding, Jian Zhang, Lili Guo, Bo An

Summary: Communication learning is an important research direction in the MARL domain. GNNs can aggregate neighbor nodes' information for representation learning. However, simply aggregating the information of neighboring agents through GNNs may not extract enough useful information, and the topological relationship information is ignored.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Horizontal Federated Density Peaks Clustering

Shifei Ding, Chao Li, Xiao Xu, Lili Guo, Ling Ding, Xindong Wu

Summary: This paper proposes a horizontal federated DPC (HFDPC) algorithm, which introduces the idea of horizontal federated learning and uses similar density chain (SDC) to address the issues of privacy data leakage and the Domino effect in DPC algorithm. Experimental results show improvements in accuracy and speed.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Incomplete Multiview Nonnegative Representation Learning With Graph Completion and Adaptive Neighbors

Shiliang Sun, Nan Zhang

Summary: This paper introduces a novel Incomplete Multiview Nonnegative representation learning model (IMNGA) that simultaneously performs graph learning, missing graph completion, and consensus representation learning, effectively addressing the issue of modeling correlations in incomplete multiview clustering.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Hardware & Architecture

Emotion Recognition With Multimodal Transformer Fusion Framework Based on Acoustic and Lexical Information

Lili Guo, Longbiao Wang, Jianwu Dang, Yahui Fu, Jiaxing Liu, Shifei Ding

Summary: This article proposes an implicitly aligned multimodal transformer fusion framework based on acoustic features and text information for emotion recognition. The model allows two modalities to guide and complement each other, and uses weighted fusion to control the contributions of different modalities, thereby obtaining more complementary emotional representations. Experiments have shown that this method outperforms baseline methods.

IEEE MULTIMEDIA (2022)

No Data Available