4.6 Article

Robust multivariate L1 principal component analysis and dimensionality reduction

Journal

NEUROCOMPUTING
Volume 72, Issue 4-6, Pages 1242-1249

Publisher

ELSEVIER
DOI: 10.1016/j.neucom.2008.01.027

Keywords

Robust L1 PCA; EM algorithm; Dimensionality reduction

Ask authors/readers for more resources

Further to our recent work on the robust L1 PCA we introduce a new version of robust PCA model based on the so-called multivariate Laplace distribution (called L1 distribution) proposed in Eltoft et al. [2006. On the multivariate Laplace distribution. IEEE Signal Process. Lett. 13(5), 300-303]. Due to the heavy tail and high component dependency characteristics of the multivariate L1 distribution, the proposed model is expected to be more robust against data outliers and fitting component dependency. Additionally. we demonstrate how a variational approximation scheme enables effective inference of key parameters in the probabilistic multivariate L1-PCA model. By doing so, a tractable Bayesian inference can be achieved based on the variational EM-type algorithm. (C) 2008 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Domain Adaptation as Optimal Transport on Grassmann Manifolds

Tianhang Long, Yanfeng Sun, Junbin Gao, Yongli Hu, Baocai Yin

Summary: This article focuses on domain adaptation on the classic Grassmann manifolds and proposes an optimal transport-based model to achieve adaptation between datasets. It introduces regularization terms to maintain task-related consistency and presents a simplified model to reduce computational cost.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Information Systems

Multi-Concept Representation Learning for Knowledge Graph Completion

Jiapu Wang, Boyue Wang, Junbin Gao, Yongli Hu, Baocai Yin

Summary: This article proposes a Multi-concept Representation Learning (McRL) method for Knowledge Graph Completion (KGC), which infers missing entities or relations. Experimental results show that the proposed method outperforms existing state-of-the-art KGC methods on several standard datasets.

ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA (2023)

Article Engineering, Civil

Hierarchical Spatio-Temporal Graph Convolutional Networks and Transformer Network for Traffic Flow Forecasting

Guangyu Huo, Yong Zhang, Boyue Wang, Junbin Gao, Yongli Hu, Baocai Yin

Summary: In this study, a hierarchical traffic flow forecasting network is proposed by combining the long-term temporal Transformer network (LTT) and the spatio-temporal graph convolutional networks (STGC). This method can capture both short-term and long-term temporal relations in traffic flow data and mitigate the over-smoothing problem of graph convolutional networks (GCN).

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2023)

Article Engineering, Biomedical

Image Segmentation for MR Brain Tumor Detection Using Machine Learning: A Review

Toufique A. Soomro, Lihong Zheng, Ahmed J. Afifi, Ahmed Ali, Shafiullah Soomro, Ming Yin, Junbin Gao

Summary: Magnetic Resonance Imaging (MRI) is commonly used in brain disease detection and diagnosis, providing three-dimensional images for precise anomaly identification. However, the process is time-consuming. Machine learning and efficient computation offer a computer-aided solution for quick and accurate abnormality identification. Brain tumor segmentation from MRI images is a hot research topic, and deep learning methods are found to be more effective in this regard.

IEEE REVIEWS IN BIOMEDICAL ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

CaEGCN: Cross-Attention Fusion Based Enhanced Graph Convolutional Network for Clustering

Guangyu Huo, Yong Zhang, Junbin Gao, Boyue Wang, Yongli Hu, Baocai Yin

Summary: This paper proposes a cross-attention based deep clustering framework, named CaEGCN, which can extract the most discriminative information from individual data and produce more satisfactory clustering results. The framework consists of four main modules: the cross-attention fusion module, the Content Auto-encoder module (CAE), the Graph Convolutional Auto-encoder module (GAE), and the self-supervised model for clustering tasks. Experimental results demonstrate the superiority and robustness of the proposed CaEGCN.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2023)

Article Computer Science, Artificial Intelligence

Graph contrastive learning with implicit augmentations

Huidong Liang, Xingjian Du, Bilei Zhu, Zejun Ma, Ke Chen, Junbin Gao

Summary: This paper presents iGCL, an Implicit Graph Contrastive Learning method that utilizes augmentations in the latent space learned from a Variational Graph Auto-Encoder to reconstruct graph topological structure. The proposed method achieves state-of-the-art accuracy on downstream classification tasks and improves learning efficiency.

NEURAL NETWORKS (2023)

Article Computer Science, Information Systems

CSD-RkNN: reverse k nearest neighbors queries with conic section discriminances

Yang Li, Mingyuan Bai, Qingfeng Guan, Zi Ming, Xun Liang, Gang Liu, Junbin Gao

Summary: The reverse k nearest neighbors (RkNN) query is a time-consuming spatial query used in various domains. We propose a verification approach called CSD to reduce query time and complexity by determining whether points belong to the RkNN set. Additionally, we introduce a Voronoi-based candidate generation method to reduce the candidate set size. Experimental results demonstrate that our CSD-RkNN algorithm outperforms other algorithms, especially for large k values.

INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE (2023)

Article Computer Science, Artificial Intelligence

MATHNET: Haar-like wavelet multiresolution analysis for graph representation learning

Xuebin Zheng, Bingxin Zhou, Ming Li, Yu Guang Wang, Junbin Gao

Summary: This paper proposes a framework for graph neural networks called MATHNET, which utilizes multiresolution Haar-like wavelets and interrelated convolution and pooling strategies to achieve consistent graph representations for label prediction. The proposed MATHNET outperforms other existing GNN models, particularly on large datasets.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Hierarchical Graph Convolutional Networks for Structured Long Document Classification

Tengfei Liu, Yongli Hu, Boyue Wang, Yanfeng Sun, Junbin Gao, Baocai Yin

Summary: The article introduces a novel hierarchical graph convolutional network (HGCN) for structured long document classification. The network models macrostructure using a section graph network, extracts fine-grained features using a word graph network, and integrates the two networks with an interaction strategy. Experimental results show that the proposed method outperforms state-of-the-art related classification methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Exploiting Neighbor Effect: Conv-Agnostic GNN Framework for Graphs With Heterophily

Jie Chen, Shouzhen Chen, Junbin Gao, Zengfeng Huang, Junping Zhang, Jian Pu

Summary: Due to the homophily assumption, graph neural networks (GNNs) are believed to perform well on homophilic graphs but may fail on heterophilic graphs. However, existing metrics cannot accurately explain GNNs' performance on heterophilic datasets. In this work, we propose a new metric and a framework called CAGNNs to enhance GNNs' performance on heterophily datasets. Experimental results show significant improvements compared to other GNN models.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

QDN: A Quadruplet Distributor Network for Temporal Knowledge Graph Completion

Jiapu Wang, Boyue Wang, Junbin Gao, Xiaoyan Li, Yongli Hu, Baocai Yin

Summary: This article introduces a novel TKGC method called the quadruplet distributor network (QDN), which independently models the embeddings of entities, relations, and timestamps to fully capture the semantics and uses a quadruplet-specific decoder for integration. A novel temporal regularization method is also proposed. Experimental results demonstrate the superior performance of the proposed method.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Beyond low-pass filtering on large-scale graphs via Adaptive Filtering Graph Neural Networks

Qi Zhang, Jinghua Li, Yanfeng Sun, Shaofan Wang, Junbin Gao, Baocai Yin

Summary: This paper proposes a novel graph neural network called AFGNN, which can capture all frequency information on large-scale graphs. AFGNN consists of two stages: the first stage extracts comprehensive frequency information using low-, middle-, and high-pass graph filters, while the second stage generates customized graph filters for each node using node-level attention-based feature combination. Experimental results demonstrate the superiority of AFGNN over other scalable GNNs and spectral GNNs.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Graph Decoupling Attention Markov Networks for Semisupervised Graph Node Classification

Jie Chen, Shouzhen Chen, Mingyuan Bai, Jian Pu, Junping Zhang, Junbin Gao

Summary: Graph neural networks (GNNs) are widely used in graph node classification tasks, but suffer from negative disturbances caused by edges connecting nodes with different labels. This article proposes a decoupling attention mechanism that utilizes both hard and soft attention to address this issue. Hard attention is learned on labels to refine the graph structure and reduce negative disturbances, while soft attention learns aggregation weights based on features to enhance information gains during message passing. The proposed method is validated on six benchmark graph datasets.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Multi-Attribute Subspace Clustering via Auto-Weighted Tensor Nuclear Norm Minimization

Jipeng Guo, Yanfeng Sun, Junbin Gao, Yongli Hu, Baocai Yin

Summary: This paper proposes a novel multi-attribute subspace clustering (MASC) model that understands data from multiple attributes. By exploiting the intrinsic multi-attribute features, MASC simultaneously learns multiple subspace representations corresponding to each specific attribute. By aggregating these multi-attribute representations, a more comprehensive subspace representation can be obtained, leading to improved clustering performance.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Computer Science, Artificial Intelligence

Parallelly Adaptive Graph Convolutional Clustering Model

Xiaxia He, Boyue Wang, Yongli Hu, Junbin Gao, Yanfeng Sun, Baocai Yin

Summary: In this article, we propose a novel end-to-end parallelly adaptive graph convolutional clustering (AGCC) model to improve the performance of graph convolutional network (GCN) by adaptively learning the graph structure from the data. The model consists of two pathway networks, one for updating the graph structure and the data representation layer, and the other for extracting data features. To effectively connect these two pathways, an attention-mechanism-based fusion module is also proposed.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)