4.6 Article

Joint sparse representation for video-based face recognition

期刊

NEUROCOMPUTING
卷 135, 期 -, 页码 306-312

出版社

ELSEVIER
DOI: 10.1016/j.neucom.2013.12.004

关键词

Face recognition; Sparse representation; Structured sparse representation; Accelerated proximal gradient

资金

  1. Natural Science Foundation of China [61025010, 61222211, 61202297, 61003103]
  2. Natural Science Foundation of Fujian Province [2013J01239]

向作者/读者索取更多资源

Video-based Face Recognition (VFR) can be converted into the problem of measuring the similarity of two image sets, where the examples from a video clip construct one image set. In this paper, we consider face images from each clip as an ensemble and formulate VFR into the Joint Sparse Representation USR) problem. In JSR, to adaptively learn the sparse representation of a probe clip, we simultaneously consider the class-level and atom-level sparsity, where the former structurizes the enrolled clips using the structured sparse regularizer (i.e., 1.(2,1)-norm) and the latter seeks for a few related examples using the sparse regularizer (i.e., L-1 norm). Besides, we also consider to pre-train a compacted dictionary to accelerate the algorithm, and impose the non-negativity constraint on the recovered coefficients to encourage positive correlations of the representation. The classification is ruled in favor of the class that has the lowest accumulated reconstruction error. We conduct extensive experiments on three real-world databases: Honda, MoBo and YouTube Celebrities (YTC). The results demonstrate that our method is more competitive than those state-of-the-art VFR methods. (c) 2013 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Locality-Aware Channel-Wise Dropout for Occluded Face Recognition

Mingjie He, Jie Zhang, Shiguang Shan, Xiao Liu, Zhongqin Wu, Xilin Chen

Summary: In this paper, a novel method for simulating occlusion by dropping the activations of a group of neurons is proposed, along with an attention module to improve the contributions of non-occluded regions. Experimental results show that the proposed method achieves significant improvements in the robustness and accuracy of face recognition.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Computer Science, Information Systems

Person Search by a Bi-Directional Task-Consistent Learning Model

Cheng Wang, Bingpeng Ma, Hong Chang, Shiguang Shan, Xilin Chen

Summary: This paper introduces a novel Bi-directional Task-Consistent Learning (BTCL) person search framework, which includes a Target-Specific Detector (TSD) and a re-ID model with Dynamic Adaptive Learning Structure (DALS) to meet the consistency needs between the detection and re-ID stages. Experimental results show that the framework achieves state-of-the-art performance on two widely-used person search datasets.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Artificial Intelligence

CMOS-GAN: Semi-Supervised Generative Adversarial Model for Cross-Modality Face Image Synthesis

Shikang Yu, Hu Han, Shiguang Shan, Xilin Chen

Summary: This paper proposes a novel semi-supervised cross-modality synthesis method (CMOS-GAN) that can leverage both paired and unpaired face images to learn a robust cross-modality synthesis model. Experimental results show that the proposed method outperforms the state-of-the-art in three cross-modality face synthesis tasks.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Artificial Intelligence

Importance First: Generating Scene Graph of Human Interest

Wenbin Wang, Ruiping Wang, Shiguang Shan, Xilin Chen

Summary: This study proposes a method for modeling human perception based on scene graphs, which generates a hierarchically constructed scene graph to present the primary content first and then the secondary content on demand. The method represents the scene with a hierarchical structure and utilizes a hierarchical contextual propagation module to model the structural information. It further highlights the key relationships in the scene graph through relationship re-ranking. Experimental results demonstrate that the method achieves state-of-the-art performance in scene graph generation and excels at mining image-specific relationships.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2023)

Article Computer Science, Artificial Intelligence

Meta Auxiliary Learning for Facial Action Unit Detection

Yong Li, Shiguang Shan

Summary: In this study, a Meta Auxiliary Learning method (MAL) is proposed to automatically select highly related facial expression (FE) samples for better facial action unit (AU) detection performance. Experimental results demonstrate that MAL consistently improves AU detection performance compared with state-of-the-art multi-task and auxiliary learning methods.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2023)

Proceedings Paper Computer Science, Cybernetics

Gaze Pattern Recognition in Dyadic Communication

Fei Chang, Jiabei Zeng, Qiaoyun Liu, Shiguang Shan

Summary: Analyzing gaze patterns is crucial for understanding communication. Current studies have mainly focused on detecting single patterns, such as mutual gaze or shared attention. This work redefines five static gaze patterns that cover all statuses during dyadic communication and proposes a network to recognize these mutually exclusive patterns from images. Experimental results demonstrate that our method outperforms other solutions on a benchmark for gaze pattern recognition. Our method also achieves state-of-the-art performance on two other single gaze pattern recognition tasks. Analysis of gaze patterns in preschool children confirms findings in psychology.

ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023 (2023)

Article Computer Science, Artificial Intelligence

Contrastive Learning of Person-Independent Representations for Facial Action Unit Detection

Yong Li, Shiguang Shan

Summary: In this paper, the problem of insufficient AU annotations in facial action unit (AU) detection is addressed by learning AU representations from unlabelled facial videos through contrastive learning. The proposed method achieves frame-wise discriminative AU representations within a short video clip and consistent AU representations for facial frames with analogous AUs sampled from different identities. Experimental results demonstrate the discriminative power of the learned AU representation for AU detection.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Artificial Intelligence

CRIC: A VQA Dataset for Compositional Reasoning on Vision and Commonsense

Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen

Summary: Inferring on visual facts and commonsense is crucial for an advanced VQA system. This requires models to surpass literal understanding of commonsense and fully ground it to the visual world. To evaluate this ability comprehensively, we introduce a VQA benchmark called CRIC, which includes new types of questions and an evaluation metric integrating correctness of answering and commonsense grounding. We also propose an automatic algorithm to generate question samples from scene and knowledge graphs, and analyze VQA models on the CRIC dataset. Experimental results demonstrate the challenge of grounding commonsense to image regions and joint reasoning on vision and commonsense. The dataset is available at https://cricvqa.github.io.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Dual Compensation Residual Networks for Class Imbalanced Learning

Ruibing Hou, Hong Chang, Bingpeng Ma, Shiguang Shan, Xilin Chen

Summary: In this study, we propose Dual Compensation Residual Networks to tackle the challenge of learning generalizable representation and classifier for class-imbalanced data in data-driven deep models. We introduce dual Feature Compensation Module (FCM) and Logit Compensation Module (LCM) to alleviate overfitting, and Residual Balanced Multi-Proxies Classifier (RBMC) to mitigate underfitting. Experimental results demonstrate the effectiveness of our approach.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

BLPSeg: Balance the Label Preference in Scribble-Supervised Semantic Segmentation

Yude Wang, Jie Zhang, Meina Kan, Shiguang Shan, Xilin Chen

Summary: Scribble-supervised semantic segmentation is a low-cost weakly supervised technique that diffuses the labeled region of scribble to narrow the supervision gap. However, there is an annotation bias and label preference that affects the model training. To address this, BLPSeg is proposed to balance the label preference and design a local aggregation module to alleviate its impact.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Proceedings Paper Computer Science, Artificial Intelligence

GAN with Multivariate Disentangling for Controllable Hair Editing

Xuyang Guo, Meina Kan, Tianle Chen, Shiguang Shan

Summary: This study proposes an efficient and controllable method for continuous and fine hair editing using sliding bars, while also supporting discrete editing through reference photos and user-painted masks.

COMPUTER VISION - ECCV 2022, PT XV (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Adaptive Image Transformations for Transfer-Based Adversarial Attack

Zheng Yuan, Jie Zhang, Shiguang Shan

Summary: This paper introduces a novel architecture called Adaptive Image Transformation Learner (AITL) to improve the transferability of adversarial examples. Unlike existing works that use fixed combinational transformations, AITL improves the attack success rates by adaptively selecting the most effective combination of image transformations.

COMPUTER VISION - ECCV 2022, PT V (2022)

Article Computer Science, Artificial Intelligence

A Comprehensive Framework for Long-Tailed Learning via Pretraining and Normalization

Nan Kang, Hong Chang, Bingpeng Ma, Shiguang Shan

Summary: This work aims to improve the feature extractor and classifier for long-tailed recognition through contrastive pretraining and feature normalization. It proposes a new balanced contrastive loss and fast contrastive initialization for better pretraining performance. It also introduces a novel generalized normalization classifier that outperforms traditional classifiers. The unified framework achieves competitive performance on long-tailed recognition benchmarks while maintaining high efficiency.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Graph Jigsaw Learning for Cartoon Face Recognition

Yong Li, Lingjie Lao, Zhen Cui, Shiguang Shan, Jian Yang

Summary: This study proposes a method called GraphJigsaw for cartoon face recognition, which utilizes jigsaw puzzles and graph convolutional networks. The proposed method achieves better accuracy compared to other existing methods without requiring manual annotations or additional computational burden during inference.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Computer Science, Artificial Intelligence

Motion Feature Aggregation for Video-Based Person Re-Identification

Xinqian Gu, Hong Chang, Bingpeng Ma, Shiguang Shan

Summary: The proposed Motion Feature Aggregation (MFA) method efficiently models and aggregates motion information in the feature map level for video-based re-identification (re-id), consisting of coarse-grained and fine-grained motion learning modules that can model motion information from different granularities and are complementary to each other.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)