4.7 Article

Lp- and Ls-Norm Distance Based Robust Linear Discriminant Analysis

Journal

NEURAL NETWORKS
Volume 105, Issue -, Pages 393-404

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2018.05.020

Keywords

linear Discriminant Analysis; Lp-norm; Ls-norm; Robustness

Funding

  1. Central Public-interest Scientific Institution Basal Research Fund [CAFYBB2016SZ003]
  2. National Science Foundation of China [61401214, 61773210]
  3. Natural Science Foundation of Jiangsu Province [BK20171453]

Ask authors/readers for more resources

Recently, L1-norm distance measure based Linear Discriminant Analysis (LDA) techniques have been shown to be robust against outliers. However, these methods have no guarantee of obtaining a satisfactory-enough performance due to the insufficient robustness of L1-norm measure. To mitigate this problem, inspired by recent works on Lp-norm based learning, this paper proposes a new discriminant method, called Lp- and Ls-Norm Distance Based Robust Linear Discriminant Analysis (FLDA-Lsp). The proposed method achieves robustness by replacing the L2-norm within-and between-class distances in conventional LDA with Lp-and Ls-norm ones. By specifying the values of p and s, many of previous efforts can be naturally expressed by our objective. The requirement of simultaneously maximizing and minimizing a number of Lp-and Ls-norm terms results in a difficulty to the optimization of the formulated objective. As one of the important contributions of this paper, we design an efficient iterative algorithm to address this problem, and also conduct some insightful analysis on the existence of local minimum and the convergence of the proposed algorithm. Theoretical insights of our method are further supported by promising experimental results on several images databases. (c) 2018 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Automation & Control Systems

Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion

Jie Wen, Zheng Zhang, Zhao Zhang, Lunke Fei, Meng Wang

Summary: This article introduces a simple and effective incomplete multiview clustering framework that considers incomplete multiview data, taking into account both local geometric information and unbalanced discriminating powers. By developing a novel graph-regularized matrix factorization model and introducing a semantic consistency constraint, the common representations learned from different views can maintain local geometric similarities and achieve a unified discriminative representation. Furthermore, the importance of different views is adaptively determined to reduce the negative influence of unbalanced incomplete views, leading to superior clustering performance compared to state-of-the-art multiview learning methods according to extensive experimental results on several incomplete multiview datasets.

IEEE TRANSACTIONS ON CYBERNETICS (2021)

Review Computer Science, Information Systems

CNN-based encoder-decoder networks for salient object detection: A comprehensive review and recent advances

Yuzhu Ji, Haijun Zhang, Zhao Zhang, Ming Liu

Summary: This paper investigates the application of convolutional neural network-based encoder-decoder models in the field of salient object detection. Through extensive experimental research on encoder-decoder models with different parameters, new baseline models that can outperform state-of-the-art performance were discovered.

INFORMATION SCIENCES (2021)

Editorial Material Computer Science, Artificial Intelligence

Editorial: Deep dictionary learning: Algorithm, theory and application

Zhao Zhang, Meng Wang, Sheng Li, Zheng Zhang

NEUROCOMPUTING (2022)

Article Computer Science, Artificial Intelligence

Twin-Incoherent Self-Expressive Locality-Adaptive Latent Dictionary Pair Learning for Classification

Zhao Zhang, Yulin Sun, Yang Wang, Zheng Zhang, Haijun Zhang, Guangcan Liu, Meng Wang

Summary: The proposed SLatDPL model integrates coefficient learning and salient feature extraction, enabling simultaneous discovery of underlying subspaces and salient features. Through twin-incoherence constraint and adaptive weighting strategy, SLatDPL ensures the block-diagonality of encoding coefficients and discriminative salient features. Extensive simulations on multiple public databases demonstrate the satisfactory performance of SLatDPL compared to related methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2021)

Article Computer Science, Information Systems

Deep Active Context Estimation for Automated COVID-19 Diagnosis

Bingzhi Chen, Yishu Liu, Zheng Zhang, Yingjian Li, Zhao Zhang, Guangming Lu, Hongbing Yu

Summary: This study introduces a novel CNN framework DACE for COVID-19 diagnosis, which leverages unlabeled neighbors to progressively learn robust feature representations and generate a well-performed classifier. The framework combines a Long-Short Hierarchical Attention Network (LSHAN) and an efficient context estimation criterion to achieve superior performance.

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS (2021)

Article Computer Science, Information Systems

Visual-Semantic Aligned Bidirectional Network for Zero-Shot Learning

Rui Gao, Xingsong Hou, Jie Qin, Yuming Shen, Yang Long, Li Liu, Zhao Zhang, Ling Shao

Summary: Zero-shot learning aims to recognize unknown categories that are not available during training. Generative models have shown potential to address this problem by synthesizing unseen features based on semantic embeddings. We propose a visual-semantic aligned bidirectional network with cycle consistency to bridge the gap between visual and semantic spaces and generate high-quality unseen features. Two carefully designed strategies are incorporated to improve the overall ZSL performance by enhancing intra-domain class divergence and mitigating inter-domain shift.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Information Systems

Toward Intelligent Design: An AI-Based Fashion Designer Using Generative Adversarial Networks Aided by Sketch and Rendering Generators

Han Yan, Haijun Zhang, Linlin Liu, Dongliang Zhou, Xiaofei Xu, Zhao Zhang, Shuicheng Yan

Summary: The article introduces an AI-based framework for fashion design using generative adversarial networks to enhance designers' efficiency. The framework includes a sketch-generation module based on latent space and a rendering-generation module to learn the mapping between textures and sketches. Experimental results demonstrate the effectiveness of the proposed method in synthesizing semantic-aware textures on sketches.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Artificial Intelligence

Fine-grained multi-view clustering with robust multi-prototypes representation

Hongwei Yin, Guixiang Wang, Wenjun Hu, Zhao Zhang

Summary: Multi-view clustering is a hot research topic that leverages complementary information from multiple views to improve clustering performance. In this paper, a novel fine-grained multi-view clustering method is proposed. It divides the sample space of each view into sub-clusters using multi-prototypes representation, enhances the robustness of representation by reducing sub-cluster overlap, and assigns contribution weights based on clustering capacity. The method integrates robust multi-prototypes representation, fine-grained multi-view fusion, and clustering process into a unified framework, and achieves better clustering accuracy compared to traditional methods.

APPLIED INTELLIGENCE (2023)

Article Automation & Control Systems

Multiview Learning With Robust Double-Sided Twin SVM

Qiaolin Ye, Peng Huang, Zhao Zhang, Yuhui Zheng, Liyong Fu, Wankou Yang

Summary: This article presents a new multiview learning approach, MvRDTSVM, to improve classification performance and robustness by introducing double-sided constraints and using L1-norm as the distance metric. Experimental results confirm the effectiveness of the proposed methods.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Automation & Control Systems

A Survey on Incomplete Multiview Clustering

Jie Wen, Zheng Zhang, Lunke Fei, Bob Zhang, Yong Xu, Zhao Zhang, Jinxing Li

Summary: Conventional multiview clustering methods fail when not all views of samples are available in practical applications. Incomplete multiview clustering (IMC) is developed to address this issue. Recent years have seen significant advances in IMC research, but there are still open problems to be solved.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Engineering, Electrical & Electronic

Motion Stimulation for Compositional Action Recognition

Lei Ma, Yuhui Zheng, Zhao Zhang, Yazhou Yao, Xijian Fan, Qiaolin Ye

Summary: Conventional action recognition algorithms face great challenges in recognizing unseen combinations of action and different objects, which is known as (zero-shot) compositional action recognition in real-world applications. Previous methods rely heavily on manual annotation or the quality of detectors to enhance the dynamic clues of objects in the scene. In this work, we propose a novel Motion Stimulation (MS) block to autonomously mine the temporal clues from moving objects or hands without explicit supervision, which can enhance the ability of compositional generalization for action recognition algorithms when integrated into existing video backbones. Experimental results on three action recognition datasets demonstrate the effectiveness and interpretability of our MS block.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2023)

Article Business

Enterprise Social Media in Workplace: Innovative Use Cases in China

Yuan Sun, Zhebin Ding, Zuopeng Zhang

Summary: In recent years, China has made great progress in the adoption and use of emerging information technologies. The popularity of enterprise social media (ESM) in Chinese enterprises and the resulting innovation practices provide an opportunity to explore relevant theories and assumptions. This article applies the organizational information processing theory (OIPT) to study the innovative use cases of ESM in China and identify contributing factors through a multicase-analysis approach. The research contributes to the literature by studying the innovative use cases in the ESM context and provides valuable insights for practitioners in designing and implementing ESM effectively.

IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT (2023)

Article Computer Science, Artificial Intelligence

Learning to Synthesize Compatible Fashion Items Using Semantic Alignment and Collocation Classification: An Outfit Generation Framework

Dongliang Zhou, Haijun Zhang, Kai Yang, Linlin Liu, Han Yan, Xiaofei Xu, Zhao Zhang, Shuicheng Yan

Summary: The article introduces a novel outfit generation framework OutfitGAN, aiming to synthesize a set of complementary items to compose an entire outfit. Through extensive experiments on a large-scale dataset, OutfitGAN demonstrates superior performance in synthesizing photo-realistic outfits and improving compatibility.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Discriminative Regression With Adaptive Graph Diffusion

Jie Wen, Shijie Deng, Lunke Fei, Zheng Zhang, Bob Zhang, Zhao Zhang, Yong Xu

Summary: In this article, a new linear regression-based multiclass classification method, called DRAGD, is proposed. It explores the high-order structure information and provides a new way to capture the structure of data, resulting in a more discriminative transformation matrix. Experimental results show that DRAGD outperforms existing LR methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking

Yanyan Wei, Zhao Zhang, Yang Wang, Mingliang Xu, Yi Yang, Shuicheng Yan, Meng Wang

Summary: The paper introduces a new unsupervised framework, DerainCycleGAN, for single image rain removal and generation, which utilizes transfer learning and cyclic structures effectively. It also presents an unsupervised rain attentive detector (UARD) to enhance rain information detection, and a new synthetic method for generating rain streaks, improving the processing of real rainy images.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2021)

Article Computer Science, Artificial Intelligence

Reduced-complexity Convolutional Neural Network in the compressed domain

Hamdan Abdellatef, Lina J. Karam

Summary: This paper proposes performing the learning and inference processes in the compressed domain to reduce computational complexity and improve speed of neural networks. Experimental results show that modified ResNet-50 in the compressed domain is 70% faster than traditional spatial-based ResNet-50 while maintaining similar accuracy. Additionally, a preprocessing step with partial encoding is suggested to improve resilience to distortions caused by low-quality encoded images. Training a network with highly compressed data can achieve good classification accuracy with significantly reduced storage requirements.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks

Victor R. Barradas, Yasuharu Koike, Nicolas Schweighofer

Summary: Inverse models are essential for human motor learning as they map desired actions to motor commands. The shape of the error surface and the distribution of targets in a task play a crucial role in determining the speed of learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning a robust foundation model against clean-label data poisoning attacks at downstream tasks

Ting Zhou, Hanshu Yan, Jingfeng Zhang, Lei Liu, Bo Han

Summary: We propose a defense strategy that reduces the success rate of data poisoning attacks in downstream tasks by pre-training a robust foundation model.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

AdaSAM: Boosting sharpness-aware minimization with adaptive learning rate and momentum for neural networks

Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao

Summary: In this paper, the convergence rate of AdaSAM in the stochastic non-convex setting is analyzed. Theoretical proof shows that AdaSAM has a linear speedup property and decouples the stochastic gradient steps with the adaptive learning rate and perturbed gradient. Experimental results demonstrate that AdaSAM outperforms other optimizers in terms of performance.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Grasping detection of dual manipulators based on Markov decision process with neural network

Juntong Yun, Du Jiang, Li Huang, Bo Tao, Shangchun Liao, Ying Liu, Xin Liu, Gongfa Li, Disi Chen, Baojia Chen

Summary: In this study, a dual manipulator grasping detection model based on the Markov decision process is proposed. By parameterizing the grasping detection model of dual manipulators using a cross entropy convolutional neural network and a full convolutional neural network, stable grasping of complex multiple objects is achieved. Robot grasping experiments were conducted to verify the feasibility and superiority of this method.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Asymmetric double networks mutual teaching for unsupervised person Re-identification

Miaohui Zhang, Kaifang Li, Jianxin Ma, Xile Wang

Summary: This paper proposes an unsupervised person re-identification (Re-ID) method that uses two asymmetric networks to generate pseudo-labels for each other by clustering and updates and optimizes the pseudo-labels through alternate training. It also designs similarity compensation and similarity suppression based on the camera ID of pedestrian images to optimize the similarity measure. Extensive experiments show that the proposed method achieves superior performance compared to state-of-the-art unsupervised person re-identification methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Low-variance Forward Gradients using Direct Feedback Alignment and momentum

Florian Bacho, Dominique Chu

Summary: This paper proposes a new approach called the Forward Direct Feedback Alignment algorithm for supervised learning in deep neural networks. By combining activity-perturbed forward gradients, direct feedback alignment, and momentum, this method achieves better performance and convergence speed compared to other local alternatives to backpropagation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Maximum margin and global criterion based-recursive feature selection

Xiaojian Ding, Yi Li, Shilin Chen

Summary: This research paper addresses the limitations of recursive feature elimination (RFE) and its variants in high-dimensional feature selection tasks. The proposed algorithms, which introduce a novel feature ranking criterion and an optimal feature subset evaluation algorithm, outperform current state-of-the-art methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation

Naoko Koide-Majima, Shinji Nishimoto, Kei Majima

Summary: Visual images observed by humans can be reconstructed from brain activity, and the visualization of arbitrary natural images from mental imagery has been achieved through an improved method. This study provides a unique tool for directly investigating the subjective contents of the brain.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Hierarchical attention network with progressive feature fusion for facial expression recognition

Huanjie Tao, Qianyue Duan

Summary: In this paper, a hierarchical attention network with progressive feature fusion is proposed for facial expression recognition (FER), addressing the challenges posed by pose variation, occlusions, and illumination variation. The model achieves enhanced performance by aggregating diverse features and progressively enhancing discriminative features.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

SLAPP: Subgraph-level attention-based performance prediction for deep learning models

Zhenyi Wang, Pengfei Yang, Linwei Hu, Bowen Zhang, Chengmin Lin, Wenkai Lv, Quan Wang

Summary: In the face of the complex landscape of deep learning, we propose a novel subgraph-level performance prediction method called SLAPP, which combines graph and operator features through an innovative graph neural network called EAGAT, providing accurate performance predictions. In addition, we introduce a mixed loss design with dynamic weight adjustment to improve predictive accuracy.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

LDCNet: Lightweight dynamic convolution network for laparoscopic procedures image segmentation

Yiyang Yin, Shuangling Luo, Jun Zhou, Liang Kang, Calvin Yu-Chian Chen

Summary: Medical image segmentation is crucial for modern healthcare systems, especially in reducing surgical risks and planning treatments. Transanal total mesorectal excision (TaTME) has become an important method for treating colon and rectum cancers. Real-time instance segmentation during TaTME surgeries can assist surgeons in minimizing risks. However, the dynamic variations in TaTME images pose challenges for accurate instance segmentation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Teng Cheng, Lei Sun, Junning Zhang, Jinling Wang, Zhanyang Wei

Summary: This study proposes a scheme that combines the start-stop point signal features for wideband multi-signal detection, called Fast Spectrum-Size Self-Training network (FSSNet). By utilizing start-stop points to build the signal model, this method successfully solves the difficulty of existing deep learning methods in detecting discontinuous signals and achieves satisfactory detection speed.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning deep representation and discriminative features for clustering of multi-layer networks

Wenming Wu, Xiaoke Ma, Quan Wang, Maoguo Gong, Quanxue Gao

Summary: The layer-specific modules in multi-layer networks are critical for understanding the structure and function of the system. However, existing methods fail to accurately characterize and balance the connectivity and specificity of these modules. To address this issue, a joint learning graph clustering algorithm (DRDF) is proposed, which learns the deep representation and discriminative features of the multi-layer network, and balances the connectivity and specificity of the layer-specific modules through joint learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Boundary uncertainty aware network for automated polyp segmentation

Guanghui Yue, Guibin Zhuo, Weiqing Yan, Tianwei Zhou, Chang Tang, Peng Yang, Tianfu Wang

Summary: This paper proposes a novel boundary uncertainty aware network (BUNet) for precise and robust colorectal polyp segmentation. BUNet utilizes a pyramid vision transformer encoder to learn multi-scale features and incorporates a boundary exploration module (BEM) and a boundary uncertainty aware module (BUM) to handle boundary areas. Experimental results demonstrate that BUNet outperforms other methods in terms of performance and generalization ability.

NEURAL NETWORKS (2024)