4.7 Article

Spectral constraint adversarial autoencoders approach to feature representation in hyperspectral anomaly detection

期刊

NEURAL NETWORKS
卷 119, 期 -, 页码 222-234

出版社

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2019.08.012

关键词

Adversarial autoencoders (AAE); Hyperspectral anomaly detection; Unsupervised feature learning; Spectral constraint; Background suppression

资金

  1. National Natural Science Foundation of China [61801359, 61571345, 91538101, 61501346, 61502367, 61701360]
  2. Young Talent fund of University Association for Science and Technology in Shaanxi of China [20190103]
  3. China Postdoctoral Science Foundation [2017M620440, 2019T120878]
  4. 111 project [B08038]
  5. Fundamental Research Funds for the Central Universities [JB180104]
  6. Natural Science Basic Research Plan in Shaanxi Province of China [2019JQ153, 2016JQ6023, 2016JQ6018]
  7. Yangtse Rive Scholar Bonus Schemes [CJT160102]
  8. Ten Thousand Talent Program

向作者/读者索取更多资源

Anomaly detection in hyperspectral images (HSIs) faces various levels of difficulty due to the high dimensionality, redundant information and deteriorated bands. To address these problems, we propose a novel unsupervised feature representation approach by incorporating a spectral constraint strategy into adversarial autoencoders (AAE) without any prior knowledge in this paper. Our approach, called SC_AAE (spectral constraint AAE), is based on the characteristics of HSIs to obtain better discrimination represented by hidden nodes. To be specific, we adopt a spectral angle distance into the loss function of AAE to enforce spectral consistency. Considering the different contribution rates of each hidden node to anomaly detection, we individually fuse the hidden nodes by an adaptive weighting method. A bi-layer architecture is then designed to suppress the variational background (BKG) while preserving features of anomalies. The experimental results demonstrate that our proposed method outperforms the state-of-the-art methods. (C) 2019 Elsevier Ltd. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Geochemistry & Geophysics

Rank-Aware Generative Adversarial Network for Hyperspectral Band Selection

Xin Zhang, Weiying Xie, Yunsong Li, Jie Lei, Qian Du, Geng Yang

Summary: This article proposes a band selection method called rank-aware generative adversarial network (R-GAN) to address the issues of band interaction and information saliency evaluation in traditional clustering-based methods. The proposed R-GAN combines interpretability and interband relevance through centralized reference feature extraction with GAN, and refines the reference feature with a saliency estimation strategy. Experimental results demonstrate that R-GAN can effectively address spectral saliency and select more informative band subsets, outperforming other competitors in detection and classification tasks.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Sparse Coding-Inspired GAN for Hyperspectral Anomaly Detection in Weakly Supervised Learning

Yunsong Li, Tao Jiang, Weiying Xie, Jie Lei, Qian Du

Summary: This study introduces a sparse coding-inspired generative adversarial network for weakly supervised anomaly detection from hyperspectral images. By integrating a background-category searching step and an SC-inspired regularized network, a robust and interpretable model is developed, which detects anomalies in a latent space.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Engineering, Electrical & Electronic

Interlayer Restoration Deep Neural Network for Scalable High Efficiency Video Coding

Gang He, Li Xu, Jie Lei, Weiying Xie, Yunsong Li, Yibo Fan, Jinjia Zhou

Summary: This paper introduces a deep neural network for scalable high efficiency video coding, which improves visual quality and coding efficiency through interlayer restoration. By utilizing reconstructed frames from different layers, the network generates interlayers with higher quality, enhancing the coding efficiency.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2022)

Article Environmental Sciences

Multi-Prior Twin Least-Square Network for Anomaly Detection of Hyperspectral Imagery

Jiaping Zhong, Yunsong Li, Weiying Xie, Jie Lei, Xiuping Jia

Summary: In this work, a multi-prior-based network (MPN) is proposed to incorporate well-trained generative adversarial networks (GANs) as effective priors for hyperspectral anomaly detection. By introducing multi-scale covariance maps (MCMs) of precise second-order statistics, multi-scale priors are constructed to reliably and adaptively estimate the HSI label. The network is enhanced with twin least-square loss and a new anomaly rejection loss to improve generative ability and training stability, while establishing a pure and discriminative background estimation.

REMOTE SENSING (2022)

Article Environmental Sciences

Spatial-Spectral Cross-Correlation Embedded Dual-Transfer Network for Object Tracking Using Hyperspectral Videos

Jie Lei, Pan Liu, Weiying Xie, Long Gao, Yunsong Li, Qian Du

Summary: This paper proposes a spatial-spectral cross-correlation embedded dual-transfer network (SSDT-Net) for hyperspectral video object tracking, addressing the challenges of limited annotation data and high-dimensional characteristics. Experimental results show that the SSDT-Net offers satisfactory performance with a similar speed to traditional color trackers.

REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Weakly Supervised Discriminative Learning With Spectral Constrained Generative Adversarial Network for Hyperspectral Anomaly Detection

Tao Jiang, Weiying Xie, Yunsong Li, Jie Lei, Qian Du

Summary: This article proposes a weakly supervised discriminative learning approach using spectral constrained generative adversarial networks for hyperspectral anomaly detection. The network enhances discrimination between anomaly and background, and includes an end-to-end architecture with a novel spectral constraint. Experimental results demonstrate the unique promise of this approach.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Automation & Control Systems

E2E-LIADE: End-to-End Local Invariant Autoencoding Density Estimation Model for Anomaly Target Detection in Hyperspectral Image

Kai Jiang, Weiying Xie, Jie Lei, Zan Li, Yunsong Li, Tao Jiang, Qian Du

Summary: The study proposes a novel end-to-end local invariant autoencoding density estimation model to address two issues in hyperspectral anomaly target detection: failure to dig out customized features and incapability of preserving inherent information in low-dimensional representation. By introducing a local invariant autoencoder and multidistance measure, more effective anomaly target detection is achieved.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Automation & Control Systems

Filter Pruning via Learned Representation Median in the Frequency Domain

Xin Zhang, Weiying Xie, Yunsong Li, Jie Lei, Qian Du

Summary: This article proposes a novel filter pruning method for deep learning networks by calculating the learned representation median in the frequency domain. The method emphasizes the removal of absolutely unimportant filters and has been shown to outperform existing pruning methods in terms of accuracy and FLOPs reduction.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Geochemistry & Geophysics

Guided Hybrid Quantization for Object Detection in Remote Sensing Imagery via One-to-One Self-Teaching

Jiaqing Zhang, Jie Lei, Weiying Xie, Yunsong Li, Geng Yang, Xiuping Jia

Summary: This paper proposes a guided hybrid quantization with one-to-one self-teaching (GHOST) framework, which combines the synergy of quantization and distillation to achieve a lightweight model. The framework introduces a guided quantization self-distillation (GQSD) structure, a hybrid quantization (HQ) module, and a one-to-one self-teaching (OST) module. Experimental results demonstrate the superiority of the GHOST framework in terms of object detection and lightweight design.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagery

Jiaqing Zhang, Jie Lei, Weiying Xie, Zhenman Fang, Yunsong Li, Qian Du

Summary: In this article, the authors propose SuperYOLO, an accurate and fast object detection method for remote sensing images. By fusing multimodal data and utilizing assisted super resolution learning, SuperYOLO achieves high-resolution object detection on multiscale objects while considering the computation cost. Experimental results show that SuperYOLO outperforms state-of-the-art models in terms of accuracy and computational efficiency.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

A Semantic Transferred Priori for Hyperspectral Target Detection With SpatialSpectral Association

Jie Lei, Simin Xu, Weiying Xie, Jiaqing Zhang, Yunsong Li, Qian Du

Summary: This article introduces a novel method for detecting hyperspectral image (HSI) targets with certain spatial information, referred to as the semantic transferred priori for hyperspectral target detection with spatial-spectral association (SSAD). By using transfer learning, a semantic segmentation network adapted for HSIs is designed to discriminate the spatial areas of targets, and a customized target spectrum is aggregated with those spectral pixels localized. Experiments demonstrate that our proposed method achieves higher detection accuracy and superior visual performance compared to the other benchmark methods.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

CBFF-Net: A New Framework for Efficient and Accurate Hyperspectral Object Tracking

Long Gao, Pan Liu, Yan Jiang, Weiying Xie, Jie Lei, Yunsong Li, Qian Du

Summary: In this article, a novel algorithm (CBFF-Net) is proposed for hyperspectral object tracking, aiming to improve discrimination ability and reduce computational complexity. By extracting features from different bands of hyperspectral images and learning inter-band interaction information, the algorithm demonstrates superior performance and runs at a speed of 24 FPS.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Computer Science, Artificial Intelligence

Block-Wise Partner Learning for Model Compression

Xin Zhang, Weiying Xie, Yunsong Li, Jie Lei, Kai Jiang, Leyuan Fang, Qian Du

Summary: In this study, a novel model compression method called block-wise partner learning (BPL) is proposed to address the resource limitations faced by convolutional neural networks (CNNs). BPL creates partners for each block during training, evaluates differences using a diversity loss, and fuses the partners equivalently. Experimental results show that BPL outperforms other methods in terms of performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Geochemistry & Geophysics

Boundary Extraction Constrained Siamese Network for Remote Sensing Image Change Detection

Jie Lei, Yijie Gu, Weiying Xie, Yunsong Li, Qian Du

Summary: This article proposes a boundary extraction constrained Siamese network (BESNet) to improve change detection performance by utilizing boundary information. The BESNet combines traditional and deep learning techniques to maximize their strengths through cooperation. A new boundary extraction constrained loss function and a contractive loss function are used to optimize the network. Experimental results demonstrate that the proposed BESNet significantly improves change detection performance and generates more complete and clearer object boundaries.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Algorithm/Hardware Codesign for Real-Time On-Satellite CNN-Based Ship Detection in SAR Imagery

Geng Yang, Jie Lei, Weiying Xie, Zhenman Fang, Yunsong Li, Jiaxuan Wang, Xin Zhang

Summary: In this article, the authors propose OSCAR-RT, an algorithm/hardware codesign framework for real-time on-satellite CNN-based SAR ship detection. OSCAR-RT simultaneously produces an accurate and hardware-friendly CNN model and an ultra-efficient FPGA-based hardware accelerator. Experimental results demonstrate the effectiveness of OSCAR-RT in achieving high detection accuracy and speed for on-satellite ship detection.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Reduced-complexity Convolutional Neural Network in the compressed domain

Hamdan Abdellatef, Lina J. Karam

Summary: This paper proposes performing the learning and inference processes in the compressed domain to reduce computational complexity and improve speed of neural networks. Experimental results show that modified ResNet-50 in the compressed domain is 70% faster than traditional spatial-based ResNet-50 while maintaining similar accuracy. Additionally, a preprocessing step with partial encoding is suggested to improve resilience to distortions caused by low-quality encoded images. Training a network with highly compressed data can achieve good classification accuracy with significantly reduced storage requirements.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks

Victor R. Barradas, Yasuharu Koike, Nicolas Schweighofer

Summary: Inverse models are essential for human motor learning as they map desired actions to motor commands. The shape of the error surface and the distribution of targets in a task play a crucial role in determining the speed of learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning a robust foundation model against clean-label data poisoning attacks at downstream tasks

Ting Zhou, Hanshu Yan, Jingfeng Zhang, Lei Liu, Bo Han

Summary: We propose a defense strategy that reduces the success rate of data poisoning attacks in downstream tasks by pre-training a robust foundation model.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

AdaSAM: Boosting sharpness-aware minimization with adaptive learning rate and momentum for neural networks

Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao

Summary: In this paper, the convergence rate of AdaSAM in the stochastic non-convex setting is analyzed. Theoretical proof shows that AdaSAM has a linear speedup property and decouples the stochastic gradient steps with the adaptive learning rate and perturbed gradient. Experimental results demonstrate that AdaSAM outperforms other optimizers in terms of performance.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Grasping detection of dual manipulators based on Markov decision process with neural network

Juntong Yun, Du Jiang, Li Huang, Bo Tao, Shangchun Liao, Ying Liu, Xin Liu, Gongfa Li, Disi Chen, Baojia Chen

Summary: In this study, a dual manipulator grasping detection model based on the Markov decision process is proposed. By parameterizing the grasping detection model of dual manipulators using a cross entropy convolutional neural network and a full convolutional neural network, stable grasping of complex multiple objects is achieved. Robot grasping experiments were conducted to verify the feasibility and superiority of this method.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Asymmetric double networks mutual teaching for unsupervised person Re-identification

Miaohui Zhang, Kaifang Li, Jianxin Ma, Xile Wang

Summary: This paper proposes an unsupervised person re-identification (Re-ID) method that uses two asymmetric networks to generate pseudo-labels for each other by clustering and updates and optimizes the pseudo-labels through alternate training. It also designs similarity compensation and similarity suppression based on the camera ID of pedestrian images to optimize the similarity measure. Extensive experiments show that the proposed method achieves superior performance compared to state-of-the-art unsupervised person re-identification methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Low-variance Forward Gradients using Direct Feedback Alignment and momentum

Florian Bacho, Dominique Chu

Summary: This paper proposes a new approach called the Forward Direct Feedback Alignment algorithm for supervised learning in deep neural networks. By combining activity-perturbed forward gradients, direct feedback alignment, and momentum, this method achieves better performance and convergence speed compared to other local alternatives to backpropagation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Maximum margin and global criterion based-recursive feature selection

Xiaojian Ding, Yi Li, Shilin Chen

Summary: This research paper addresses the limitations of recursive feature elimination (RFE) and its variants in high-dimensional feature selection tasks. The proposed algorithms, which introduce a novel feature ranking criterion and an optimal feature subset evaluation algorithm, outperform current state-of-the-art methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation

Naoko Koide-Majima, Shinji Nishimoto, Kei Majima

Summary: Visual images observed by humans can be reconstructed from brain activity, and the visualization of arbitrary natural images from mental imagery has been achieved through an improved method. This study provides a unique tool for directly investigating the subjective contents of the brain.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Hierarchical attention network with progressive feature fusion for facial expression recognition

Huanjie Tao, Qianyue Duan

Summary: In this paper, a hierarchical attention network with progressive feature fusion is proposed for facial expression recognition (FER), addressing the challenges posed by pose variation, occlusions, and illumination variation. The model achieves enhanced performance by aggregating diverse features and progressively enhancing discriminative features.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

SLAPP: Subgraph-level attention-based performance prediction for deep learning models

Zhenyi Wang, Pengfei Yang, Linwei Hu, Bowen Zhang, Chengmin Lin, Wenkai Lv, Quan Wang

Summary: In the face of the complex landscape of deep learning, we propose a novel subgraph-level performance prediction method called SLAPP, which combines graph and operator features through an innovative graph neural network called EAGAT, providing accurate performance predictions. In addition, we introduce a mixed loss design with dynamic weight adjustment to improve predictive accuracy.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

LDCNet: Lightweight dynamic convolution network for laparoscopic procedures image segmentation

Yiyang Yin, Shuangling Luo, Jun Zhou, Liang Kang, Calvin Yu-Chian Chen

Summary: Medical image segmentation is crucial for modern healthcare systems, especially in reducing surgical risks and planning treatments. Transanal total mesorectal excision (TaTME) has become an important method for treating colon and rectum cancers. Real-time instance segmentation during TaTME surgeries can assist surgeons in minimizing risks. However, the dynamic variations in TaTME images pose challenges for accurate instance segmentation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Teng Cheng, Lei Sun, Junning Zhang, Jinling Wang, Zhanyang Wei

Summary: This study proposes a scheme that combines the start-stop point signal features for wideband multi-signal detection, called Fast Spectrum-Size Self-Training network (FSSNet). By utilizing start-stop points to build the signal model, this method successfully solves the difficulty of existing deep learning methods in detecting discontinuous signals and achieves satisfactory detection speed.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning deep representation and discriminative features for clustering of multi-layer networks

Wenming Wu, Xiaoke Ma, Quan Wang, Maoguo Gong, Quanxue Gao

Summary: The layer-specific modules in multi-layer networks are critical for understanding the structure and function of the system. However, existing methods fail to accurately characterize and balance the connectivity and specificity of these modules. To address this issue, a joint learning graph clustering algorithm (DRDF) is proposed, which learns the deep representation and discriminative features of the multi-layer network, and balances the connectivity and specificity of the layer-specific modules through joint learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Boundary uncertainty aware network for automated polyp segmentation

Guanghui Yue, Guibin Zhuo, Weiqing Yan, Tianwei Zhou, Chang Tang, Peng Yang, Tianfu Wang

Summary: This paper proposes a novel boundary uncertainty aware network (BUNet) for precise and robust colorectal polyp segmentation. BUNet utilizes a pyramid vision transformer encoder to learn multi-scale features and incorporates a boundary exploration module (BEM) and a boundary uncertainty aware module (BUM) to handle boundary areas. Experimental results demonstrate that BUNet outperforms other methods in terms of performance and generalization ability.

NEURAL NETWORKS (2024)