4.7 Article

Fusion of Multiple Edge-Preserving Operations for Hyperspectral Image Classification

Journal

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Volume 57, Issue 12, Pages 10336-10349

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2019.2933588

Keywords

Image edge detection; Smoothing methods; Feature extraction; Support vector machines; Transforms; Hyperspectral imaging; Decision fusion; edge-preserving operation (EPO); feature extraction; hyperspectral image (HSI); image classification

Funding

  1. Major Program of the National Natural Science Foundation of China [61890962]
  2. National Natural Science Foundation of China [61601179, 6187119]
  3. National Natural Science Fund of China for International Cooperation and Exchanges [61520106001]
  4. Fund of the Key Laboratory of Visual Perception and Artificial Intelligence of Hunan Province [2018TP1013]
  5. Fund of Hunan Province for the Science and Technology Plan Project [2017RS3024]

Ask authors/readers for more resources

In this article, a novel hyperspectral image (HSI) classification method based on fusing multiple edge-preserving operations (EPOs) is proposed, which consists of the following steps. First, the edge-preserving features are obtained by performing different types of EPOs, i.e., local edge-preserving filtering and global edge-preserving smoothing on the dimension-reduced HSI. Then, with the assistance of a superpixel segmentation method, the edge-preserving features are further improved by considering the inter and intra spectral properties of superpixels. Finally, the spectral and edge-preserving features are fused to form one composite kernel, which is fed into the support vector machine (SVM) followed by a majority voting fusion scheme. Experimental results on three data sets demonstrate the superiority of the proposed method over several state-of-the-art classification approaches, especially when the training sample size is limited. Furthermore, 21 well-known methods, including mathematical morphology-based approaches, sparse representation models, and deep learning-based classifiers, are adopted to be compared with the proposed method on Houston data set with standard sets of training and test samples released during 2013 Data Fusion Contest, which also shows the effectiveness of the proposed method.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Information Systems

JDAN: Joint Detection and Association Network for Real-Time Online Multi-Object Tracking

Haidong Wang, Xuan He, Zhiyong Li, Jin Yuan, Shutao Li

Summary: This study proposes an end-to-end MOT network called joint detection and association network (JDAN) that can simultaneously perform object detection and data association, resulting in improved tracking performance by optimizing the overall task.

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

SGFusion: A saliency guided deep-learning framework for pixel-level image fusion

Jinyang Liu, Renwei Dian, Shutao Li, Haibo Liu

Summary: This study proposes a saliency guided deep-learning framework for pixel-level image fusion, which can simultaneously deal with different tasks and generate fusion images that are more in line with visual perception by extracting meaningful information through fusion weights.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

Intrinsic Graph Learning With Discrete Constrained Diffusion-Fusion

Xiaohui Wei, Ting Lu, Shutao Li

Summary: Graphs are crucial for improving graph-based machine learning methods, but existing approaches have limitations when dealing with multiple graphs. This article presents a novel method that can simultaneously capture global and local information, and achieves superior results in clustering tasks compared to previous state-of-the-art methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Geochemistry & Geophysics

Gabor-Modulated Grouped Separable Convolutional Network for Hyperspectral Image Classification

Zhuoyi Zhao, Xiang Xu, Jun Li, Shutao Li, Antonio Plaza

Summary: Nowadays, CNN-based DL models have gained popularity in HSIC and achieved high accuracy due to their hierarchical and nonlinear feature learning patterns. However, deeper network structures may demand more parameters and training samples. To overcome these problems, we propose a lightweight network model using the GSC module, which reduces parameters and is suitable for HSI data. Experimental results show that our model has low training cost and achieves competitive accuracy with fewer samples compared to existing models.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Toward Efficient Remote Sensing Image Change Detection via Cross-Temporal Context Learning

Ze Song, Xiaohui Wei, Xudong Kang, Shutao Li, Jinyang Liu

Summary: In this study, we propose a cross-temporal context learning network called CCLNet, which leverages intratemporal and intertemporal long-range dependencies to fully exploit cross-temporal context information. Our method achieves improved change detection performance, especially in complex and diverse changing scenes.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Computer Science, Artificial Intelligence

A Deep Framework for Hyperspectral Image Fusion Between Different Satellites

Anjing Guo, Renwei Dian, Shutao Li

Summary: In recent years, fusing a low-resolution hyperspectral image (LR-HSI) with a high-resolution multispectral image (HR-MSI) from different satellites has been proven to be an effective method for improving HSI resolution. However, the LR-HSI and HR-MSI obtained from different satellites may not satisfy existing observation models and it is difficult to register them. To address these issues, a deep-learning-based framework is proposed, which includes image registration, blur kernel learning, and image fusion. The proposed framework demonstrates superior performance in HSI registration and fusion accuracy through extensive experiments.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Iterative Training Sample Augmentation for Enhancing Land Cover Change Detection Performance With Deep Learning Neural Network

Zhiyong Lv, Haitao Huang, Weiwei Sun, Meng Jia, Jon Atli Benediktsson, Fengrui Chen

Summary: This article proposes an iterative training sample augmentation (ITSA) strategy to improve the performance of deep learning neural networks in land cover change detection (LCCD) tasks with remote sensing images. The strategy is verified with experiments on seven pairs of real remote sensing images, showing excellent visual performance and quantitative improvement in detection accuracies of LCCD. The results indicate that the deep learning network coupled with ITSA can effectively improve LCCD performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

LRAF-Net: Long-Range Attention Fusion Network for Visible-Infrared Object Detection

Haolong Fu, Shixun Wang, Puhong Duan, Changyan Xiao, Renwei Dian, Shutao Li, Zhiyong Li

Summary: Visible-infrared object detection aims to improve detector performance by fusing the complementarity of visible and infrared images. To overcome the limitation of existing methods that only utilize local intramodality information, we propose a feature-enhanced long-range attention fusion network (LRAF-Net) that leverages the long-range dependence between different modalities.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Geochemistry & Geophysics

Hyperspectral Remote Sensing Benchmark Database for Oil Spill Detection With an Isolation Forest-Guided Unsupervised Detector

Puhong Duan, Xudong Kang, Pedram Ghamisi, Shutao Li

Summary: Oil spill detection is a topic of increasing importance due to its negative impact on the environment and coastal communities. This study proposes an unsupervised method for oil spill detection using hyperspectral remote sensing images. The method utilizes isolation forest to estimate the probability of each pixel belonging to seawater or oil spills, and generates pseudolabeled training samples using clustering algorithms. The proposed method achieves superior detection performance compared to other state-of-the-art approaches.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Feature-Band-Based Unsupervised Hyperspectral Underwater Target Detection Near the Coastline

Shuo Zhang, Puhong Duan, Xudong Kang, Yan Mo, Shutao Li

Summary: In this article, a feature-band-based unsupervised underwater target detection method (FBUD) is proposed, which uses the normalized difference water index (NDWI) and unmixing technique to find the target and background pixels. The spectral difference between the target and background is used to determine the optimal feature bands. The probability map of the underwater target can be obtained through a simple math operation on the feature bands. Additionally, a new UAV-borne hyperspectral image dataset named HNU-UTD is built for real-world underwater target detection, and the experimental results confirm the accuracy and effectiveness of the proposed method, which outperforms supervised detection methods.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Computer Science, Artificial Intelligence

Pixel-Centric Context Perception Network for Camouflaged Object Detection

Ze Song, Xudong Kang, Xiaohui Wei, Shutao Li

Summary: Camouflaged object detection is always faced with the challenge of identifying object pixels embedded in the background. Existing deep learning methods lack the ability to effectively utilize the context information around different pixels. In this paper, a pixel-centric context perception network (PCPNet) is proposed to address this problem. PCPNet customizes personalized context for each pixel based on the automatic estimation of its surroundings. Experimental results demonstrate the superiority of PCPNet in camouflaged object detection compared to other state-of-the-art methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Geochemistry & Geophysics

Multispectral Image Pan-Sharpening Guided by Component Substitution Model

Huiling Gao, Shutao Li, Jun Li, Renwei Dian

Summary: This research proposes a dual-branch network with attention mechanisms for multispectral image pan-sharpening. By improving the linear transformation and decomposition methods, it enhances the performance of pan-sharpening and improves the physical interpretability.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Computer Science, Artificial Intelligence

Zero-Shot Hyperspectral Sharpening

Renwei Dian, Anjing Guo, Shutao Li

Summary: The paper introduces a zero-shot learning method for HSI sharpening, which estimates the spectral and spatial responses of imaging sensors and uses subsampled HSI and MSI for inference to improve sharpening performance. Additionally, dimension reduction is applied to the HSI to reduce the model size, and an imaging model-based loss function is designed to enhance fusion performance.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

SSTF-Unet: Spatial-Spectral Transformer-Based U-Net for High-Resolution Hyperspectral Image Acquisition

Haibo Liu, Chenguo Feng, Renwei Dian, Shutao Li

Summary: A spatial-spectral transformer-based U-net (SSTF-Unet) approach is proposed in this paper to achieve the fusion of high-resolution hyperspectral images and high-resolution multispectral images by capturing the association between distant features and exploring the intrinsic information of the images. The method utilizes spatial and spectral self-attention and incorporates multiple fusion blocks for multiscale feature fusion.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Multimodal Sparse Transformer Network for Audio-Visual Speech Recognition

Qiya Song, Bin Sun, Shutao Li

Summary: Automatic speech recognition (ASR) is a crucial interface in intelligent systems, but its performance is often affected by external noise. Audio-visual speech recognition (AVSR) utilizes visual information to enhance ASR in noisy conditions. This article proposes a multimodal sparse transformer network (MMST) that incorporates sparse self-attention mechanism and motion features to improve AVSR performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

No Data Available