4.7 Article

Oil Spill Segmentation via Adversarial f-Divergence Learning

Journal

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING
Volume 56, Issue 9, Pages 4973-4988

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TGRS.2018.2803038

Keywords

Adversarial learning; f-divergence minimization; oil spill segmentation; synthetic aperture radar (SAR) image processing

Funding

  1. National Natural Science Foundation of China [61671481]
  2. Qingdao Applied Fundamental Research [16-5-1-11-jch]
  3. Fundamental Research Funds for the Central Universities [18CX05014A]

Ask authors/readers for more resources

We develop an automatic oil spill segmentation method in terms of f-divergence minimization. We exploit f-divergence for measuring the disagreement between the distributions of ground-truth and generated oil spill segmentations. To render tractable optimization, we minimize the tight lower bound of the f-divergence by adversarial training a regressor and a generator, which are structured in different forms of deep neural networks separately. The generator aims at producing accurate oil spill segmentation, while the regressor characterizes discriminative distributions with respect to true and generated oil spill segmentations. It is the coplay between the generator net and the regressor net against each other that achieves a minimal of the maximum lower bound for the f-divergence. The adversarial strategy enhances the representational powers of both the generator and the regressor and avoids requesting large amounts of labeled data for training the deep network parameters. In addition, the trained generator net enables automatic oil spill detection that does not require manual initialization. Benefiting from the comprehensiveness of f-divergence for characterizing diversified distributions, our framework can accurately segment variously shaped oil spills in noisy synthetic aperture radar images. Experimental results validate the effectiveness of the proposed oil spill segmentation framework.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Geochemistry & Geophysics

Oceanic Internal Wave Signature Extraction in the Sulu Sea by a Pixel Attention U-Net: PAU-Net

Yuteng Ma, Junmin Meng, Lina Sun, Peng Ren

Summary: In this research, a two-stage oceanic internal wave (IW) signature segmentation algorithm for synthetic aperture radar (SAR) images is proposed. The algorithm consists of an IW images classification stage and a stripe segmentation stage. Experimental results demonstrate that the proposed algorithm can successfully extract the signature of oceanic IWs from SAR images.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2023)

Article Geochemistry & Geophysics

DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentation

Fang Chen, Heiko Balzter, Feixiang Zhou, Peng Ren, Huiyu Zhou

Summary: In this article, we propose an effective segmentation framework called DGNet for oil spill segmentation in SAR images. Our framework incorporates the intrinsic distribution of backscatter values in SAR images and utilizes two deep neural modules for inference and generation. Experimental evaluations show that DGNet achieves accurate oil spill segmentation.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geography, Physical

Meta underwater camera: A smart protocol for underwater image enhancement

Hao Wang, Shixin Sun, Peng Ren

Summary: Underwater camera images often suffer from visual degradation issues, and existing studies tend to address these issues separately, resulting in inconsistent improvements in underwater image visibility. To overcome this limitation, we propose a smart protocol for underwater image enhancement, which utilizes reinforcement learning to optimize the parameter values for a comprehensive cascade of seven enhancement techniques. Our methodology, referred to as meta underwater camera (MUC), outperforms state-of-the-art methods in improving underwater image visibility.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2023)

Article Environmental Sciences

Dictionary Learning for Few-Shot Remote Sensing Scene Classification

Yuteng Ma, Junmin Meng, Baodi Liu, Lina Sun, Hao Zhang, Peng Ren

Summary: In this paper, a novel dictionary learning algorithm is proposed for few-shot remote sensing scene classification. By using natural image datasets for pre-training, a feature extractor suitable for remote sensing data is obtained. A kernel space classifier is designed to map the features to a high-dimensional space and embed the label information into the dictionary learning process to improve feature discrimination for classification. Extensive experiments on four popular remote sensing scene classification datasets demonstrate the effectiveness of the proposed dictionary learning method.

REMOTE SENSING (2023)

Article Engineering, Civil

A Reinforcement Learning Paradigm of Configuring Visual Enhancement for Object Detection in Underwater Scenes

Hao Wang, Shixin Sun, Xiao Bai, Jian Wang, Peng Ren

Summary: This article investigates the problem of enhancing underwater visual observations for accurate underwater object detection. Existing algorithms tend to follow human vision preference and may not be effective for object detection. The study proposes a reinforcement learning paradigm to configure visual enhancement for object detection in underwater scenes. Experimental results validate the effectiveness of the proposed method in improving detection results.

IEEE JOURNAL OF OCEANIC ENGINEERING (2023)

Article Automation & Control Systems

Dual-model: Revised imaging network and visual perception correction for underwater image enhancement

Huajun Song, Laibin Chang, Hao Wang, Peng Ren

Summary: Considering the limitations of single physics-based or deep learning-based methods, this paper proposes an effective Dual-model methodology for underwater image enhancement. The Dual-model consists of a Revised Imaging Network-model (RIN-model) and a Visual Perception Correction-model (VPC-model). The RIN-model estimates ambient-light and direct-transmission parameters to reconstruct a preliminary enhanced image based on a revised underwater image formation model, and the VPC-model further enhances contrast and restores color to correct the visual perception of the image.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2023)

Review Remote Sensing

UAV Ad Hoc Network Routing Algorithms in Space-Air-Ground Integrated Networks: Challenges and Directions

Yuxi Lu, Wu Wen, Kostromitin Konstantin Igorevich, Peng Ren, Hongxia Zhang, Youxiang Duan, Hailong Zhu, Peiying Zhang

Summary: With the rapid development of 5G and 6G communications, there is increasing interest in space-air-ground integrated networks (SAGINs) to achieve seamless all-area, all-time coverage. Flying ad hoc networks (FANETs) play a key role in SAGINs, particularly in the agriculture and transportation sectors. This study analyzes the unique communication architecture of FANETs in SAGINs, presents existing routing protocols, reviews recent research advances in routing algorithms, and discusses future research trends for FANET routing algorithms in SAGINs.

DRONES (2023)

Article Geochemistry & Geophysics

Classification With Unbalanced Samples by Self-Sampling and Semicorrelated Co-Training-An Application to Algal Bloom Detection

Xinrong Lyu, Jun Zhou, Peng Ren, Alejandro C. Frery

Summary: This manuscript presents a model based on self-sampling and semicorrelated co-training to improve the detection accuracy of algal bloom. The self-sampling module enhances the efficiency of extracting useful information from training sets, while the semicorrelated co-training module addresses the issue of limited labeled samples. Experimental results show that the proposed model has contributed to the improvement of detection accuracy.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Sea Ice Classification Using Mutually Guided Contexts

Xiaoyu Sun, Xi Zhang, Weimin Huang, Zongjun Han, Xinrong Lyu, Peng Ren

Summary: This article investigates sea ice classification on a remote sensing image with just a small number of labeled pixels. An effective method is developed to extract context features from a classification map, and an iterative learning paradigm is established to guide the update of these features. The paradigm is referred to as mutually guided contexts, which comprehensively characterizes the sea ice image representation for training and classification even with limited training data.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

MSH-Net: Modality-Shared Hallucination With Joint Adaptation Distillation for Remote Sensing Image Classification Using Missing Modalities

Shicai Wei, Yang Luo, Xiaoguang Ma, Peng Ren, Chunbo Luo

Summary: Learning-based multimodal data is of increasing interest in remote sensing due to its strong performance. This work proposes a framework called modality-shared hallucination network (MSH-Net) that reconstructs complete modality-shared features from incomplete inference modalities to address the problem of missing modalities in multimodal remote sensing image processing. Additionally, a novel joint adaptation distillation (JAD) method is developed to guide the hallucination model in learning modality-shared knowledge from the multimodal model. Extensive experiments demonstrate that MSH-Net achieves state-of-the-art performance in addressing the problem of missing modalities. Code is available at: https://github.com/shicaiwei123/MSHNet

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Encrypting Hashing Against Localization

Jingpeng Han, Peng Li, Yimin Tao, Peng Ren

Summary: This article investigates encrypting remote sensing images to counter the Hashing for Localization task. Two cues are characterized for the task: visually similar encrypted patches and different hash codes. Based on an adversarial method, an encrypted patch generator is developed, leading to two encryption frameworks causing nonlocalization and mislocalization to the HfL task.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Engineering, Civil

Oil Spill Timely Backtracking Oriented by Wind Field Correction With Self-Attention Temporal Convolutional Networks

Yongqing Li, Xinrong Lyu, Peng Ren

Summary: We investigate the problem of oil spill timely backtracking and propose a self-attention temporal convolutional network (SaTCN) to obtain a timely and accurate estimate of historical wind fields for reliable oil spill backtracking. The SaTCN consists of a self-attention network and a temporal convolutional network, which capture spatial correlations and temporal characteristics from wind field sequences. Extensive experiments validate the effectiveness of the proposed method in addressing oil spill accidents.

IEEE JOURNAL OF OCEANIC ENGINEERING (2023)

Article Geochemistry & Geophysics

Hashing for Geo-Localization

Peng Ren, Yimin Tao, Jingpeng Han, Peng Li

Summary: In this article, a method of fast geolocation of query ground images using geo-tagged aerial images is proposed. By converting aerial images into ground-view aerial images with the same angle of view as the ground image, and generating hash codes for images using a feature extraction model and a hash encoder, the geographic location of the ground image is efficiently retrieved by searching for matched geo-tagged aerial images based on the hash codes.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Cohesion Intensive Hash Code Book Coconstruction for Efficiently Localizing Sketch Depicted Scenes

Yuxin Fang, Peng Li, Jie Zhang, Peng Ren

Summary: This study investigates the efficient localization of sketch depicted scenes in a remote sensing image dataset. Hashing techniques are explored to achieve efficient retrieval and linear mapping models are used to generate hash codes for sketches and remote sensing images separately. The proposed method enables efficient remote sensing image retrieval with sketch queries and has been validated to be effective and efficient.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Enhancement-Registration-Homogenization (ERH): A Comprehensive Underwater Visual Reconstruction Paradigm

Huajun Song, Laibin Chang, Ziwei Chen, Peng Ren

Summary: This paper presents a comprehensive underwater visual reconstruction paradigm that includes three procedures: the E-procedure, the R-procedure, and the H-procedure. By enhancing original images, registering multiple enhanced images, and homogenizing the registered images, the paradigm achieves restored colors, sharpened edges, and improved visibility in wide-field underwater images.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

No Data Available