4.7 Review

A comprehensive review on deep learning based remote sensing image super-resolution methods

Journal

EARTH-SCIENCE REVIEWS
Volume 232, Issue -, Pages -

Publisher

ELSEVIER
DOI: 10.1016/j.earscirev.2022.104110

Keywords

Deep learning; Remote sensing; Super-resolution

Ask authors/readers for more resources

This research aims to comprehensively evaluate DL-based SISR methods on optical remote sensing images. The study first introduces DL techniques used in SISR and then thoroughly summarizes RSISR algorithms, including DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. The research also provides a new multi-sensor dataset and evaluates the performance of state-of-the-art super-resolution methods on this dataset.
Satellite imageries are an important geoinformation source for different applications in the Earth Science field. However, due to the limitation of the optic and sensor technologies and the high cost to update the sensors and equipments, the spectral and spatial resolution of the Earth Observation satellites may not meet the desired requirements. Thus, Remote Sensing Image Super-resolution (RSISR) which aims at restoring the high-resolution (HR) remote sensing images from the given low-resolution (LR) images has drawn considerable attention and witnessed the rapid development of the deep learning (DL) algorithms. In this research, we aim to compre-hensively review the DL-based single image super-resolution (SISR) methods on optical remote sensing images. First, we introduce the DL techniques utilized in SISR. Second, we summarize the RSISR algorithms thoroughly, including the DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. Third, we present a new multi-sensor dataset that consists of Very High-Resolution satellite images from different satellites of various landscapes and evaluate the performance of some state-of-the-art super-resolution methods on this dataset. Finally, we envision the challenges and future research in the RSISR field.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Aerospace

Assessing the performance of machine learning algorithms for soil salinity mapping in Google Earth Engine platform using Sentinel-2A and Landsat-8 OLI data

Samet Aksoy, Aylin Yildirim, Taha Gorji, Nikou Hamzehpour, Aysegul Tanik, Elif Sertel

Summary: The study focuses on the importance of soil salinization detection using remote sensing techniques and machine-learning algorithms in arid and semi-arid regions. Among the three machine-learning algorithms analyzed, random forest algorithm demonstrated the most reliable spatial distribution of soil salinity classes in the selected study area, despite slightly better prediction results from classification and regression trees (CART) in some aspects.

ADVANCES IN SPACE RESEARCH (2022)

Article Environmental Sciences

Evaluation and comparison of MODIS and VIIRS aerosol optical depth (AOD) products over regions in the Eastern Mediterranean and the Black Sea

Paria Ettehadi Osgouei, Gareth Roberts, Sinasi Kaya, Muhammad Bilal, Jadunandan Dash, Elif Sertel

Summary: Aerosol loading has significant impacts on radiative forcing, climate, and human health. This study evaluated and compared multiple satellite aerosol products in the Eastern Mediterranean and the Black Sea region, with VIIRS aerosol product showing the best performance over coastal areas.

ATMOSPHERIC ENVIRONMENT (2022)

Article Environmental Sciences

High-resolution land use and land cover change analysis using GEOBIA and landscape metrics: A case of Istanbul, Turkey

Raziye Hale Topaloglu, Gul Asli Aksu, Yusuf Alizade Govarchin Ghale, Elif Sertel

Summary: This study used GEOBIA and Landscape Metrics to create multi-temporal high-resolution LU/LC maps in a selected study region in the Istanbul metropolitan city of Turkey. The integration of open-source geospatial data improved the overall classification accuracy, and PCA was used to select landscape metrics and evaluate the results.

GEOCARTO INTERNATIONAL (2022)

Article Multidisciplinary Sciences

Integrated usage of historical geospatial data and modern satellite images reveal long-term land use/cover changes in Bursa/Turkey, 1858-2020

Paria Ettehadi Osgouei, Elif Sertel, M. Erdem Kabadayi

Summary: This study aims to determine the historical land use and land cover changes using different geospatial datasets from different time periods. The research proposes a method to prepare historical datasets and utilizes an object-oriented joint classification scheme to accurately map the spatio-temporal changes. The analysis shows diverging developments in the selected locations over a period of 162 years.

SCIENTIFIC REPORTS (2022)

Article Computer Science, Interdisciplinary Applications

Performance evaluation of shallow and deep CNN architectures on building segmentation from high-resolution images

Batuhan Sariturk, Dursun Zafer Seker, Ozan Ozturk, Bulent Bayram

Summary: This study investigates the performance evaluation of convolutional neural network architectures in building segmentation from high-resolution images. The results show that deeper architectures can provide better results even with limited data, and shallower architectures perform well with lower computational cost, making them useful for geographic applications.

EARTH SCIENCE INFORMATICS (2022)

Article Computer Science, Information Systems

VHRShips: An Extensive Benchmark Dataset for Scalable Deep Learning-Based Ship Detection Applications

Serdar Kizilkaya, Ugur Alganci, Elif Sertel

Summary: This study introduces the VHRShips dataset, which is a unique and rich ship dataset that can improve the scalability of ship detection and mapping applications. A deep learning-based multi-stage approach called HieD is proposed for ship type classification. The results show that HieD outperforms other methods in localization, recognition, and identification stages.

ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION (2022)

Article Computer Science, Information Systems

A dense residual U-net for multiple sclerosis lesions segmentation from multi-sequence 3D MR images

Beytullah Sarica, Dursun Zafer Seker, Bulent Bayram

Summary: This study proposes a novel dense residual U-Net model that enhances automatic MS lesion segmentation using 3D MRI sequences. The model combines attention gate (AG), efficient channel attention (ECA), and Atrous Spatial Pyramid Pooling (ASPP) to achieve better results than other state-of-the-art methods. Validation on ISBI2015 and MSSEG2016 challenge datasets shows superior performance.

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS (2023)

Article Environmental Sciences

Estimation of emissions from crop residue burning in Turkiye using remotely sensed data and the Google Earth Engine platform

Kubra Bahsi, Beyza Ustaoglu, Samet Aksoy, Elif Sertel

Summary: This research aims to determine the amount of crop-based residue burning (CRB) in the Southeastern Anatolia Region of Turkiye, using Sentinel-2 images and Intergovernmental Panel on Climate Change standards. The analysis showed that CRB practices in 2019 released 14,444.307 Gg of Greenhouse Gases and 117.809 Gg of Particulate Matters. The results can improve national statistics and support agricultural decision-making processes.

GEOCARTO INTERNATIONAL (2023)

Article Computer Science, Artificial Intelligence

Multi-frame super-resolution of remote sensing images using attention-based GAN models

Peijuan Wang, Elif Sertel

Summary: With the advancement of artificial intelligence techniques and the launch of new satellites with video capturing capability, multi-frame super-resolution of remote sensing images has become a critical research topic. In this study, an attention-based Generative Adversarial Network (GAN) algorithm is proposed for multi-frame remote sensing image super-resolution. Several experiments were conducted, comparing the results of different models and the proposed approach using SpaceNet7 and Jilin-1 datasets.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Geography, Physical

Use of Artificial Intelligence Toward Climate-Neutral Cultural Heritage

Tolga Bakirman, Bahadir Kulavuz, Bulent Bayram

Summary: This study aims to provide a holistic solution to monitor and protect cultural heritage from climate change, natural hazards, and anthropogenic effects. The efficiency of deep learning using low-cost unmanned aerial vehicles and camera images for the documentation and monitoring of cultural heritage is investigated. The proposed solution can aid in monitoring the protection of cultural heritage from climate change, natural disasters, and anthropogenic effects.

PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING (2023)

Article Engineering, Geological

A comprehensive analysis of different geometric correction methods for the Pleiades-1A and Spot-6 satellite images

Bugrahan oezcihan, Levent Dogukan oezlue, Muemin Ilker Karakap, Halime Suermeli, Ugur Alganci, Elif Sertel

Summary: Satellite images are widely used in the production of geospatial information. Geometric correction is essential for image pre-processing to extract accurate locational information. This study performed geometric correction on satellite images obtained from Pleiades 1A (PHR) and SPOT-6 using empirical and physical models. Several experiments were conducted to investigate the effects of various parameters on the performance of the geometric correction procedure. The results showed that the model using RPC from data providers achieved lower RMSE values, providing better locational accuracy.

INTERNATIONAL JOURNAL OF ENGINEERING AND GEOSCIENCES (2023)

Article Remote Sensing

Evaluating the potential of multi-temporal Sentinel-1 and Sentinel-2 data for regional mapping of olive trees

Haydar Akcay, Samet Aksoy, Sinasi Kaya, Elif Sertel, Jadu Dash

Summary: This study evaluated the performance of Sentinel-1 and Sentinel-2 data fusion for regional mapping of olive trees. Using the Izmir Province in Turkiye as a case study, the researchers successfully produced a regional-scale olive distribution map. The results showed that this method can be scaled up to the entire country and replicated elsewhere, providing a foundation for other scientific studies and effective management practices.

INTERNATIONAL JOURNAL OF REMOTE SENSING (2023)

Proceedings Paper Engineering, Aerospace

Determination of Caspian Sea Coastal Changes Using Remote Sensing and Geographic Information Systems

Ramil Safarov, Elif Sertel

Summary: This study used Remote Sensing and Geographic Information Systems to analyze the coastal changes around the Baku International Sea Trade Port over the past thirty years. The results showed that the most significant shoreline change occurred on the east side of the port, while the smallest change was observed 11.5 kilometers south of the port. Additionally, the study found that the land area had increased by 633 hectares due to coastline filling.

2023 10TH INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN AIR AND SPACE TECHNOLOGIES, RAST (2023)

Article Computer Science, Software Engineering

Classification of Skin Lesion Images with Deep Learning Approaches

Buket Bayram, Bahadir Kulavuz, Berkay Ertugrul, Bulent Bayram, Tolga Bakirman, Tuna Cakar, Metehan Dogan

Summary: Skin cancer, one of the most dangerous cancer types, requires early detection for successful recovery. This study demonstrates that deep learning-based image classification can aid doctors in accurately diagnosing skin lesions, achieving high accuracy rates.

BALTIC JOURNAL OF MODERN COMPUTING (2022)

Article Geochemistry & Geophysics

Deep Learning-Based Road Extraction From Historical Maps

Cengiz Avci, Elif Sertel, Mustafa Erdem Kabadayi

Summary: The research aimed to propose an ideal architecture, encoder, and hyperparameter settings for historical road extraction, achieving the best results with the combination of Unet++ architecture and split-attention network (Timm-resnest200e) encoder, which can directly be used for inference of other historical maps and transfer learning.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

No Data Available