4.7 Article

Efficient SfM for Oblique UAV Images: From Match Pair Selection to Geometrical Verification

Journal

REMOTE SENSING
Volume 10, Issue 8, Pages -

Publisher

MDPI
DOI: 10.3390/rs10081246

Keywords

unmanned aerial vehicle; oblique photogrammetry; structure-from-motion; maximal spanning tree; tiling strategy; hierarchical motion consistency constraint

Ask authors/readers for more resources

Accurate orientation is required for the applications of UAV (Unmanned Aerial Vehicle) images. In this study, an integrated Structure from Motion (SfM) solution is proposed, which aims to address three issues to ensure the efficient and reliable orientation of oblique UAV images, including match pair selection for large-volume images with large overlap degree, reliable feature matching of images captured from varying directions, and efficient geometrical verification of initial matches. By using four datasets captured with different oblique imaging systems, the proposed SfM solution is comprehensively compared and analyzed. The results demonstrate that linear computational costs can be achieved in feature extraction and matching; although high decrease ratios occur in image pairs, reliable orientation results are still obtained from both the relative and absolute bundle adjustment (BA) tests when compared with other software packages. For the orientation of oblique UAV images, the proposed method can be an efficient and reliable solution.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Geography, Physical

HMSM-Net: Hierarchical multi-scale matching network for disparity estimation of high-resolution satellite stereo images

Sheng He, Shenhong Li, San Jiang, Wanshou Jiang

Summary: This paper proposes a hierarchical multi-scale matching network (HMSM-Net) for the disparity estimation of high-resolution satellite stereo images. The network leverages multi-scale features and a hierarchical coarse-to-fine matching strategy to handle challenging regions and achieves superior accuracy compared to state-of-the-art methods. The authors also create a dense stereo matching dataset and provide the source codes and evaluation dataset for further research.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2022)

Article Geography, Physical

Leveraging vocabulary tree for simultaneous match pair selection and guided feature matching of UAV images

San Jiang, Wanshou Jiang, Bingxuan Guo

Summary: This paper presents an integrated workflow for match pair selection and guided feature matching for image orientation. The proposed algorithm explores the index structure of both inverted and direct indexes in the context of vocabulary tree-based image retrieval. The experimental results demonstrate that the proposed method achieves match pair selection with linear time complexity and provides refined matches for image orientation.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2022)

Article Environmental Sciences

Building Height Extraction from GF-7 Satellite Images Based on Roof Contour Constrained Stereo Matching

Chenni Zhang, Yunfan Cui, Zeyao Zhu, San Jiang, Wanshou Jiang

Summary: This paper proposes a solution for the estimation of building height from GF-7 satellite images, using a roof contour constrained stereo matching algorithm and DSM based bottom elevation estimation. The results demonstrate that the proposed method improves the accuracy of height estimation for high-rise buildings.

REMOTE SENSING (2022)

Article Environmental Sciences

CAISOV: Collinear Affine Invariance and Scale-Orientation Voting for Reliable Feature Matching

Haihan Luo, Kai Liu, San Jiang, Qingquan Li, Lizhe Wang, Wanshou Jiang

Summary: This study proposes a reliable outlier-removal algorithm by combining two affine-invariant geometric constraints to address the issue of high outlier ratios in initial matches. Through experiments and comparative analysis, the results demonstrate that the algorithm outperforms other methods in overall performance and is suitable for the workflow of SfM-based UAV image orientation.

REMOTE SENSING (2022)

Article Environmental Sciences

Editorial on Special Issue Techniques and Applications of UAV-Based Photogrammetric 3D Mapping

Wanshou Jiang, San Jiang, Xiongwu Xiao

REMOTE SENSING (2022)

Article Engineering, Electrical & Electronic

Optimized Views Photogrammetry: Precision Analysis and a Large-Scale Case Study in Qingdao

Qingquan Li, Hui Huang, Wenshuai Yu, San Jiang

Summary: Unmanned aerial vehicles have become widely used in remote sensing and are critical in the construction of smart cities. However, urban environments pose challenges for secure and accurate data acquisition for 3D modeling. This study presents optimized views photogrammetry as a solution and verifies its precision and potential in large-scale 3D modeling.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2023)

Article Environmental Sciences

MSSF: A Novel Mutual Structure Shift Feature for Removing Incorrect Keypoint Correspondences between Images

Juan Liu, Kun Sun, San Jiang, Kunqian Li, Wenbing Tao

Summary: In this paper, a novel robust feature called Mutual Structure Shift Feature (MSSF) is proposed to remove incorrect keypoint correspondences. The feature measures the bidirectional relative ranking difference for the neighbors of a reference correspondence, and combines spatially nearest neighbors with geometrically good neighbors to reduce the negative effect of incorrect correspondences. The proposed method is evaluated through extensive experiments on raw matching quality and downstream tasks.

REMOTE SENSING (2023)

Article Environmental Sciences

Reliable Feature Matching for Spherical Images via Local Geometric Rectification and Learned Descriptor

San Jiang, Junhuan Liu, Yaxin Li, Duojie Weng, Wu Chen

Summary: This study proposes a reliable feature matching algorithm for spherical images using a combination of local geometric rectification and CNN learned descriptor. Experimental results demonstrate that the algorithm efficiently reduces geometric distortions and provides reliable feature matches for complete reconstruction.

REMOTE SENSING (2023)

Article Geochemistry & Geophysics

WHU-Stereo: A Challenging Benchmark for Stereo Matching of High-Resolution Satellite Images

Shenhong Li, Sheng He, San Jiang, Wanshou Jiang, Lin Zhang

Summary: The article introduces that stereo matching of high-resolution satellite images is still a fundamental but challenging task, and presents a large-scale dataset called WHU-Stereo for training and testing of deep learning networks. The dataset is created using airborne LiDAR point clouds and high-resolution stereo imageries from the Chinese GF-7 satellite, and includes ground-truth disparities considering occlusions. Experimental results demonstrate that the WHU-Stereo dataset can serve as a challenging benchmark for stereo matching and performance evaluation of DL models.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2023)

Article Engineering, Electrical & Electronic

Efficient Match Pair Retrieval for Large-Scale UAV Images via Graph Indexed Global Descriptor

San Jiang, Yichen Ma, Junhuan Liu, Qingquan Li, Wanshou Jiang, Bingxuan Guo, Lelin Li, Lizhe Wang

Summary: This article proposes an efficient method for UAV image orientation using structure from motion (SfM). By training an individual codebook and aggregating local features into global descriptors, the match pair retrieval is accelerated and the efficiency of SfM reconstruction is improved.

IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING (2023)

Article Geochemistry & Geophysics

Parallel Structure From Motion for UAV Images via Weighted Connected Dominating Set

San Jiang, Qingquan Li, Wanshou Jiang, Wu Chen

Summary: This article proposes an algorithm for extracting the global model for cluster merging in unmanned aerial vehicle (UAV) image orientation. It also presents a parallel ISfM solution to achieve efficient and accurate image orientation. The experimental results demonstrate significant improvements in efficiency and orientation accuracy.

IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING (2022)

Article Geochemistry & Geophysics

Unmanned Aerial Vehicle-Based Photogrammetric 3D Mapping A survey of techniques, applications, and challenges

San Jiang, Wanshou Jiang, Lizhe Wang

IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE (2022)

No Data Available