4.7 Article

Towards Real-Time Building Damage Mapping with Low-Cost UAV Solutions

期刊

REMOTE SENSING
卷 11, 期 3, 页码 -

出版社

MDPI
DOI: 10.3390/rs11030287

关键词

UAV; building damage; detection; real-time; deep learning; photogrammetric mapping

资金

  1. INACHUS (Technological and Methodological Solutions for Integrated Wide Area Situation Awareness and Survivor Localization to Support Search), an EU-FP7 project [607522]

向作者/读者索取更多资源

The timely and efficient generation of detailed damage maps is of fundamental importance following disaster events to speed up first responders' (FR) rescue activities and help trapped victims. Several works dealing with the automated detection of building damages have been published in the last decade. The increasingly widespread availability of inexpensive UAV platforms has also driven their recent adoption for rescue operations (i.e., search and rescue). Their deployment, however, remains largely limited to visual image inspection by skilled operators, limiting their applicability in time-constrained real conditions. This paper proposes a new solution to autonomously map building damages with a commercial UAV in near real-time. The solution integrates different components that allow the live streaming of the images on a laptop and their processing on the fly. Advanced photogrammetric techniques and deep learning algorithms are combined to deliver a true-orthophoto showing the position of building damages, which are already processed by the time the UAV returns to base. These algorithms have been customized to deliver fast results, fulfilling the near real-time requirements. The complete solution has been tested in different conditions, and received positive feedback by the FR involved in the EU funded project INACHUS. Two realistic pilot tests are described in the paper. The achieved results show the great potential of the presented approach, how close the proposed solution is to FR' expectations, and where more work is still needed.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Geochemistry & Geophysics

Integrating UAV and Ground Panoramic Images for Point Cloud Analysis of Damaged Building

Jyun-Ping Jhan, Norman Kerle, Jiann-Yeou Rau

Summary: The effectiveness of damaged building investigation relies on rapid data collection, using UAV and a backpack panoramic imaging system for recording damage status comprehensively. Integrating these for generating complete 3D point clouds is crucial for 3D measurement of damaged areas. This study evaluates the impact of using panoramic images and multiview aerial images for 3D mapping, highlighting the necessity of integrating both for rapid and complete point cloud generation.

IEEE GEOSCIENCE AND REMOTE SENSING LETTERS (2022)

Article Geography, Physical

LISU: Low-light indoor scene understanding with joint learning of reflectance restoration

Ning Zhang, Francesco Nex, Norman Kerle, George Vosselman

Summary: This paper presents a novel cascade network for studying semantic segmentation in low-light indoor environments, utilizing real and rendered images datasets. The proposed method achieves high accuracy in segmentation by decomposing low-light images and incorporating illumination invariant features. The results also demonstrate the importance of semantic information in enhancing reflectance restoration and segmentation accuracy.

ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING (2022)

Article Computer Science, Artificial Intelligence

Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle

Simone Borsci, Ville V. Lehtola, Francesco Nex, Michael Ying Yang, Ellen-Wien Augustijn, Leila Bagheriye, Christoph Brune, Ourania Kounadi, Jamy Li, Joao Moreira, Joanne Van der Nagel, Bernard Veldkamp, Duc Le, Mingshu Wang, Fons Wijnhoven, Jelmer M. Wolterink, Raul Zurita-Milla

Summary: The article reviews the EU Commission's whitepaper on Artificial Intelligence and highlights potential conflicts with current societal, technical, and methodological constraints. The lack of a coherent EU vision and methods to support sustainable AI diffusion are identified as main obstacles. The article recommends complementary rules and compensatory mechanisms to avoid market fragmentation, as well as research to address technical and methodological open questions for the sustainable development of human-AI co-action.

AI & SOCIETY (2023)

Article Environmental Sciences

Training a Disaster Victim Detection Network for UAV Search and Rescue Using Harmonious Composite Images

Ning Zhang, Francesco Nex, George Vosselman, Norman Kerle

Summary: This research focuses on using deep learning to detect victims in disaster debris, proposes a method to generate harmonious composite images for training, and significantly improves detection accuracy.

REMOTE SENSING (2022)

Article Environmental Sciences

Towards Improved Unmanned Aerial Vehicle Edge Intelligence: A Road Infrastructure Monitoring Case Study

Sofia Tilon, Francesco Nex, George Vosselman, Irene Sevilla de la Llave, Norman Kerle

Summary: This paper introduces a versatile UAV system that can carry out multiple road infrastructure monitoring tasks simultaneously in real-time. The system design considers computational strain and latency, and it is deployed on a unique typology of UAV. It includes important modules such as vehicle detection, scene segmentation, and 3D scene reconstruction, and has a good performance.

REMOTE SENSING (2022)

Article Remote Sensing

Simulating a Hybrid Acquisition System for UAV Platforms

Bashar Alsadik, Fabio Remondino, Francesco Nex

Summary: This paper investigates a multi-view camera system integrated with a multi-beam LiDAR to build an efficient UAV hybrid system. Two types of cameras, MAPIR Survey and SenseFly SODA, integrated with a multi-beam digital Ouster OS1-32 LiDAR sensor, are proposed and examined. The results show that with appropriate conditions, high-density facade coverage can be achieved.

DRONES (2022)

Article Remote Sensing

Microdrone-Based Indoor Mapping with Graph SLAM

Samer Karam, Francesco Nex, Bhanu Teja Chidura, Norman Kerle

Summary: This article presents a low-cost SLAM-based drone for creating exploration maps of building interiors. The experimental results indicate that the system is capable of creating quality exploration maps of small indoor spaces and handling the loop-closure problem.

DRONES (2022)

Article Environmental Studies

Thematic Comparison between ESA WorldCover 2020 Land Cover Product and a National Land Use Land Cover Map

Diogo Duarte, Cidalia Fonte, Hugo Costa, Mario Caetano

Summary: This study compares the differences between a global land cover map and a national use/land cover map of Portugal. The results show differences in land use, classification, and focus between the two maps. It is found that the global land cover map is better at distinguishing artificial surfaces and grasslands within urban environments, but often fails to differentiate sparse/individual trees from neighboring cover in the Portuguese landscape.
Proceedings Paper Geography, Physical

MICRO AND MACRO QUADCOPTER DRONES FOR INDOOR MAPPING TO SUPPORT DISASTER MANAGEMENT

S. Karam, F. Nex, O. Karlsson, J. Rydell, E. Bilock, M. Tulldahl, M. Holmberg, N. Kerle

Summary: This paper presents the operations and mapping techniques of two drones used for mapping indoor spaces. Both the Crazyflie and MAX drones are capable of mapping cluttered indoor environments and providing sufficient point clouds for quick exploration. The results show that the LIDAR scanner-based system can handle larger office environments with minimal drift, while the Crazyflie drone performs well given its limited sensor configuration.

XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION I (2022)

Proceedings Paper Geography, Physical

EXPLORING THE POTENTIALS OF UAV PHOTOGRAMMETRIC POINT CLOUDS IN FACADE DETECTION AND 3D RECONSTRUCTION OF BUILDINGS

Karen K. Mwangangil, P. O. Mc'okeyo, S. J. Oude Elberink, F. Nex

Summary: This research explores the potential of using UAV image data for 3D buildings reconstruction, and analyzes the optimal parameter settings. The results show that proper segmentation and detection methods can improve the 3D building modeling from UAV point clouds.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II (2022)

Proceedings Paper Geography, Physical

UNSUPERVISED HARMONIOUS IMAGE COMPOSITION FOR DISASTER VICTIM DETECTION

N. Zhang, F. Nex, G. Vosselman, N. Kerle

Summary: This paper addresses the issue of deep detection networks in detecting buried victims. By generating realistic images and using an unsupervised generative adversarial network for harmonization, the accuracy of victim detection can be effectively improved.

XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III (2022)

Proceedings Paper Geography, Physical

GEOGRAPHICAL TRANSFERABILITY OF LULC IMAGE-BASED SEGMENTATION MODELS USING TRAINING DATA AUTOMATICALLY GENERATED FROM OPENSTREETMAP - CASE STUDY IN PORTUGAL

D. Duarte, C. C. Fonte, J. Patriarca, I Jesus

Summary: This study evaluates the geographical transferability of satellite image-based segmentation models trained with OpenStreetMap (OSM) derived data through a series of experiments. The results show that models trained in different locations can improve the mapping of certain classes.

XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III (2022)

暂无数据