4.5 Article

Extraction of Pluvial Flood Relevant Volunteered Geographic Information (VGI) by Deep Learning from User Generated Texts and Photos

Journal

Publisher

MDPI
DOI: 10.3390/ijgi7020039

Keywords

social media; crowdsourcing; volunteered geographic information; multimedia information retrieval; convolutional neural network; transfer learning; word embedding; flood mapping

Funding

  1. BMBF [03G0846A]
  2. NVIDIA Corporation
  3. Leibniz Universitat Hannover

Ask authors/readers for more resources

In recent years, pluvial floods caused by extreme rainfall events have occurred frequently. Especially in urban areas, they lead to serious damages and endanger the citizens' safety. Therefore, real-time information about such events is desirable. With the increasing popularity of social media platforms, such as Twitter or Instagram, information provided by voluntary users becomes a valuable source for emergency response. Many applications have been built for disaster detection and flood mapping using crowdsourcing. Most of the applications so far have merely used keyword filtering or classical language processing methods to identify disaster relevant documents based on user generated texts. As the reliability of social media information is often under criticism, the precision of information retrieval plays a significant role for further analyses. Thus, in this paper, high quality eyewitnesses of rainfall and flooding events are retrieved from social media by applying deep learning approaches on user generated texts and photos. Subsequently, events are detected through spatiotemporal clustering and visualized together with these high quality eyewitnesses in a web map application. Analyses and case studies are conducted during flooding events in Paris, London and Berlin.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Review Computer Science, Information Systems

Extraction and analysis of natural disaster-related VGI from social media: review, opportunities and challenges

Yu Feng, Xiao Huang, Monika Sester

Summary: With the rapid development of deep learning techniques, the concept of 'citizen as sensors' has gradually become a reality, involving citizens in acquiring information on natural disasters via social media. Integrating information extracted from various sources to provide comprehensive details on disasters is of great significance.

INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE (2022)

Article Ophthalmology

GaVe: A Webcam-Based Gaze Vending Interface Using One-Point Calibration

Zhe Zeng, Sai Liu, Hao Cheng, Hailong Liu, Yang Li, Yu Feng, Felix Wilhelm Siebert

Summary: This paper introduces gaze input as a promising method for contact-free interaction in human-machine systems. The authors present the GazeVending interface (GaVe) that allows users to control actions on a display using their eyes. GaVe works on a regular webcam and only requires a short calibration before use. The interface is designed in a hierarchical structure, presenting broad item clusters to users and guiding them through another selection round based on dwell time. User study results show that participants quickly understood how to interact with GaVe and performed well in selecting target items.

JOURNAL OF EYE MOVEMENT RESEARCH (2023)

Article Computer Science, Information Systems

Recognition of Intersection Traffic Regulations from Crowdsourced Data

Stefania Zourlidou, Monika Sester, Shaohan Hu

Summary: In this paper, a new method is proposed to detect traffic regulations at intersections using GPS traces. The lack of mapping traffic regulations on maps and the cost and time constraints of surveying equipment for mapping motivate this study. A new method based on summarizing the collective behavior of vehicle crossing intersections is proposed, and a clustering algorithm is modified for detecting stopping and deceleration episodes.

ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION (2023)

Article Computer Science, Information Systems

Promoting favorable routes through visual communication: a design study for creating 'Social' route maps for the case of air pollution

Stefan Fuest, Olga Shkedova, Monika Sester

Summary: This article presents an approach to promote routes that reduce road users' exposure to areas that should be temporarily avoided due to traffic or environmental considerations. At the same time, routes that are already heavily polluted should be avoided to reduce pollution and distribute it more equitably in the environment. In this research, a design study is presented for the creation of route maps that aim to visually communicate the preference for route options in the case of high air pollution.

INTERNATIONAL JOURNAL OF CARTOGRAPHY (2023)

Article Remote Sensing

Learning visual overlapping image pairs for SfM via CNN fine-tuning with photogrammetric geometry information

Qianbao Hou, Rui Xia, Jiahuan Zhang, Yu Feng, Zongqian Zhan, Xin Wang

Summary: This paper addresses the challenge of efficiently and accurately identifying visual overlapping image pairs in large-scale SfM. It fine-tunes several popular CNN models and utilizes local overlapping information to improve retrieval performance.

INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION (2023)

Article Geography

Keeping walls straight: data model and training set size matter for deep learning in building generalization

Cheng Fu, Zhiyong Zhou, Yu Feng, Robert Weibel

Summary: This study proposes a layered data representation model to address the "wobbly-wall" effect in raster-based building generalization. The Residual U-Net model can already produce straight walls and maintain rectangularity and parallelism of buildings at different scales. Increasing the input tensor size is an effective solution to improve prediction. Adjustments in sample balancing and data augmentation can enhance network learning, but tradeoffs exist.

CARTOGRAPHY AND GEOGRAPHIC INFORMATION SCIENCE (2023)

Proceedings Paper Computer Science, Cybernetics

Mixed Reality Agent-Based Framework for Pedestrian-Cyclist Interaction

Vinu Kamalasanan, Awad Mukbil, Monika Sester, Jorg P. Muller

Summary: Virtual Reality (VR) has been widely used in behavioral studies, including urban traffic research. This paper presents a framework called Pedestrian-in-the-Loop (PIL) Mixed Reality (MR), where virtual cyclist avatars coexist with humans in a real-world outdoor space. The novelty of this approach lies in modeling virtual avatars as cognitive agents, allowing them to sense and interact with the environment. The framework shows great potential in effectively studying pedestrian interactions.

2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT (ISMAR-ADJUNCT 2022) (2022)

Proceedings Paper Geography, Physical

LEVERAGING DYNAMIC OBJECTS FOR RELATIVE LOCALIZATION CORRECTION IN A CONNECTED AUTONOMOUS VEHICLE NETWORK

Y. Yuan, M. Sester

Summary: In this paper, a RANSAC-based method is proposed to correct relative localization errors between Connected Autonomous Vehicles (CAVs). This method leverages real-time data sharing and uses dynamic objects, in addition to static environmental information, to improve the accuracy of localization. Experimental results demonstrate that the proposed method greatly reduces relative localization errors, making it suitable for real-time scenarios in autonomous driving.

XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION I (2022)

Proceedings Paper Geography, Physical

BUILDING CHANGE DETECTION IN AIRBORNE LASER SCANNING AND DENSE IMAGE MATCHING POINT CLOUDS USING A RESIDUAL NEURAL NETWORK

F. Politz, M. Sester

Summary: National Mapping Agencies acquire point cloud data from ALS sensors and DIM on aerial images to detect building changes using a residual neural network. The experiments show that this approach can automatically and reliably detect building changes.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II (2022)

Proceedings Paper Geography, Physical

UNCERTAINTY REPRESENTATION AND QUANTIFICATION OF 3D BUILDING MODELS

Qianqian Zou, Monika Sester

Summary: This study proposes a method for modeling 3D building facades with uncertainty quantification in complex urban scenes. The uncertainties of windows and facades are indicated in a probabilistic fashion, and the potential locations of missing objects are inferred using the Monte Carlo sampling approach. The proposed 3D building model and uncertainty measures are evaluated using real-world LiDAR point clouds.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II (2022)

Proceedings Paper Geography, Physical

IMPROVING 3D PEDESTRIAN DETECTION FOR WEARABLE SENSOR DATA WITH 2D HUMAN POSE

Vinu Kamalasanan, Yu Feng, Monika Sester

Summary: Collisions and safety are crucial in urban design like shared spaces. Research directions include developing intelligent mobility aids to prevent collisions, using AR devices for virtual infrastructure and traffic systems, and improving 3D object detection frameworks for better pedestrian detection.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION IV (2022)

Proceedings Paper Geography, Physical

RISK ANALYSIS OF CYCLING ACCIDENTS USING A TRAFFIC DEMAND MODEL

O. Wage, L. Bienzeisler, M. Sester

Summary: This article introduces a method for identifying accident-prone locations using bicycle accident data and bicycle volumes. By using an agent-based traffic simulation model to generate bicycle volumes and normalizing accidents, a risk score can be estimated to help city planners and cyclists avoid high-risk areas.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION IV (2022)

Proceedings Paper Geography, Physical

TRAFFIC CONTROL RECOGNITION WITH AN ATTENTION MECHANISM USING SPEED-PROFILE AND SATELLITE IMAGERY DATA

Hao Cheng, Haoran Lei, Stefania Zourlidou, Monika Sester

Summary: Traffic regulators play a crucial role in influencing traffic flow and commuters' route choices. This paper proposes an automatic method based on CVAE to recognize traffic regulators at intersections using GPS data and satellite imagery from digital maps. Experimental results show that the proposed method achieves better accuracy and F1-score in detecting traffic arm rules compared to other models.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION IV (2022)

Proceedings Paper Geography, Physical

SPATIAL ANALYSIS OF EXTERNAL INFLUENCES ON TRAFFIC ACCIDENTS USING OPEN DATA

J. Golze, U. Feuerhake, M. Sester

Summary: This article investigates traffic accidents in Germany by analyzing various environmental impacting factors, including road characteristics, weather information, population density, and points of interest. By utilizing open data sources such as OpenStreetMap and an open weather API, different categories of features describing the on-site situation of accidents are generated. Through k-means clustering, six clusters are identified and further analyzed in terms of their feature space and spatial distribution. The findings provide valuable insight for regional comparison across the state borders of Germany.

XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION IV (2022)

No Data Available