4.7 Article

Deep learning-based road damage detection and classification for multiple countries

期刊

AUTOMATION IN CONSTRUCTION
卷 132, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.autcon.2021.103935

关键词

Automatic road condition monitoring; Convolutional neural network; Deep learning; Smartphone-based road damage detection; Big Data; Smart infrastructure

资金

  1. Ministry of Education, India

向作者/读者索取更多资源

Many municipalities and road authorities lack the technology, know-how, and funds to afford state-of-the-art equipment for data collection and analysis of road damages. While some countries, like Japan, have developed Smartphone-based methods for automatic road condition monitoring, others still struggle to find efficient solutions. This study assesses usability of the Japanese model for other countries, proposes a large-scale road damage dataset, and models capable of detecting and classifying road damages in multiple countries.
Many municipalities and road authorities seek to implement automated evaluation of road damage. However, they often lack technology, know-how, and funds to afford state-of-the-art equipment for data collection and analysis of road damages. Although some countries, like Japan, have developed less expensive and readily available Smartphone-based methods for automatic road condition monitoring, other countries still struggle to find efficient solutions. This work makes the following contributions in this context. Firstly, it assesses usability of Japanese model for other countries. Secondly, it proposes a large-scale heterogeneous road damage dataset comprising 26,620 images collected from multiple countries (India, Japan, and the Czech Republic) using smartphones. Thirdly, it proposes models capable of detecting and classifying road damages in more than one country. Lastly, the study provides recommendations for readers, local agencies, and municipalities of other countries when one other country publishes its data and model for automatic road damage detection and classification. A part of the proposed dataset was utilized for Global Road Damage Detection Challenge'2020 and can be accessed at (https://github.com/sekilab/RoadDamageDetector/).

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Environmental Sciences

Extraction of built-up areas from Landsat-8 OLI data based on spectral-textural information and feature selection using support vector machine method

Vijendra Singh Bramhe, Sanjay Kumar Ghosh, Pradeep Kumar Garg

GEOCARTO INTERNATIONAL (2020)

Article Environmental Sciences

Assessment and prediction of urban growth for a mega-city using CA-Markov model

Veerendra Yadav, Sanjay Kumar Ghosh

Summary: This study assessed the land use and land cover changes in Chennai using temporal Landsat data and various analytical methods to study the impact of urbanization. The results showed a growing trend in the urban area of Chennai, with the prediction model indicating that vegetation and barren land will continue to be converted into urban land in the coming decades.

GEOCARTO INTERNATIONAL (2021)

Article Environmental Sciences

Crop classification in a heterogeneous agricultural environment using ensemble classifiers and single-date Sentinel-2A imagery

Rashmi Saini, Sanjay Kumar Ghosh

Summary: This study successfully identified major crops in the Roorkee, India using Sentinel-2A data, with Xgboost showing the best performance for crop mapping and support vector machine (SVM) performing the worst. Major crops, such as wheat and sugarcane, were accurately classified with high accuracy rates.

GEOCARTO INTERNATIONAL (2021)

Article Environmental Sciences

Analysis of land use land cover change using a new and existing spectral indices and its impact on normalized land surface temperature

Atul Kant Piyoosh, Sanjay Kumar Ghosh

Summary: A new spectral index NRUI(ms) has been proposed for assessing LULC changes in Dehradun, India using Landsat satellite data. The NRUI(ms) showed better separability compared to other indices for the fallow-urban class pair. Significant LULC changes were observed during the period 1991-2019, with unprecedented urban growth and conversion of vegetated areas into non-vegetated areas.

GEOCARTO INTERNATIONAL (2022)

Article Multidisciplinary Sciences

RDD2020: An annotated image dataset for automatic road damage detection using deep learning

Deeksha Arya, Hiroya Maeda, Sanjay Kumar Ghosh, Durga Toshniwal, Yoshihide Sekimoto

Summary: The RDD2020 dataset includes road images from India, Japan, and the Czech Republic, totaling 26,336, capturing 4 types of road damage, aiming to develop deep learning methods to automatically detect and classify road damage, which can be used for developing low-cost methods for monitoring road pavement conditions.

DATA IN BRIEF (2021)

Article Instruments & Instrumentation

Surface Water Area Extraction by Using Water Indices and DFPS Method Applied to Satellites Data

Surendra Singh Choudhary, S. K. Ghosh

Summary: This study utilizes satellite images to accurately extract and calculate surface water area. It compares the accuracy of different water indices and uses a semi-automatic method to obtain optimum threshold values and classify water indices. The results show that NDWI provides the best surface water area outputs.

SENSING AND IMAGING (2022)

Article Environmental Sciences

Spatio-temporal shift in fire activity in the Indo-Gangetic region

Sumit Kumar, Sanjay Kumar Ghosh, Brijendra Pateriya

Summary: The vegetation fire patterns and burning trends in the Indo-Gangetic Region have shifted from forest and shrubland to cropland. Fire counts have increased by 2.6 times over the past 20 years, and there has been a shift in the burning season.

GEOCARTO INTERNATIONAL (2022)

Article Meteorology & Atmospheric Sciences

Analysis of rainfall and temperature using deep learning model

Surendra Singh Choudhary, S. K. Ghosh

Summary: The uncertainty of climatic variations presents a challenge for human adaptation. Despite technological developments for predicting and forecasting climate behavior, uncertainty of atmospheric and geoprocesses hinders efforts in dealing with disasters. It is crucial to understand future atmospheric uncertainty and predict climatic variations for analysis and decision-making. This study focuses on developing a model trained with rainfall and temperature data to support climatic predictions and adaptation to adverse situations.

THEORETICAL AND APPLIED CLIMATOLOGY (2023)

Article Environmental Sciences

Analysis of reservoir outflow using deep learning model

Surendra Singh Choudhary, S. K. Ghosh

Summary: The Long Short Term Memory model of Deep Learning is applied to predict reservoir outflow using rainfall, rainfall intensity, runoff rate, temperature, surface water area, and reservoir outflow. This study analyzes the effect of parameter settings on model performance and identifies the main factors influencing reservoir outflow prediction. The proposed model can accurately and efficiently predict multiple parameters.

MODELING EARTH SYSTEMS AND ENVIRONMENT (2023)

Proceedings Paper Engineering, Aerospace

Power Management of Drones

D. S. Vohra, P. K. Garg, S. K. Ghosh

Summary: Drones are used for various activities and require long flying time, which depends on the LiPo batteries used. This paper will discuss how to choose the right LiPo battery pack for drones, the working principle of LiPo batteries, different forms/configurations and cell sizes, maintenance, and alternatives such as charging stations, charging drones while in flight, and the use of solar voltaic cells.

PROCEEDINGS OF UASG 2021: WINGS 4 SUSTAINABILITY (2023)

Proceedings Paper Computer Science, Artificial Intelligence

AI-Driven Road Condition Monitoring across Multiple Nations

Deeksha Arya, Sanjay Kumar Ghosh, Durga Toshniwal

Summary: The doctoral work discussed in this summary applies Artificial Intelligence (AI) for social good, aiming to achieve low-cost and faster monitoring of road conditions across different nations for safer roads. Furthermore, the study provides recommendations for utilizing road image data and Deep Learning models from one country to detect road damage in other countries.

THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Global Road Damage Detection: State-of-the-art Solutions

Deeksha Arya, Hiroya Maeda, Sanjay Kumar Ghosh, Durga Toshniwal, Hiroshi Omata, Takehiro Kashiyama, Yoshihide Sekimoto

2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA) (2020)

Article Construction & Building Technology

Lightweight convolutional neural network driven by small data for asphalt pavement crack segmentation

Jia Liang, Qipeng Zhang, Xingyu Gu

Summary: A lightweight PCSNet-based segmentation model is developed to address the issues of insufficient performance in feature extraction and boundary loss information. The introduction of generalized Dice loss improves prediction performance, and the visualization of class activation mapping enhances model interpretability.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Contextual multimodal approach for recognizing concurrent activities of equipment in tunnel construction projects

Gilsu Jeong, Minhyuk Jung, Seongeun Park, Moonseo Park, Changbum Ryan Ahn

Summary: This study introduces a contextual audio-visual approach to recognize multi-equipment activities in tunnel construction sites, improving monitoring effectiveness. Tested against real-world operation data, the model achieved remarkable results, emphasizing the potential of contextual multimodal models in enhancing operational efficiency in complex construction sites.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dual-path network combining CNN and transformer for pavement crack segmentation

Jin Wang, Zhigao Zeng, Pradip Kumar Sharma, Osama Alfarraj, Amr Tolba, Jianming Zhang, Lei Wang

Summary: This study presents a dual-path network for pavement crack segmentation, combining Convolutional Neural Network (CNN) and transformer. A lightweight CNN encoder is used for local feature extraction, while a novel transformer encoder integrates high-low frequency attention mechanism and efficient feedforward network for global feature extraction. Additionally, a complementary fusion module is introduced to aggregate intermediate features extracted from both encoders. Evaluation on three datasets confirms the superior performance of the proposed network.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Robust optimization for geometrical design of 2D sequential interlocking assemblies

Pierre Gilibert, Romain Mesnil, Olivier Baverel

Summary: This paper introduces a flexible method for crafting 2D assemblies adaptable to various geometric assumptions in the realm of sustainable construction. By utilizing digital fabrication technologies and optimization approaches, precise control over demountable buildings can be achieved, improving mechanical performance and sustainability.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Breaking new ground: Opportunities and challenges in tunnel boring machine operations with integrated management systems and artificial intelligence

Jorge Loy-Benitez, Myung Kyu Song, Yo-Hyun Choi, Je-Kyum Lee, Sean Seungwon Lee

Summary: This paper discusses the advancement of tunnel boring machines (TBM) through the application of artificial intelligence. It highlights the significance of AI-based management subsystems for automatic TBM operations and presents recent contributions in this field. The paper evaluates modeling, monitoring, and control subsystems and suggests research paths for integrating existing management subsystems into TBM automation.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Text mining and natural language processing in construction

Alireza Shamshiri, Kyeong Rok Ryu, June Young Park

Summary: This paper reviews the application of text mining and natural language processing in the construction field, highlighting the need for automation and minimizing manual tasks. The study identifies potential research opportunities in strengthening overlooked construction aspects, coupling diverse data formats, and leveraging pre-trained language models and reinforcement learning.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Improved coverage path planning for indoor robots based on BIM and robotic configurations

Zhengyi Chen, Hao Wang, Keyu Chen, Changhao Song, Xiao Zhang, Boyu Wang, Jack C. P. Cheng

Summary: This study proposes an improved coverage path planning system that leverages building information modeling and robotic configurations to optimize coverage performance in indoor environments. Experimental validation shows the effectiveness and applicability of the system. Future research will focus on further enhancing coverage ratio and optimizing computation time.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Human-robot collaboration for modular construction manufacturing: Review of academic research

Yonglin Fu, Junjie Chen, Weisheng Lu

Summary: This study presents a review of human-robot collaboration (HRC) in modular construction manufacturing (MCM), focusing on tasks, human roles, and interaction levels. The review found that HRC solutions are applicable to various MCM tasks, with a primary focus on timber component production. It also revealed the diverse collaborative roles humans can play and the varying levels of interaction with robots.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Steel cable bonding in fresh mortar and 3D printed beam flexural behavior

Qiong Liu, Shengbo Cheng, Chang Sun, Kailun Chen, Wengui Li, Vivian W. Y. Tam

Summary: This paper presents an approach to enhance the path-following capability of concrete printing by integrating steel cables into the printed mortar strips, and validates the feasibility and effectiveness of this approach through experiments.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

A transformer and self-cascade operation-based architecture for segmenting high-resolution bridge cracks

Honghu Chu, Lu Deng, Huaqing Yuan, Lizhi Long, Jingjing Guo

Summary: The study proposes a method called Cascade CATransUNet for high-resolution crack image segmentation. This method combines the coordinate attention mechanism and self-cascaded design to accurately segment cracks. Through a customized feature extraction architecture and an optimized boundary loss function, the proposed method achieves impressive segmentation performance on HR images and demonstrates its practicality in UAV crack detection tasks.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Automated production of synthetic point clouds of truss bridges for semantic and instance segmentation using deep learning models

Daniel Lamas, Andres Justo, Mario Soilan, Belen Riveiro

Summary: This paper introduces a new method for creating synthetic point clouds of truss bridges and demonstrates the effectiveness of a deep learning approach for semantic and instance segmentation of these point clouds. The proposed methodology has significant implications for the development of automated inspection and monitoring systems for truss bridges.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dynamic building defect categorization through enhanced unsupervised text classification with domain-specific corpus embedding methods

Kahyun Jeon, Ghang Lee, Seongmin Yang, Yonghan Kim, Seungah Suh

Summary: This study proposes two enhanced unsupervised text classification methods for domain-specific non-English text. The results of the tests show that these methods achieve excellent performance on Korean building defect complaints, outperforming state-of-the-art zero-shot and few-shot text classification methods, with minimal data preparation effort and computing resources.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Transformer language model for mapping construction schedule activities to uniformat categories

Yoonhwa Jung, Julia Hockenmaier, Mani Golparvar-Fard

Summary: This study introduces a transformer-based natural language processing model, UNIfORMATBRIDGE, that automatically labels activities in a project schedule with Uniformat classification. Experimental results show that the model performs well in matching unstructured schedule data to Uniformat classifications. Additionally, the study highlights the importance of this method in developing new techniques.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Digital twin for indoor condition monitoring in living labs: University library case study

De-Graft Joe Opoku, Srinath Perera, Robert Osei-Kyei, Maria Rashidi, Keivan Bamdad, Tosin Famakinwa

Summary: This paper introduces a digital twin technology combining Building Information Modelling and the Internet of Things for the construction industry, aiming to optimize building conditions. The technology is implemented in a university library, successfully achieving real-time data capture and visual representation of internal conditions.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Learning multi-granular worker intentions from incomplete visual observations for worker-robot collaboration in construction

Zaolin Pan, Yantao Yu

Summary: The construction industry faces safety and workforce shortages globally, and worker-robot collaboration is seen as a solution. However, robots face challenges in recognizing worker intentions in construction. This study tackles these challenges by proposing a fusion method and investigating the best granularity for recognizing worker intentions. The results show that the proposed method can recognize multi-granular worker intentions effectively, contributing to seamless worker-robot collaboration in construction.

AUTOMATION IN CONSTRUCTION (2024)