4.7 Article

SODA: A large-scale open site object detection dataset for deep learning in construction

期刊

AUTOMATION IN CONSTRUCTION
卷 142, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.autcon.2022.104499

关键词

Dataset; Object detection; Construction site; Deep learning; Computer vision

资金

  1. Guangdong Science Foundation [2022A1515010174]
  2. State Key Lab of Subtropical Building Science, South China University of Technology [2022ZB19]
  3. Guangzhou Science and Technology Program [202201010338]
  4. National Natural Science Foundation of China [51908323, 72091512]
  5. SODA at the South China University of Technology

向作者/读者索取更多资源

This study develops and publicly releases a large-scale image dataset specifically collected for construction sites, which contains over 20,000 images and has been statistically analyzed. The evaluation of two deep learning algorithms demonstrates the feasibility and performance of this dataset.
Comprehensive image datasets can benefit the construction industry in terms of serving as the basis for gener-ating deep-learning-based object detection models and testing the performance of object detection algorithms, but building such datasets is complex and requires vast professional knowledge. This paper develops and publicly releases a new large-scale image dataset specifically collected and annotated for the construction site, called Site Object Detection Dataset (SODA), which contains 15 object classes categorized by the worker, material, machine, and layout. >20,000 images were collected from multiple construction sites in different situations, weather conditions, and construction phases, covering different angles and perspectives. Statistical analysis shows that the dataset is well developed in terms of diversity and volume. Further evaluation with two widely-adopted deep learning-based object detection algorithms also illustrates the feasibility of the dataset, achieving a maximum mAP of 81.47%. This research contributes a large-scale open image dataset for the construction industry and sets up a performance benchmark for further evaluation of relevant algorithms.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Construction & Building Technology

Rule-based information extraction for mechanical-electrical-plumbing-specific semantic web

Lang-Tao Wu, Jia-Rui Lin, Shuo Leng, Jiu-Lin Li, Zhen-Zhong Hu

Summary: This paper proposes a rule-based approach for MEP information extraction and verifies its feasibility and efficiency through experiments.

AUTOMATION IN CONSTRUCTION (2022)

Article Construction & Building Technology

Digital Twin-Based Investigation of a Building Collapse Accident

Zhe Zheng, Wenjie Liao, Jiarui Lin, Yucheng Zhou, Chi Zhang, Xinzheng Lu

Summary: The investigation of collapse accidents is crucial for preventing future incidents and improving structural resilience. However, conventional methods face challenges in dealing with complex collapse accidents. The proposed digital twin-based investigation method offers an effective solution by integrating real-world data into virtual models, allowing for efficient analysis and revealing potential collapse mechanisms.

ADVANCES IN CIVIL ENGINEERING (2022)

Article Construction & Building Technology

Adaptive control of resource flow to optimize construction work and cash flow via online deep reinforcement learning

Can Jiang, Xin Li, Jia-Rui Lin, Ming Liu, Zhiliang Ma

Summary: Poor management of construction work, resource, and cash flows can lead to time and cost overruns, bankruptcy, and project failure due to their complexity and dynamics. This paper proposes a model and method to adaptively control resource flows and optimize the work and cash flows of construction projects. A mathematical model based on a partially observable Markov decision process is established to capture the complex interactions and uncertainties. A Deep Reinforcement Learning (DRL) based method is introduced for continuous adaptive optimal control, and a simulator based on discrete event simulation assists the training process. Experiments show that our method outperforms traditional methods and a hybrid approach combining DRL and empirical method achieves the best result.

AUTOMATION IN CONSTRUCTION (2023)

Article Chemistry, Multidisciplinary

Evaluation of Virtual Reality Application in Construction Teaching: A Comparative Study of Undergraduates

Dongyang An, Hui Deng, Cheng Shen, Yiwen Xu, Lina Zhong, Yichuan Deng

Summary: Construction courses often lack teaching of practical knowledge due to safety and cost concerns, but VR can improve this by facilitating interactions between teachers and students. This study evaluated the effect of VR in construction teaching and found that it enhances students' enthusiasm and satisfaction, especially in practical knowledge. Students also believe a combination of traditional and VR teaching is more helpful. These findings strengthen the advantages of VR in delivering practical knowledge in construction teaching.

APPLIED SCIENCES-BASEL (2023)

Review Construction & Building Technology

Recent Research Progress in Intelligent Construction: A Comparison between China and Developed Countries

Jing-Ke Yan, Zhe Zheng, Yu-Cheng Zhou, Jia-Rui Lin, Yi-Chuan Deng, Xin-Zheng Lu

Summary: Intelligent construction is a new approach to transform the AEC industry through the integration of advanced information technologies. This study provides a comparative review of relevant literature and discusses the differences between developing and developed countries in the field of intelligent construction. Four future research directions are suggested.

BUILDINGS (2023)

Article Construction & Building Technology

Data-Driven Quantitative Performance Evaluation of Construction Supervisors

Cheng Yang, Jia-Rui Lin, Ke-Xiao Yan, Yi-Chuan Deng, Zhen-Zhong Hu, Cheng Liu

Summary: This paper proposes a data-driven approach to quantitatively evaluate the performance of construction supervisors by integrating analytic hierarchy process (AHP) and activity tracking.

BUILDINGS (2023)

Editorial Material Construction & Building Technology

Intelligent and Computer Technologies' Application in Construction

Hongling Guo, Jia-Rui Lin, Yantao Yu

BUILDINGS (2023)

Article Construction & Building Technology

A multilayer perceptron-based fast sunlight assessment for the conceptual design of residential neighborhoods under Chinese policy

Can Jiang, Xiong Liang, Yu-cheng Zhou, Yong Tian, Shengli Xu, Jia-Rui Lin, Zhiliang Ma, Shiji Yang, Hao Zhou

Summary: In Chinese building codes, it is necessary for residential buildings to receive a minimum amount of direct sunlight on a specified winter day. This requirement is essential for obtaining a building permit during the conceptual design phase, and official software is commonly used to assess sunlight performance. The paper proposes a real-time shading time interval prediction method based on multilayer perceptron, which reduces computation time significantly with high accuracy. A residential neighborhood layout planning plug-in for Rhino 7/Grasshopper is also developed based on the proposed model. The study demonstrates the potential of using deep learning techniques for accelerating sunlight hour simulations in the conceptual design phase.

BUILDING AND ENVIRONMENT (2023)

Article Virology

Epstein-Barr virus-encoded miR-BART11-3p modulates the DUSP6-MAPK axis to promote gastric cancer cell proliferation and metastasis

Mingqian Xu, Jiarui Lin, Shuaibing Yang, Jiahu Yao, Meiyang Chen, Jinfu Feng, Liang Zhang, Li Zhou, Junjie Zhang, Qingsong Qin

Summary: The Epstein-Barr virus (EBV) encoded miRNA miR-BART11-3p promotes cell proliferation, migration, and invasion in gastric cancer (GC) by targeting DUSP6 and dysregulating the MAPK pathway. Restoring DUSP6 expression reverses the tumor-promoting effects of miR-BART11-3p, and blocking ERK phosphorylation inhibits the effects of miR-BART11-3p-expressing cells. These findings provide new insights into tumorigenesis in EBV-associated gastric cancer (EBVaGC) and potential therapeutic strategies.

JOURNAL OF VIROLOGY (2023)

Article Engineering, Mechanical

System reliability analysis for independent and nonidentical components based on survival signature

Yide Zheng, Yi Zhang, Jiarui Lin

Summary: Two algorithms based on survival signatures are proposed to analyze the reliability of complex systems with independently distributed components. The results demonstrate that these algorithms can effectively reduce the computation time and are applied to analyze a real practical problem.

PROBABILISTIC ENGINEERING MECHANICS (2023)

Article Construction & Building Technology

BIM-based time-varying system reliability analysis for buildings and infrastructures

Yide Zheng, Yi Zhang, Jiarui Lin

Summary: Building Information Modelling (BIM) technology is widely used in the building industry, but the current BIM-based infrastructure time effect analysis mainly focuses on cost and schedule analyses, neglecting the impact on system safety. This paper developed a BIM-reliability integrated technology for time-varying and system analysis of structural safety, which was demonstrated using two different case studies.

JOURNAL OF BUILDING ENGINEERING (2023)

Article Automation & Control Systems

A text classification-based approach for evaluating and enhancing the machine interpretability of building codes

Zhe Zheng, Yu-Cheng Zhou, Ke-Yin Chen, Xin-Zheng Lu, Zhong-Tian She, Jia-Rui Lin

Summary: This research aims to propose a novel approach to automatically evaluate and enhance the machine interpretability of single clauses and building codes. By introducing classification categories and developing a text classification model, the machine interpretability of building codes is improved, and a quantitative evaluation method is proposed. Experimental results show that the proposed method outperforms existing methods, and it is suggested that there is still room for improvement in the interpretability of building codes.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Proceedings Paper Construction & Building Technology

A Review on Current Advances of Intelligent Construction Based on Bibliometric Analysis

Jingke Yan, Zhe Zheng, Yucheng Zhou, Jiarui Lin, Yichuan Deng

Summary: With the development of information technologies and the transformation and upgrading of the AEC industry, intelligent construction is gaining increasing attention. Integrating with construction industrialization, intelligent construction has become an important way to achieve high-quality development of the AEC industry. Through a bibliometric analysis of related research, this study found that English articles transitioned from theoretical methods to engineering practice, while Chinese articles showed a rapid development in recent years with close interactions with engineering practice.

CARBON PEAK AND NEUTRALITY STRATEGIES OF THE CONSTRUCTION INDUSTRY (ICCREM 2022) (2022)

Article Construction & Building Technology

Lightweight convolutional neural network driven by small data for asphalt pavement crack segmentation

Jia Liang, Qipeng Zhang, Xingyu Gu

Summary: A lightweight PCSNet-based segmentation model is developed to address the issues of insufficient performance in feature extraction and boundary loss information. The introduction of generalized Dice loss improves prediction performance, and the visualization of class activation mapping enhances model interpretability.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Contextual multimodal approach for recognizing concurrent activities of equipment in tunnel construction projects

Gilsu Jeong, Minhyuk Jung, Seongeun Park, Moonseo Park, Changbum Ryan Ahn

Summary: This study introduces a contextual audio-visual approach to recognize multi-equipment activities in tunnel construction sites, improving monitoring effectiveness. Tested against real-world operation data, the model achieved remarkable results, emphasizing the potential of contextual multimodal models in enhancing operational efficiency in complex construction sites.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dual-path network combining CNN and transformer for pavement crack segmentation

Jin Wang, Zhigao Zeng, Pradip Kumar Sharma, Osama Alfarraj, Amr Tolba, Jianming Zhang, Lei Wang

Summary: This study presents a dual-path network for pavement crack segmentation, combining Convolutional Neural Network (CNN) and transformer. A lightweight CNN encoder is used for local feature extraction, while a novel transformer encoder integrates high-low frequency attention mechanism and efficient feedforward network for global feature extraction. Additionally, a complementary fusion module is introduced to aggregate intermediate features extracted from both encoders. Evaluation on three datasets confirms the superior performance of the proposed network.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Robust optimization for geometrical design of 2D sequential interlocking assemblies

Pierre Gilibert, Romain Mesnil, Olivier Baverel

Summary: This paper introduces a flexible method for crafting 2D assemblies adaptable to various geometric assumptions in the realm of sustainable construction. By utilizing digital fabrication technologies and optimization approaches, precise control over demountable buildings can be achieved, improving mechanical performance and sustainability.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Breaking new ground: Opportunities and challenges in tunnel boring machine operations with integrated management systems and artificial intelligence

Jorge Loy-Benitez, Myung Kyu Song, Yo-Hyun Choi, Je-Kyum Lee, Sean Seungwon Lee

Summary: This paper discusses the advancement of tunnel boring machines (TBM) through the application of artificial intelligence. It highlights the significance of AI-based management subsystems for automatic TBM operations and presents recent contributions in this field. The paper evaluates modeling, monitoring, and control subsystems and suggests research paths for integrating existing management subsystems into TBM automation.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Text mining and natural language processing in construction

Alireza Shamshiri, Kyeong Rok Ryu, June Young Park

Summary: This paper reviews the application of text mining and natural language processing in the construction field, highlighting the need for automation and minimizing manual tasks. The study identifies potential research opportunities in strengthening overlooked construction aspects, coupling diverse data formats, and leveraging pre-trained language models and reinforcement learning.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Improved coverage path planning for indoor robots based on BIM and robotic configurations

Zhengyi Chen, Hao Wang, Keyu Chen, Changhao Song, Xiao Zhang, Boyu Wang, Jack C. P. Cheng

Summary: This study proposes an improved coverage path planning system that leverages building information modeling and robotic configurations to optimize coverage performance in indoor environments. Experimental validation shows the effectiveness and applicability of the system. Future research will focus on further enhancing coverage ratio and optimizing computation time.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Human-robot collaboration for modular construction manufacturing: Review of academic research

Yonglin Fu, Junjie Chen, Weisheng Lu

Summary: This study presents a review of human-robot collaboration (HRC) in modular construction manufacturing (MCM), focusing on tasks, human roles, and interaction levels. The review found that HRC solutions are applicable to various MCM tasks, with a primary focus on timber component production. It also revealed the diverse collaborative roles humans can play and the varying levels of interaction with robots.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Steel cable bonding in fresh mortar and 3D printed beam flexural behavior

Qiong Liu, Shengbo Cheng, Chang Sun, Kailun Chen, Wengui Li, Vivian W. Y. Tam

Summary: This paper presents an approach to enhance the path-following capability of concrete printing by integrating steel cables into the printed mortar strips, and validates the feasibility and effectiveness of this approach through experiments.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

A transformer and self-cascade operation-based architecture for segmenting high-resolution bridge cracks

Honghu Chu, Lu Deng, Huaqing Yuan, Lizhi Long, Jingjing Guo

Summary: The study proposes a method called Cascade CATransUNet for high-resolution crack image segmentation. This method combines the coordinate attention mechanism and self-cascaded design to accurately segment cracks. Through a customized feature extraction architecture and an optimized boundary loss function, the proposed method achieves impressive segmentation performance on HR images and demonstrates its practicality in UAV crack detection tasks.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Automated production of synthetic point clouds of truss bridges for semantic and instance segmentation using deep learning models

Daniel Lamas, Andres Justo, Mario Soilan, Belen Riveiro

Summary: This paper introduces a new method for creating synthetic point clouds of truss bridges and demonstrates the effectiveness of a deep learning approach for semantic and instance segmentation of these point clouds. The proposed methodology has significant implications for the development of automated inspection and monitoring systems for truss bridges.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dynamic building defect categorization through enhanced unsupervised text classification with domain-specific corpus embedding methods

Kahyun Jeon, Ghang Lee, Seongmin Yang, Yonghan Kim, Seungah Suh

Summary: This study proposes two enhanced unsupervised text classification methods for domain-specific non-English text. The results of the tests show that these methods achieve excellent performance on Korean building defect complaints, outperforming state-of-the-art zero-shot and few-shot text classification methods, with minimal data preparation effort and computing resources.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Transformer language model for mapping construction schedule activities to uniformat categories

Yoonhwa Jung, Julia Hockenmaier, Mani Golparvar-Fard

Summary: This study introduces a transformer-based natural language processing model, UNIfORMATBRIDGE, that automatically labels activities in a project schedule with Uniformat classification. Experimental results show that the model performs well in matching unstructured schedule data to Uniformat classifications. Additionally, the study highlights the importance of this method in developing new techniques.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Digital twin for indoor condition monitoring in living labs: University library case study

De-Graft Joe Opoku, Srinath Perera, Robert Osei-Kyei, Maria Rashidi, Keivan Bamdad, Tosin Famakinwa

Summary: This paper introduces a digital twin technology combining Building Information Modelling and the Internet of Things for the construction industry, aiming to optimize building conditions. The technology is implemented in a university library, successfully achieving real-time data capture and visual representation of internal conditions.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Learning multi-granular worker intentions from incomplete visual observations for worker-robot collaboration in construction

Zaolin Pan, Yantao Yu

Summary: The construction industry faces safety and workforce shortages globally, and worker-robot collaboration is seen as a solution. However, robots face challenges in recognizing worker intentions in construction. This study tackles these challenges by proposing a fusion method and investigating the best granularity for recognizing worker intentions. The results show that the proposed method can recognize multi-granular worker intentions effectively, contributing to seamless worker-robot collaboration in construction.

AUTOMATION IN CONSTRUCTION (2024)