4.5 Article

Rock segmentation visual system for assisting driving in TBM construction

期刊

MACHINE VISION AND APPLICATIONS
卷 32, 期 4, 页码 -

出版社

SPRINGER
DOI: 10.1007/s00138-021-01203-8

关键词

Tunnel boring machine; Visual system; Semantic segmentation; Dataset

资金

  1. National Natural Science Foundation of China [61633019, 61873233]
  2. National Key R&D Program of China [2017YFB1300403]
  3. Fundamental Research Funds for the Central Universities

向作者/读者索取更多资源

The study introduces a rock segmentation visual system to assist the driver of a tunnel boring machine. The system can automatically analyze the size distribution of rocks and provide statistical information, effectively detecting large rock particles and meeting the speed requirements of the system design.
The tunnel boring machine (TBM) is a key equipment for excavating long-range tunnels. It is a complex system and hard to be controlled well in practice. In this paper, we propose the rock segmentation visual system to assist TBM driving. Through the system, online size distribution of excavated rocks is automatically analysed and sent back to TBM driver, from which many statistical information can be gathered. The system's core algorithm is based on semantic segmentation, and the rock detection task is viewed as a rock/background pixel-wise classification problem. Accordingly, the Rock Segmentation Dataset is made with specific annotation strategies, and the goal of the dataset is to pick out large rocks in the images. Many networks are evaluated quantitatively on it, and we select the best suited one. We design two parallel networks to extract rock object and contour mask, such that the connected rock areas in object mask can be split with a mask fusion algorithm. Further network modification is made to boost inference speed that meets the requirement of system design. Experimental results show that the system can effectively detect large rock particles in the images and make necessary statistical analysis. Specifically, the segmentation accuracy achieves 68.3% mIoU, and the inference speed achieves 19.4 FPS under image resolution of 1600x1200on one NVIDIA Titan XP GPU. From the viewpoint of statistical analysis, 43.5% rock size IoU and 14.7% error rate of mean rock size are obtained, which is acceptable from the viewpoint of real applications.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Automation & Control Systems

Finite-time local piecewise control for parabolic PDEs with ODE output feedback

Manna Li, Weijie Mao

Summary: This paper presents a dynamic output feedback control strategy for finite-time local piecewise control of parabolic partial differential equations, with sufficient conditions developed for stabilization of the closed-loop system through matrix inequalities feasibility, supported by simulation studies.

IET CONTROL THEORY AND APPLICATIONS (2022)

Article Multidisciplinary Sciences

Automated rock mass condition assessment during TBM tunnel excavation using deep learning

Liang Chen, Zhitao Liu, Hongye Su, Fulong Lin, Weijie Mao

Summary: In this study, a self-convolution based attention fusion network (SAFN) is proposed for rock mass condition assessment. The network is designed to discover and fuse object attention maps within a deep neural network, enabling fine-grain classification of rock mass. Experimental results show that the proposed method outperforms state-of-the-art models in rock mass assessment and the field test demonstrates its accuracy and efficiency in automated classification of rock mass.

SCIENTIFIC REPORTS (2022)

Article Computer Science, Artificial Intelligence

Image-level dataset synthesis with an end-to-end trainable framework

Zhenfeng Xue, Weijie Mao, Yong Liu

Summary: This paper proposes a method to simulate synthetic datasets from a fine-grained perspective, enabling the system to be trained in an end-to-end manner. By converting it into an image-level data synthesis problem and training a generative model to approximate the rendering process, the whole framework becomes fully differentiable, allowing efficient optimization of attributes.

IET IMAGE PROCESSING (2022)

Article Computer Science, Artificial Intelligence

ViRFD: a virtual-realistic fused dataset for rock size analysis in TBM construction

Zhenfeng Xue, Liang Chen, Zhitao Liu, Yong Liu, Weijie Mao

Summary: In this paper, a virtual-realistic fused dataset is proposed for assisting rock size analysis in TBM construction process. By using a virtual engine and a learning-based method, the method reduces the challenges in dataset acquisition and improves the test accuracy for segmentation in real applications.

NEURAL COMPUTING & APPLICATIONS (2022)

Article Automation & Control Systems

Real-Time Prediction of TBM Driving Parameters Using In Situ Geological and Operation Data

Liang Chen, Zhitao Liu, Weijie Mao, Hongye Su, Fulong Lin

Summary: This article proposes a TransTP network for real-time prediction of tunnel boring machine (TBM) driving parameters. By collecting a hybrid in situ prediction dataset, the network can learn multiperiod feature representation and extract multivariate features, achieving accurate prediction of TBM driving parameters.

IEEE-ASME TRANSACTIONS ON MECHATRONICS (2022)

Article Engineering, Civil

Robust Registration of Rail Profile and Complete Detection of Outliers in Complex Field Environment

Yanfu Li, Xiaopeng Yang, Liang Chen, Yingjian Zhi, Hongli Liu

Summary: This paper focuses on solving the challenges of rail wear measurement in complex field environments. It proposes a solution that includes preprocessing to locate the rail waist, a hybrid model called R-H-ICP for profile registration, and a method for accurately detecting outliers. Extensive experiments validate the efficiency and superiority of the proposed methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Construction & Building Technology

Spatial-temporal fusion network for maximum ground surface settlement prediction during tunnel excavation

Liang Chen, Kimihiro Hashiba, Zhitao Liu, Fulong Lin, Weijie Mao

Summary: The maximum ground surface settlement prediction is a complex problem with many influencing factors. A hybrid prediction dataset is constructed to estimate the settlement, which includes geological and construction parameters based on spatial and temporal series. A spatial-temporal fusion network (STF-Network) is proposed to handle the multi-modal and multi-variate series prediction task.

AUTOMATION IN CONSTRUCTION (2023)

Article Computer Science, Artificial Intelligence

Mask-guided image person removal with data synthesis

Yunliang Jiang, Chenyang Gu, Zhenfeng Xue, Xiongtao Zhang, Yong Liu

Summary: This paper proposes a novel idea to tackle the problems of image person removal by data synthesis. Two dataset production methods are proposed to automatically generate images, masks, and ground truths. A learning framework similar to local image degradation is used to guide the feature extraction process and gather more texture information for final prediction. Experimental results demonstrate the effectiveness of the method and the trained network has good generalization ability.

IET IMAGE PROCESSING (2023)

Article Chemistry, Analytical

A USV-UAV Cooperative Trajectory Planning Algorithm with Hull Dynamic Constraints

Tao Huang, Zhe Chen, Wang Gao, Zhenfeng Xue, Yong Liu

Summary: Efficient trajectory generation in complex dynamic environments for unmanned surface vehicles (USVs) remains a challenge due to interference from hull swing and ambient weather. This paper proposes a cooperative trajectory planning algorithm for a coupled USV-UAV system, utilizing a lightweight semantic segmentation network and 3D projection transformation. The algorithm generates an initial obstacle avoidance trajectory using a graph-based search method and introduces a numerical optimization method based on hull dynamic constraints for easier trajectory tracking. A motion control method based on NMPC with energy consumption constraint is also proposed.

SENSORS (2023)

Article Computer Science, Information Systems

Learning to Simulate Complex Scenes for Street Scene Segmentation

Zhenfeng Xue, Weijie Mao, Liang Zheng

Summary: This paper explores content adaptation in the context of semantic segmentation using data simulation engines. The authors propose a scalable discretization-and-relaxation approach to optimize attribute values and generate training sets similar to real-world data. The experiment shows promising results in terms of real-world segmentation accuracy.

IEEE TRANSACTIONS ON MULTIMEDIA (2022)

Article Automation & Control Systems

Real-Time Prediction of TBM Driving Parameters Using In Situ Geological and Operation Data

Liang Chen, Zhitao Liu, Weijie Mao, Hongye Su, Fulong Lin

Summary: This article proposes a TransTP network for real-time prediction of tunnel boring machine (TBM) driving parameters, achieving superior performance.

IEEE-ASME TRANSACTIONS ON MECHATRONICS (2022)

暂无数据