4.7 Article

Robot-aided tunnel inspection and maintenance system by vision and proximity sensor integration

Journal

AUTOMATION IN CONSTRUCTION
Volume 20, Issue 5, Pages 629-636

Publisher

ELSEVIER SCIENCE BV
DOI: 10.1016/j.autcon.2010.12.005

Keywords

Robotic tool design; Robotic automation; Tunnel maintenance; Concrete inspection; HMI

Funding

  1. E.U. community

Ask authors/readers for more resources

This article describes an unprecedented alternative to manual procedures for the application of advanced composite materials, such as Fiber Reinforced Polymer (FRP) and epoxy resins. A complete mobile integrated system is presented for the inspection and maintenance of concrete surfaces in tunnels. It allows performance of operations with minimum interference on passing traffic. The core of this system resides in a specially designed light-weight robotic tool, which is sensed and automated for processes. Sensing includes vision and a laser telemeter to assure precise inspection, superficial preparation, and composite application. The designed interconnection flange allows simple and robust attachment of the tool to a robotic arm's tip. The robot-tool set is to be mounted on a standard articulated lift platform. Therefore, an operator can direct the platform and the robot-tool set's operations from a control station placed at ground-level, in a wheeled vehicle on which the articulated lift platform is mounted. A graphical Human-Machine Interface (HMI) has been developed for the system. It allows the operator to identify fissures for the injection of epoxy resin, and weakened surfaces for FRP adhesion. Actual procedures are planned and performed by the system's automatic components. (C) 2010 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Automation & Control Systems

Enabling garment-agnostic laundry tasks for a Robot Household Companion

David Estevez, Juan G. Victores, Raul Fernandez-Fernandez, Carlos Balaguer

ROBOTICS AND AUTONOMOUS SYSTEMS (2020)

Article Chemistry, Analytical

3D Exploration and Navigation with Optimal-RRT Planners for Ground Robots in Indoor Incidents

Noe Perez-Higueras, Alberto Jardon, Angel Rodriguez, Carlos Balaguer

SENSORS (2020)

Article Chemistry, Analytical

Validity of a Fully-Immersive VR-Based Version of the Box and Blocks Test for Upper Limb Function Assessment in Parkinson's Disease

Edwin Daniel Ona, Alberto Jardon, Alicia Cuesta-Gomez, Patricia Sanchez-Herrera-Baeza, Roberto Cano-de-la-Cuerda, Carlos Balaguer

SENSORS (2020)

Review Chemistry, Analytical

Robot-Aided Systems for Improving the Assessment of Upper Limb Spasticity: A Systematic Review

Ruben De-la-Torre, Edwin Daniel Ona, Carlos Balaguer, Alberto Jardon

SENSORS (2020)

Article Chemistry, Multidisciplinary

Design of an Active Vision System for High-Level Isolation Units through Q-Learning

Andrea Gil Ruiz, Juan G. Victores, Bartek Lukawski, Carlos Balaguer

APPLIED SCIENCES-BASEL (2020)

Review Computer Science, Information Systems

Service Robots in Catering Applications: A Review and Future Challenges

Juan Miguel Garcia-Haro, Edwin Daniel Ona, Juan Hernandez-Vicen, Santiago Martinez, Carlos Balaguer

Summary: With the advancement of robotics technology, waiter robots and other "catering robotics" are gradually entering professional fields such as restaurants. These robots have social capacities to interact with consumers and other robots, as well as physical skills to perform complex tasks in environments like restaurants.

ELECTRONICS (2021)

Article Automation & Control Systems

Basic principles for the development of an application to bi-manipulate boxes with a humanoid robot

J. Hernandez-Vicen, S. Martinez, C. Balaguer

Summary: This article introduces an application that uses computer vision techniques to identify boxes, extracting characteristics and determining the opening side based on a decision tree. The goal is to develop a future application where the humanoid robot TEO can learn to find and manipulate the opening of boxes in an automated system.

REVISTA IBEROAMERICANA DE AUTOMATICA E INFORMATICA INDUSTRIAL (2021)

Article Robotics

Modeling, Gait Sequence Design, and Control Architecture of BADGER Underground Robot

Panagiotis Vartholomeos, Panos Marantos, George Karras, Elisabeth Menendez, Marcos Rodriguez, Santiago Martinez, Carlos Balaguer

Summary: The letter introduces the BADGER autonomous underground robot, which utilizes inchworm biomimetic motion to build curved tunnels underground. Efficient motion control strategies, including gait sequence and motion controller, are designed using dynamic modeling and a model-based approach.

IEEE ROBOTICS AND AUTOMATION LETTERS (2021)

Article Computer Science, Information Systems

Characterization and Study of the Primitive Dynamic Movements Required to Bi-Manipulate a Box

Juan Hernandez-Vicen, Santiago Martinez, Raul de Santos-Rico, Elisabeth Menendez, Carlos Balaguer

Summary: This study examines three different movement strategies for bi-manipulating a box, studies the dynamics involved, conducts experiments, and creates primitive movements based on force and position information in the end effectors.

ELECTRONICS (2021)

Article Mathematics

A New Approach of Soft Joint Based on a Cable-Driven Parallel Mechanism for Robotic Applications

Luis Nagua, Carlos Relano, Concepcion A. Monje, Carlos Balaguer

Summary: A soft joint with 2 Degrees of Freedom designed to function as a robotic joint utilizing a Cable-Driven Parallel Mechanism. A test platform using components manufactured in a 3D printer with a flexible polymer was developed to analyze its performance in detail. The mathematical kinematics model of the soft joint including a blocking mechanism and workspace morphology was validated through Finite Element Analysis, with experimental tests confirming the inverse kinematic model and potential use in robotic platforms.

MATHEMATICS (2021)

Article Computer Science, Artificial Intelligence

Neural Policy Style Transfer

Raul Fernandez-Fernandez, Juan G. Victores, Jennifer J. Gago, David Estevez, Carlos Balaguer

Summary: This study applies the concept of style transfer to deep reinforcement learning, proposing the Neural Policy Style Transfer algorithm that can transfer the style of one policy to another while maintaining the content. Experimental results show that the algorithm can successfully perform style transfer under different Q-network architectures.

COGNITIVE SYSTEMS RESEARCH (2022)

Article Mathematics, Interdisciplinary Applications

Modeling and Control of a Soft Robotic Arm Based on a Fractional Order Control Approach

Carlos Relano, Jorge Munoz, Concepcion A. Monje, Santiago Martinez, Daniel Gonzalez

Summary: This paper investigates the identification and control problems of a novel two-degrees-of-freedom, tendon-actuated, soft robotic arm. A decoupled identification approach is proposed, and a fractional order control strategy is experimentally tested and compared with PI solutions. Simulation and experimental results demonstrate the effectiveness of the discussed modeling and control approaches.

FRACTAL AND FRACTIONAL (2023)

Proceedings Paper Automation & Control Systems

Neural Style Transfer with Twin-Delayed DDPG for Shared Control of Robotic Manipulators

Raul Fernandez-Fernandez, Marco Aggravi, Paolo Robuffo Giordano, Juan G. Victores, Claudio Pacchierotti

Summary: Neural Style Transfer (NST) is an algorithm that allows an element to adopt the appearance or style of another element. This paper presents a custom NST framework for transferring styles to robotic motion. By using an autoencoder architecture and TD3 network, the robot's motion can be altered and adapted offline or online.

2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022) (2022)

Article Construction & Building Technology

Lightweight convolutional neural network driven by small data for asphalt pavement crack segmentation

Jia Liang, Qipeng Zhang, Xingyu Gu

Summary: A lightweight PCSNet-based segmentation model is developed to address the issues of insufficient performance in feature extraction and boundary loss information. The introduction of generalized Dice loss improves prediction performance, and the visualization of class activation mapping enhances model interpretability.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Contextual multimodal approach for recognizing concurrent activities of equipment in tunnel construction projects

Gilsu Jeong, Minhyuk Jung, Seongeun Park, Moonseo Park, Changbum Ryan Ahn

Summary: This study introduces a contextual audio-visual approach to recognize multi-equipment activities in tunnel construction sites, improving monitoring effectiveness. Tested against real-world operation data, the model achieved remarkable results, emphasizing the potential of contextual multimodal models in enhancing operational efficiency in complex construction sites.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dual-path network combining CNN and transformer for pavement crack segmentation

Jin Wang, Zhigao Zeng, Pradip Kumar Sharma, Osama Alfarraj, Amr Tolba, Jianming Zhang, Lei Wang

Summary: This study presents a dual-path network for pavement crack segmentation, combining Convolutional Neural Network (CNN) and transformer. A lightweight CNN encoder is used for local feature extraction, while a novel transformer encoder integrates high-low frequency attention mechanism and efficient feedforward network for global feature extraction. Additionally, a complementary fusion module is introduced to aggregate intermediate features extracted from both encoders. Evaluation on three datasets confirms the superior performance of the proposed network.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Robust optimization for geometrical design of 2D sequential interlocking assemblies

Pierre Gilibert, Romain Mesnil, Olivier Baverel

Summary: This paper introduces a flexible method for crafting 2D assemblies adaptable to various geometric assumptions in the realm of sustainable construction. By utilizing digital fabrication technologies and optimization approaches, precise control over demountable buildings can be achieved, improving mechanical performance and sustainability.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Breaking new ground: Opportunities and challenges in tunnel boring machine operations with integrated management systems and artificial intelligence

Jorge Loy-Benitez, Myung Kyu Song, Yo-Hyun Choi, Je-Kyum Lee, Sean Seungwon Lee

Summary: This paper discusses the advancement of tunnel boring machines (TBM) through the application of artificial intelligence. It highlights the significance of AI-based management subsystems for automatic TBM operations and presents recent contributions in this field. The paper evaluates modeling, monitoring, and control subsystems and suggests research paths for integrating existing management subsystems into TBM automation.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Text mining and natural language processing in construction

Alireza Shamshiri, Kyeong Rok Ryu, June Young Park

Summary: This paper reviews the application of text mining and natural language processing in the construction field, highlighting the need for automation and minimizing manual tasks. The study identifies potential research opportunities in strengthening overlooked construction aspects, coupling diverse data formats, and leveraging pre-trained language models and reinforcement learning.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Improved coverage path planning for indoor robots based on BIM and robotic configurations

Zhengyi Chen, Hao Wang, Keyu Chen, Changhao Song, Xiao Zhang, Boyu Wang, Jack C. P. Cheng

Summary: This study proposes an improved coverage path planning system that leverages building information modeling and robotic configurations to optimize coverage performance in indoor environments. Experimental validation shows the effectiveness and applicability of the system. Future research will focus on further enhancing coverage ratio and optimizing computation time.

AUTOMATION IN CONSTRUCTION (2024)

Review Construction & Building Technology

Human-robot collaboration for modular construction manufacturing: Review of academic research

Yonglin Fu, Junjie Chen, Weisheng Lu

Summary: This study presents a review of human-robot collaboration (HRC) in modular construction manufacturing (MCM), focusing on tasks, human roles, and interaction levels. The review found that HRC solutions are applicable to various MCM tasks, with a primary focus on timber component production. It also revealed the diverse collaborative roles humans can play and the varying levels of interaction with robots.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Steel cable bonding in fresh mortar and 3D printed beam flexural behavior

Qiong Liu, Shengbo Cheng, Chang Sun, Kailun Chen, Wengui Li, Vivian W. Y. Tam

Summary: This paper presents an approach to enhance the path-following capability of concrete printing by integrating steel cables into the printed mortar strips, and validates the feasibility and effectiveness of this approach through experiments.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

A transformer and self-cascade operation-based architecture for segmenting high-resolution bridge cracks

Honghu Chu, Lu Deng, Huaqing Yuan, Lizhi Long, Jingjing Guo

Summary: The study proposes a method called Cascade CATransUNet for high-resolution crack image segmentation. This method combines the coordinate attention mechanism and self-cascaded design to accurately segment cracks. Through a customized feature extraction architecture and an optimized boundary loss function, the proposed method achieves impressive segmentation performance on HR images and demonstrates its practicality in UAV crack detection tasks.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Automated production of synthetic point clouds of truss bridges for semantic and instance segmentation using deep learning models

Daniel Lamas, Andres Justo, Mario Soilan, Belen Riveiro

Summary: This paper introduces a new method for creating synthetic point clouds of truss bridges and demonstrates the effectiveness of a deep learning approach for semantic and instance segmentation of these point clouds. The proposed methodology has significant implications for the development of automated inspection and monitoring systems for truss bridges.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Dynamic building defect categorization through enhanced unsupervised text classification with domain-specific corpus embedding methods

Kahyun Jeon, Ghang Lee, Seongmin Yang, Yonghan Kim, Seungah Suh

Summary: This study proposes two enhanced unsupervised text classification methods for domain-specific non-English text. The results of the tests show that these methods achieve excellent performance on Korean building defect complaints, outperforming state-of-the-art zero-shot and few-shot text classification methods, with minimal data preparation effort and computing resources.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Transformer language model for mapping construction schedule activities to uniformat categories

Yoonhwa Jung, Julia Hockenmaier, Mani Golparvar-Fard

Summary: This study introduces a transformer-based natural language processing model, UNIfORMATBRIDGE, that automatically labels activities in a project schedule with Uniformat classification. Experimental results show that the model performs well in matching unstructured schedule data to Uniformat classifications. Additionally, the study highlights the importance of this method in developing new techniques.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Digital twin for indoor condition monitoring in living labs: University library case study

De-Graft Joe Opoku, Srinath Perera, Robert Osei-Kyei, Maria Rashidi, Keivan Bamdad, Tosin Famakinwa

Summary: This paper introduces a digital twin technology combining Building Information Modelling and the Internet of Things for the construction industry, aiming to optimize building conditions. The technology is implemented in a university library, successfully achieving real-time data capture and visual representation of internal conditions.

AUTOMATION IN CONSTRUCTION (2024)

Article Construction & Building Technology

Learning multi-granular worker intentions from incomplete visual observations for worker-robot collaboration in construction

Zaolin Pan, Yantao Yu

Summary: The construction industry faces safety and workforce shortages globally, and worker-robot collaboration is seen as a solution. However, robots face challenges in recognizing worker intentions in construction. This study tackles these challenges by proposing a fusion method and investigating the best granularity for recognizing worker intentions. The results show that the proposed method can recognize multi-granular worker intentions effectively, contributing to seamless worker-robot collaboration in construction.

AUTOMATION IN CONSTRUCTION (2024)