4.5 Article

Curved patch mapping and tracking for irregular terrain modeling: Application to bipedal robot foot placement

Journal

ROBOTICS AND AUTONOMOUS SYSTEMS
Volume 119, Issue -, Pages 13-30

Publisher

ELSEVIER
DOI: 10.1016/j.robot.2019.05.012

Keywords

Irregular surface modeling; Foothold contact modeling; Bounded curved patch modeling; Curved patch fitting and tracking; 3D perception for bipedal robots; Bipedal robot foot placement; Rough terrain stepping; Legged robot locomotion

Ask authors/readers for more resources

Legged robots need to make contact with irregular surfaces, when operating in unstructured natural terrains. Representing and perceiving these areas to reason about potential contact between a robot and its surrounding environment, is still largely an open problem. This paper introduces a new framework to model and map local rough terrain surfaces, for tasks such as bipedal robot foot placement. The system operates in real-time, on data from an RGB-D and an IMU sensor. We introduce a set of parametrized patch models and an algorithm to fit them in the environment. Potential contacts are identified as bounded curved patches of approximately the same size as the robot's foot sole. This includes sparse seed point sampling, point cloud neighborhood search, and patch fitting and validation. We also present a mapping and tracking system, where patches are maintained in a local spatial map around the robot as it moves. A bio-inspired sampling algorithm is introduced for finding salient contacts. We include a dense volumetric fusion layer for spatiotemporally tracking, using multiple depth data to reconstruct a local point cloud. We present experimental results on a mini-biped robot that performs foot placements on rocks, implementing a 3D foothold perception system, that uses the developed patch mapping and tracking framework. (C) 2019 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Robotics

An efficient leg with series-parallel and biarticular compliant actuation: design optimization, modeling, and control of the eLeg

Wesley Roozing, Zeyu Ren, Nikos G. Tsagarakis

Summary: This study introduces a novel three-degree-of-freedom compliantly actuated leg called eLeg, employing efficient actuation design and control strategies. Experimental results demonstrate significant improvements in electrical energy consumption compared to traditional actuation configurations.

INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH (2021)

Article Polymer Science

Comprehensive Enhancement in Thermomechanical Performance of Melt-Extruded PEEK Filaments by Graphene Incorporation

Srinivasarao Yaragalla, Muhammad Zahid, Jaya Kumar Panda, Nikolaos Tsagarakis, Roberto Cingolani, Athanassia Athanassiou

Summary: A simple and scalable fabrication process of graphene nanoplatelets (GnPs)-reinforced polyether ether ketone (PEEK) filaments with enhanced mechanical and thermal performance was successfully demonstrated. The addition of GnPs to PEEK improved the thermal stability of the polymer matrix, but excessive GnPs content can negatively affect the mechanical performance.

POLYMERS (2021)

Article Robotics

Blending of Series-Parallel Compliant Actuation With Field Weakening Control for Explosive Motion Generation

Vishnu Dev Amara, Jorn Malzahn, Wesley Roozing, Nikos Tsagarakis

Summary: This study explores and validates two methods for enhancing the explosive motion capabilities of series elastic actuated robots during standing jumps. By combining field weakening control and energy-efficient parallel elastic actuators, a significant performance increase of up to 54% in jump height is achieved, demonstrating the effectiveness of the approach in improving the explosive capabilities of these robots.

IEEE ROBOTICS AND AUTOMATION LETTERS (2021)

Article Robotics

Nonlinear model predictive control for robust bipedal locomotion: exploring angular momentum and CoM height changes

J. Ding, C. Zhou, S. Xin, X. Xiao, N. G. Tsagarakis

Summary: The study introduces a novel Nonlinear Model Predictive Control framework for generating robust walking patterns that adapt multiple balance strategies, and demonstrates adaptable walking capabilities in various scenarios through simulation studies.

ADVANCED ROBOTICS (2021)

Article Computer Science, Information Systems

Reconfigurable and Agile Legged-Wheeled Robot Navigation in Cluttered Environments With Movable Obstacles

Vignesh Sushrutha Raghavan, Dimitrios Kanoulas, Darwin G. Caldwell, Nikos G. Tsagarakis

Summary: This article discusses legged and wheeled locomotion methods used by robots for navigation, and the advantages of combining them to create a hybrid legged-wheeled locomotion. The article presents a review of a previously presented legged-wheeled footprint reconfiguring global planner, as well as new work on local obstacle pushing. The combination of these global and local planners forms a major part of the agile reconfigurable navigation suite for the legged-wheeled hybrid CENTAURO robot.

IEEE ACCESS (2022)

Article Automation & Control Systems

An Angle-Axis Space-Based Orientability Index Characterizing Complete Orientations

Gaofeng Li, Jingtai Liu, Ioannis Sarakoglou, Nikos G. Tsagarakis

Summary: The development of new materials and actuators has led to the rapid growth of new types of robots in robotics, such as soft/continuum robots, reconfigurable robots, exoskeleton robots, haptic master devices, and so on. However, there is still a lack of theoretical investigation on the orientability performance index in robot design. In this article, a novel orientability index based on the angle-axis space is proposed to evaluate the dexterity of robots, and its effectiveness is validated.

IEEE-ASME TRANSACTIONS ON MECHATRONICS (2022)

Article Robotics

Behavior policy learning: Learning multi-stage tasks via solution sketches and model-based controllers

Konstantinos Tsinganos, Konstantinos Chatzilygeroudis, Denis Hadjivelichkov, Theodoros Komninos, Evangelos Dermatas, Dimitrios Kanoulas

Summary: This paper proposes a method called Behavior Policy Learning (BPL) that effectively solves multi-stage tasks without requiring strong knowledge about the underlying task. The method combines solution sketches, model-based controllers, and simulations to learn high-level trajectories and improve policy robustness. The Sim2Real capabilities of the method are validated through both simulation and real-world experiments.

FRONTIERS IN ROBOTICS AND AI (2022)

Editorial Material Automation & Control Systems

Taking the First Step Toward Autonomous Quadruped Robots: The Quadruped Robot Challenge at ICRA 2023 in London

Adam Jacoff, Jeongmin Jeon, Oliver Huke, Dimitrios Kanoulas, Seehoon Ha, Donghyun Kim, Hyungpil Moon

IEEE ROBOTICS & AUTOMATION MAGAZINE (2023)

Article Engineering, Biomedical

Body Extension by Using Two Mobile Manipulators

Yusuke Hirao, Weiwei Wan, Dimitrios Kanoulas, Kensuke Harada

Summary: This paper introduces a remotely operated robotic system with two mobile manipulators to extend the functional capabilities of a human body. The system allows for enlarging the workspace and manipulating large or long objects. It utilizes a joystick for controlling the mobile base and robotic gripper, and a motion capture system for controlling the arm poses, enabling tele-operated dual-arm and large-space manipulation. Experimental results validate the effectiveness of the proposed system in extending the human body to a large space while retaining the advantages of having two limbs.

CYBORG AND BIONIC SYSTEMS (2023)

Proceedings Paper Automation & Control Systems

Robust Contact State Estimation in Humanoid Walking Gaits

Stylianos Piperakis, Michael Maravgakis, Dimitrios Kanoulas, Panos Trahanias

Summary: In this article, a deep learning framework is proposed for leg contact detection in humanoid robot walking gaits. The framework uses proprioceptive sensing and accurately estimates the contact state probability for each leg. It shows stability and generalization across different friction surfaces and legged robotic platforms, and performs well in simulation and real robot experiments.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Automation & Control Systems

Autonomous Mobile 3D Printing of Large-Scale Trajectories

Julius Sustarevas, Dimitrios Kanoulas, Simon Julier

Summary: Mobile 3D Printing (M3DP), using printing-in-motion, is a powerful paradigm for automated construction. In this paper, we extend previous work on M3DP to robot control and compare different methods of integrating the planned path with a short horizon Model Predictive Controller. Through experiments, we demonstrate the effectiveness and feasibility of our algorithm in a 250m long multilayer print.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Automation & Control Systems

Navigation Among Movable Obstacles with Object Localization using Photorealistic Simulation

Kirsty Ellis, Henry Zhang, Danail Stoyanov, Dimitrios Kanoulas

Summary: This paper introduces a novel system integration for handling Navigation Among Movable Obstacles (NAMO) using visual feedback. It explores the capabilities of the system through graph-based path planning in a photorealistic simulator and validates the method on a real-world mobile wheeled robot.

2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) (2022)

Proceedings Paper Automation & Control Systems

Agile Actions with a Centaur-Type Humanoid: A Decoupled Approach

Matteo Parigi Polverini, Enrico Mingo Hoffman, Arturo Laurenzi, Nikos G. Tsagarakis

Summary: This study presents a control architecture for agile actions, separating offline optimal control planning of lower-body primitives and online control of upper-body motion for balance. To address the research challenges posed by the centaur-type humanoid platform, researchers introduce three stabilizing strategies for comparison in simulated jumps and experimental validation on the CENTAURO robot.

2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021) (2021)

Proceedings Paper Automation & Control Systems

Optimization-Based Quadrupedal Hybrid Wheeled-Legged Locomotion

I Belli, M. Parigi Polverini, A. Laurenzi, E. Mingo Hoffman, P. Rocco, N. G. Tsagarakis

Summary: This paper presents a trajectory optimization approach for the motion generation problem of a wheeled-legged quadrupedal robot, incorporating a unicycle model for each leg to generate various locomotion strategies. The effectiveness of the approach has been experimentally validated on the humanoid quadruped CENTAURO.

PROCEEDINGS OF THE 2020 IEEE-RAS 20TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS 2020) (2021)

Proceedings Paper Automation & Control Systems

A Compliant Mechanism with Progressive Stiffness for Robotic Actuation

Eamon Barrett, Jorn Malzahn, Nikos Tsagarakis

Summary: Softer series elastic actuators provide higher torque resolution and better torque transparency for soft physical interaction with the environment, while stiffer series elastic actuators enable fast, strong, and powerful physical interaction. Progressive stiffness compliant elements can make the actuator inherently soft at low torque levels and stiffer at higher levels, addressing design trade-offs. The proposed solution, based on radially oriented linear springs, achieves a passive elastic element without complex nonlinear transmissions, resulting in a cubic polynomial torque-deflection characteristic with low hysteresis.

2021 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM) (2021)

Article Automation & Control Systems

Mask-VRDet: A robust riverway panoptic perception model based on dual graph fusion of vision and 4D mmWave radar

Runwei Guan, Shanliang Yao, Lulu Liu, Xiaohui Zhu, Ka Lok Man, Yong Yue, Jeremy Smith, Eng Gee, Yutao Yue

Summary: With the development of Unmanned Surface Vehicles (USVs), the perception of inland waterways has become significant. Traditional RGB cameras cannot work effectively in adverse weather and at night, which has led to the emergence of 4D millimeter-wave radar as a new perception sensor. However, the radar suffers from water-surface clutter and irregular shape of point cloud. To address these issues, this paper proposes a high-performance panoptic perception model called Mask-VRDet, which fuses features of vision and radar using graph neural network.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Improving accuracy reconstruction of parts through a capability study: A methodology for X-ray Computed Tomography Robotic Cell

Adrien Le Reun, Kevin Subrin, Anthony Dubois, Sebastien Garnier

Summary: This study aims to evaluate the quality and health of aerospace parts using a high-dimensional robotic cell. By utilizing X-ray Computed Tomography devices, the interior of the parts can be reconstructed and anomalies can be detected. A methodology is proposed to assess both the raw process capability and the improved process capability, with three strategies developed to improve the robot behavior model and calibration.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

An analytical differential kinematics-based method for controlling tendon-driven continuum robots

Weiming Ba, Jung-Che Chang, Jing Liu, Xi Wang, Xin Dong, Dragos Axinte

Summary: This paper proposes a hybrid scheme for kinematic control of continuum robots, which avoids errors through tension supervision and accurate piecewise linear approximation. The effectiveness of the controller is verified on different continuum robotic systems.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Self-supervised prediction of the intention to interact with a service robot

Gabriele Abbate, Alessandro Giusti, Viktor Schmuck, Oya Celiktutan, Antonio Paolillo

Summary: In this study, a learning-based approach is proposed to predict the probability of human users interacting with a robot before the interaction begins. By considering the pose and motion of the user, the approach labels the robot's encounters with humans in a self-supervised manner. The method is validated and deployed in various scenarios, achieving high accuracy in predicting user intentions to interact with the robot.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Depth- and semantics-aware multi-modal domain translation: Generating 3D panoramic color images from LiDAR point clouds

Tiago Cortinhal, Eren Erdal Aksoy

Summary: This work presents a new depth-and semantics-aware conditional generative model, named TITAN-Next, for cross-domain image-to-image translation between LiDAR and camera sensors. The model is able to translate raw LiDAR point clouds to RGB-D camera images by solely relying on semantic scene segments, and it has practical applications in fields like autonomous vehicles.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Overcome the Fear Of Missing Out: Active sensing UAV scanning for precision agriculture

Marios Krestenitis, Emmanuel K. Raptis, Athanasios Ch. Kapoutsis, Konstantinos Ioannidis, Elias B. Kosmatopoulos, Stefanos Vrochidis

Summary: This paper addresses the issue of informative path planning for a UAV used in precision agriculture. By using a non-uniform scanning approach, the time spent in areas with minimal value is reduced, while maintaining high precision in information-dense regions. A novel active sensing and deep learning-based coverage path planning approach is proposed, which adjusts the UAV's speed based on the quantity and confidence level of identified plant classes.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Development and evaluation of fiber reinforced modular soft actuators and an individualized soft rehabilitation glove

Shota Kokubu, Pablo E. Tortos Vinocour, Wenwei Yu

Summary: In this study, a new modular soft actuator was proposed to improve the support performance of soft rehabilitation gloves (SRGs). Objective evaluations and clinical tests were conducted to demonstrate the effectiveness and functionality of the proposed actuator and SRG.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Design and experiment of a variable stiffness prosthetic knee joint using parallel elastic actuation

Jinliang Zhu, Yuanxi Sun, Jie Xiong, Yiyang Liu, Jia Zheng, Long Bai

Summary: This paper proposes an active prosthetic knee joint with a variable stiffness parallel elastic actuation mechanism. Numerical verifications and practical experiments demonstrate that the mechanism can reduce torque and power, thus reducing energy consumption and improving the endurance of the prosthetic knee joint.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Adaptive shift strategy of a novel power-cycling variable transmission for construction vehicles

Yong You, Jingtao Wu, Yunlong Meng, Dongye Sun, Datong Qin

Summary: A new power-cycling variable transmission (PCVT) is proposed and applied to construction vehicles to improve transmission efficiency. A shift correction strategy is developed based on identifying the changes in construction vehicles' mass and gradient. Simulation results show that the proposed method can correct shift points, improve operation efficiency, and ensure a safer operation process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Base position and task assignment optimization concerning productivity and machining performance for multi-robot systems in aerospace manufacturing

Shaorui Liu, Wei Tian, Jianxin Shen, Bo Li, Pengcheng Li

Summary: This paper proposes a two-objective optimization technique for multi-robot systems, addressing the issue of balancing productivity and machining performance in high-quality machining tasks.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Identifying and approaching for obscured stairs

Pengchao Ding, Faben Zhu, Hongbiao Zhu, Gongcheng Wang, Hua Bai, Han Wang, Dongmei Wu, Zhijiang Du, Weidong Wang

Summary: We propose an autonomous approaching scheme for mobile robot traversing obstacle stairwells, which overcomes the restricted field of vision caused by obstacles. The scheme includes stair localization, structural parameter estimation, and optimization of the approaching process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Comparative analysis of multiple YOLO-based target detectors and trackers for ADAS in edge devices

Pedro Azevedo, Vitor Santos

Summary: Accurate detection and tracking of vulnerable road users and traffic objects are vital tasks for autonomous driving and driving assistance systems. This paper proposes a solution for object detection and tracking in an autonomous driving scenario, comparing different object detectors and exploring the deployment on edge devices. The effectiveness of DeepStream technology and different object trackers is assessed using the KITTI tracking dataset.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Shared autonomy and positive power control for powered exoskeletons

Benjamin Beiter, Divya Srinivasan, Alexander Leonessa

Summary: Powered exoskeletons can significantly reduce physical workload and have great potential impact on future labor practices. To truly assist users in achieving task goals, a shared autonomy control framework is proposed to separate the control objectives of the human and exoskeleton. Positive Power control is introduced for the human-based controller, while 'acceptance' is used as a measure of matching the exoskeleton's control objective to the human's. Both control objectives are implemented in an optimization-based Whole-Body-Control structure. The results verify the effectiveness of the control framework and its potential for improving cooperative control for powered exoskeletons.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)