4.5 Article

A neuromorphic control architecture for a biped robot

Journal

ROBOTICS AND AUTONOMOUS SYSTEMS
Volume 120, Issue -, Pages -

Publisher

ELSEVIER
DOI: 10.1016/j.robot.2019.07.014

Keywords

Neuromorphic controller; Real time trajectory generation; Chaotic Recurrent Neural Network; Humanoid robotics; Biped robot; Neurodynamics

Funding

  1. Ministry of Education and Science of the Republic of Kazakhstan [348/226-2016]
  2. Nazarbayev University, Kazakhstan [090118FD5343]

Ask authors/readers for more resources

A neuromorphic control architecture is introduced to govern the motion of a lightweight humanoid robot. The reference trajectories necessary to perform stable gaits are generated by neural modules represented by Chaotic Recurrent Neural Networks CRNN organized in a hierarchical fashion. In the higher layer a body-coordination module generates the trajectories for the central parts of the robot body, in the middle layer the limb-coordination modules generate the Cartesian trajectories for the end effector of each limb, finally in the lower layer the limb modules control the position of the robot joints. Each neural module consists of a reservoir of N = 200 leaky-integrator neurons randomly and sparsely connected with fixed synapses. The adaptation occurs in the synapses of readout units by online learning techniques like the delta rule and the Recursive Least Square algorithm RLS. It is demonstrated that the neural modules can learn and reproduce with enough accuracy the trajectories acquired from the simulation of a humanoid robot in V-REP software. With an optimal initialization of the reservoir connection matrix and by using a low computationally expensive learning algorithm such as the delta rule, Theta(N), the average of MSE over all lower limbs joints is in the order of 0.1. For the lower-limbs-coordination-module the MSE drops to 0.004 by using the more computational expensive RLS, Theta(N-2). In case the neural module needs to learn how to adapt the trajectories according to a specific step length and frequency the MSE is 0.06. A comparison between different learning algorithms applied on the CRNN showed better performances by using RLS. This result is confirmed also by a direct comparison with a different neural architecture, the PCPG, however at the expense of a bigger computational complexity. A real test conducted on a small computational unit (Raspberry Pi2) demonstrated that the CRNN can be executed at a frequency of 142 Hz which suffices to feed a PID feedback control loop at the joint level. (C) 2019 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Robotics

Design and Modeling of a Lightweight and Low Power Consumption Full-Scale Biped Robot

Michele Folgheraiter, Bauyrzhan Aubakir

INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS (2018)

Article Robotics

Reasoning on objects and grasping using description logics

Nicola Vitucci, Giuseppina Gini

ADVANCED ROBOTICS (2019)

Article Chemistry, Multidisciplinary

Could deep learning in neural networks improve the QSAR models?

G. Gini, F. Zanoli, A. Gamba, G. Raitano, E. Benfenati

SAR AND QSAR IN ENVIRONMENTAL RESEARCH (2019)

Review Environmental Sciences

Integrating in silico models and read-across methods for predicting toxicity of chemicals: A step-wise strategy

Emilio Benfenati, Qasim Chaudhry, Giuseppina Gini, Jean Lou Dorne

ENVIRONMENT INTERNATIONAL (2019)

Article History & Philosophy Of Science

The QSAR similarity principle in the deep learning era: Confirmation or revision?

Giuseppina Gini

FOUNDATIONS OF CHEMISTRY (2020)

Article Biochemistry & Molecular Biology

QSAR modeling without descriptors using graph convolutional neural networks: the case of mutagenicity prediction

Chiakang Hung, Giuseppina Gini

Summary: This paper demonstrates the construction of QSAR models from 2D molecular graphs without the need for computing chemical descriptors, using graph convolutional neural network models with and without Bayesian estimation of prediction uncertainty. The models predict the mutagenicity of molecules based on the Ames test results, showing promising results compared to current state-of-the-art models. The interpretation of the models is enhanced by automatic extraction of important substructures driving the prediction, as well as uncertainty estimations.

MOLECULAR DIVERSITY (2021)

Proceedings Paper Automation & Control Systems

Fast Prototyping and Testing of a New Full Scale Bipedal Robot

Timur Umurzakov, Sharafatdin Yessirkepov, Michele Folgheraiter

Summary: This paper presents the development of a low-cost and fast prototyping bipedal robot with 12 DOFs. The lower limb structure of the robot was physically assembled by the research team, optimizing cost and duration. To reduce cost and weight, a high power-to-weight ratio servomotor capable of generating up to 200 W of mechanical power was developed.

2022 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION ENGINEERING, ICRAE (2022)

Proceedings Paper Automation & Control Systems

Design and Control of an Aquatic Robot with RGB-D Sensor

Madi Nurmanov, Timur Ishuov, Azim Dukenderov, Michele Folgheraiter

Summary: Bio-inspired robotics is a new field of engineering that aims to mimic living organisms for different applications. This work focuses on developing a reactive control system for an aquatic robot based on feedback from an RGB-D camera. The robot uses image segmentation and depth data to estimate distances and a neural network to control its trajectory, allowing it to avoid obstacles and detect energy sources.

2022 8TH INTERNATIONAL CONFERENCE ON AUTOMATION, ROBOTICS AND APPLICATIONS (ICARA 2022) (2022)

Proceedings Paper Automation & Control Systems

Development of a Shoulder Joint for Humanoid Robotics Application

Zhenis Otarbay, Sharafatdin Yessirkepov, Timur Ishuov, Michele Folgheraiter

Summary: This paper presents the design and kinematic model of a low-inertia, high-stiffness tendon-driven shoulder joint for humanoid robotics. The system consists of three limbs with 2 DOFs of mobility and the possibility of a third DOF for yaw rotation. Motion is achieved using three tendons moved by motors integrated with pulleys. Load cell sensors in the joint structure measure the forces applied by the tendons. A custom motherboard integrates the microcontroller unit, motor drivers, and instrumentation amplifiers. The forward kinematic model was obtained using screw theory, with inverse kinematics calculated from the orientation matrix. Preliminary testing was conducted using a custom graphical user interface for actuator monitoring and control.

2021 20TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS (ICAR) (2021)

Proceedings Paper Engineering, Biomedical

On the Classification of Electromyography Signals to Control a Four Degree-Of-Freedom Prosthetic Device

Artemiy Oleinikov, Berdakh Abibullaev, Michele Folgheraiter

42ND ANNUAL INTERNATIONAL CONFERENCES OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY: ENABLING INNOVATIVE TECHNOLOGIES FOR GLOBAL HEALTHCARE EMBC'20 (2020)

Proceedings Paper Automation & Control Systems

An Actuated Spherical Joint for Humanoid Robotics Applications

Michele Folgheraiter, Sharafatdin Yessirkepov, Alikhan Yessaly

PROCEEDINGS OF THE IEEE 2019 9TH INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) ROBOTICS, AUTOMATION AND MECHATRONICS (RAM) (CIS & RAM 2019) (2019)

Proceedings Paper Computer Science, Artificial Intelligence

Development of a Teach Pendant for Humanoid Robotics with Cartesian and Joint-Space Control Modalities

Zhenis Otarbay, Iliyas Assylgali, Asset Yskak, Michele Folgheraiter

2019 28TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN) (2019)

Proceedings Paper Robotics

Computational Efficient Balance Control for a Lightweight Biped Robot with Sensor Based ZMP Estimation

Michele Folgheraiter, Alikhan Yessaly, Galym Kaliyev, Asset Yskak, Sharafatdin Yessirkepov, Artemiy Oleinikov, Giuseppina Gini

2018 IEEE-RAS 18TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS) (2018)

Article Automation & Control Systems

Mask-VRDet: A robust riverway panoptic perception model based on dual graph fusion of vision and 4D mmWave radar

Runwei Guan, Shanliang Yao, Lulu Liu, Xiaohui Zhu, Ka Lok Man, Yong Yue, Jeremy Smith, Eng Gee, Yutao Yue

Summary: With the development of Unmanned Surface Vehicles (USVs), the perception of inland waterways has become significant. Traditional RGB cameras cannot work effectively in adverse weather and at night, which has led to the emergence of 4D millimeter-wave radar as a new perception sensor. However, the radar suffers from water-surface clutter and irregular shape of point cloud. To address these issues, this paper proposes a high-performance panoptic perception model called Mask-VRDet, which fuses features of vision and radar using graph neural network.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Improving accuracy reconstruction of parts through a capability study: A methodology for X-ray Computed Tomography Robotic Cell

Adrien Le Reun, Kevin Subrin, Anthony Dubois, Sebastien Garnier

Summary: This study aims to evaluate the quality and health of aerospace parts using a high-dimensional robotic cell. By utilizing X-ray Computed Tomography devices, the interior of the parts can be reconstructed and anomalies can be detected. A methodology is proposed to assess both the raw process capability and the improved process capability, with three strategies developed to improve the robot behavior model and calibration.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

An analytical differential kinematics-based method for controlling tendon-driven continuum robots

Weiming Ba, Jung-Che Chang, Jing Liu, Xi Wang, Xin Dong, Dragos Axinte

Summary: This paper proposes a hybrid scheme for kinematic control of continuum robots, which avoids errors through tension supervision and accurate piecewise linear approximation. The effectiveness of the controller is verified on different continuum robotic systems.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Self-supervised prediction of the intention to interact with a service robot

Gabriele Abbate, Alessandro Giusti, Viktor Schmuck, Oya Celiktutan, Antonio Paolillo

Summary: In this study, a learning-based approach is proposed to predict the probability of human users interacting with a robot before the interaction begins. By considering the pose and motion of the user, the approach labels the robot's encounters with humans in a self-supervised manner. The method is validated and deployed in various scenarios, achieving high accuracy in predicting user intentions to interact with the robot.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Depth- and semantics-aware multi-modal domain translation: Generating 3D panoramic color images from LiDAR point clouds

Tiago Cortinhal, Eren Erdal Aksoy

Summary: This work presents a new depth-and semantics-aware conditional generative model, named TITAN-Next, for cross-domain image-to-image translation between LiDAR and camera sensors. The model is able to translate raw LiDAR point clouds to RGB-D camera images by solely relying on semantic scene segments, and it has practical applications in fields like autonomous vehicles.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Overcome the Fear Of Missing Out: Active sensing UAV scanning for precision agriculture

Marios Krestenitis, Emmanuel K. Raptis, Athanasios Ch. Kapoutsis, Konstantinos Ioannidis, Elias B. Kosmatopoulos, Stefanos Vrochidis

Summary: This paper addresses the issue of informative path planning for a UAV used in precision agriculture. By using a non-uniform scanning approach, the time spent in areas with minimal value is reduced, while maintaining high precision in information-dense regions. A novel active sensing and deep learning-based coverage path planning approach is proposed, which adjusts the UAV's speed based on the quantity and confidence level of identified plant classes.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Development and evaluation of fiber reinforced modular soft actuators and an individualized soft rehabilitation glove

Shota Kokubu, Pablo E. Tortos Vinocour, Wenwei Yu

Summary: In this study, a new modular soft actuator was proposed to improve the support performance of soft rehabilitation gloves (SRGs). Objective evaluations and clinical tests were conducted to demonstrate the effectiveness and functionality of the proposed actuator and SRG.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Design and experiment of a variable stiffness prosthetic knee joint using parallel elastic actuation

Jinliang Zhu, Yuanxi Sun, Jie Xiong, Yiyang Liu, Jia Zheng, Long Bai

Summary: This paper proposes an active prosthetic knee joint with a variable stiffness parallel elastic actuation mechanism. Numerical verifications and practical experiments demonstrate that the mechanism can reduce torque and power, thus reducing energy consumption and improving the endurance of the prosthetic knee joint.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Adaptive shift strategy of a novel power-cycling variable transmission for construction vehicles

Yong You, Jingtao Wu, Yunlong Meng, Dongye Sun, Datong Qin

Summary: A new power-cycling variable transmission (PCVT) is proposed and applied to construction vehicles to improve transmission efficiency. A shift correction strategy is developed based on identifying the changes in construction vehicles' mass and gradient. Simulation results show that the proposed method can correct shift points, improve operation efficiency, and ensure a safer operation process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Base position and task assignment optimization concerning productivity and machining performance for multi-robot systems in aerospace manufacturing

Shaorui Liu, Wei Tian, Jianxin Shen, Bo Li, Pengcheng Li

Summary: This paper proposes a two-objective optimization technique for multi-robot systems, addressing the issue of balancing productivity and machining performance in high-quality machining tasks.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Identifying and approaching for obscured stairs

Pengchao Ding, Faben Zhu, Hongbiao Zhu, Gongcheng Wang, Hua Bai, Han Wang, Dongmei Wu, Zhijiang Du, Weidong Wang

Summary: We propose an autonomous approaching scheme for mobile robot traversing obstacle stairwells, which overcomes the restricted field of vision caused by obstacles. The scheme includes stair localization, structural parameter estimation, and optimization of the approaching process.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Comparative analysis of multiple YOLO-based target detectors and trackers for ADAS in edge devices

Pedro Azevedo, Vitor Santos

Summary: Accurate detection and tracking of vulnerable road users and traffic objects are vital tasks for autonomous driving and driving assistance systems. This paper proposes a solution for object detection and tracking in an autonomous driving scenario, comparing different object detectors and exploring the deployment on edge devices. The effectiveness of DeepStream technology and different object trackers is assessed using the KITTI tracking dataset.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)

Article Automation & Control Systems

Shared autonomy and positive power control for powered exoskeletons

Benjamin Beiter, Divya Srinivasan, Alexander Leonessa

Summary: Powered exoskeletons can significantly reduce physical workload and have great potential impact on future labor practices. To truly assist users in achieving task goals, a shared autonomy control framework is proposed to separate the control objectives of the human and exoskeleton. Positive Power control is introduced for the human-based controller, while 'acceptance' is used as a measure of matching the exoskeleton's control objective to the human's. Both control objectives are implemented in an optimization-based Whole-Body-Control structure. The results verify the effectiveness of the control framework and its potential for improving cooperative control for powered exoskeletons.

ROBOTICS AND AUTONOMOUS SYSTEMS (2024)