4.1 Review

A Survey for Machine Learning-Based Control of Continuum Robots

Journal

FRONTIERS IN ROBOTICS AND AI
Volume 8, Issue -, Pages -

Publisher

FRONTIERS MEDIA SA
DOI: 10.3389/frobt.2021.730330

Keywords

continuum robots; data-driven control; inverse kinematics (IK); kinematic; dynamic model-free control; learning-based control; machine learning; reinforcement learning; soft robots

Categories

Funding

  1. Research Grants Council (RGC) of Hong Kong [17206818, 17205919, 17207020, T42-409/18-R]
  2. Innovation and Technology Commission (ITC) [MRP/029/20X, UIM/353]
  3. Multi-Scale Medical Robotics Center Limited [EW01500]

Ask authors/readers for more resources

Soft continuum robots are seen as promising in the field of biomedical robotics due to their inherent compliance for safe interaction with the surroundings. In minimally invasive surgery, soft manipulators face modeling uncertainties, where machine learning algorithms offer a potential solution for control.
Soft continuum robots have been accepted as a promising category of biomedical robots, accredited to the robots' inherent compliance that makes them safely interact with their surroundings. In its application of minimally invasive surgery, such a continuum concept shares the same view of robotization for conventional endoscopy/laparoscopy. Different from rigid-link robots with accurate analytical kinematics/dynamics, soft robots encounter modeling uncertainties due to intrinsic and extrinsic factors, which would deteriorate the model-based control performances. However, the trade-off between flexibility and controllability of soft manipulators may not be readily optimized but would be demanded for specific kinds of modeling approaches. To this end, data-driven modeling strategies making use of machine learning algorithms would be an encouraging way out for the control of soft continuum robots. In this article, we attempt to overview the current state of kinematic/dynamic model-free control schemes for continuum manipulators, particularly by learning-based means, and discuss their similarities and differences. Perspectives and trends in the development of new control methods are also investigated through the review of existing limitations and challenges.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.1
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Automation & Control Systems

Stability and stabilization of periodic piecewise positive systems: A time segmentation approach

Bohao Zhu, James Lam, Xiaoqi Song, Hong Lin, Jason Ying Kuen Chan, Ka-Wai Kwok

Summary: This paper focuses on the stability analysis and stabilization of periodic piecewise positive systems. A time-scheduled copositive Lyapunov function is constructed to establish an equivalent stability condition for periodic piecewise positive systems. The spectral radius characterization of the state transition matrix is proposed based on the asymptotic stability condition, and the relation between the spectral radius and the convergent rate of the system is revealed. An iterative algorithm is developed to stabilize the system by reducing the spectral radius of the state transition matrix. Numerical examples are provided to illustrate the results.

ASIAN JOURNAL OF CONTROL (2023)

Article Engineering, Multidisciplinary

Domain Adaptive Graph Infomax via Conditional Adversarial Networks

Jiaren Xiao, Quanyu Dai, Xiaochen Xie, Qi Dou, Ka-Wai Kwok, James Lam

Summary: In this study, we propose a domain adaptive graph infomax method that computes node representations through neighborhood aggregation and maximizes mutual information between node representations and global summaries to encode global structural information. Conditional adversarial networks are used to reduce the domain discrepancy by aligning the multimodal distributions of node representations. Experimental results on real-world datasets validate the performance of our method in comparison with state-of-the-art baselines.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2023)

Article Robotics

Learning-Based Visual-Strain Fusion for Eye-in-Hand Continuum Robot Pose Estimation and Control

Xiaomei Wang, Jing Dai, Hon-Sing Tong, Kui Wang, Ge Fang, Xiaochen Xie, Yun-Hui Liu, Kwok Wai Samuel Au, Ka-Wai Kwok

Summary: Image processing enhances the practical value of the eye-in-hand camera for quantitative measurement. This article proposes a fusion of visual information and sparse strain data collected from fiber Bragg gratings to improve continuum robot pose estimation. The integration of the proposed F-emp pose estimation method reduces sensing limitations caused by visual obstacles and lighting variations. A hybrid controller combining kinematics and data-driven algorithms achieves fast convergence and high accuracy using the fused pose feedback. The online-learning error compensator significantly improves target tracking performance.

IEEE TRANSACTIONS ON ROBOTICS (2023)

Article Computer Science, Artificial Intelligence

Adversarially regularized graph attention networks for inductive learning on partially labeled graphs

Jiaren Xiao, Quanyu Dai, Xiaochen Xie, James Lam, Ka-Wai Kwok

Summary: The high cost of data labeling results in node label shortage. To address this, a graph-based semi-supervised learning method is proposed, which leverages unlabeled nodes to train together with scarce labeled nodes. An attention-based aggregator is designed to generate node representations by aggregating information from neighboring nodes, and adversarial training is employed to improve robustness and generalization.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Robotics

Flexible Needle Bending Model for Spinal Injection Procedures

Yanzhou Wang, Ka-Wai Kwok, Kevin Cleary, Russell H. Taylor, Iulian Iordachita

Summary: In this study, an in situ needle manipulation technique used for spinal injections is modeled and its effect on needle shape and position is studied. A mechanics-based model is proposed and solved using finite element method. A test setup is presented to mimic the needle manipulation motion. Tissue phantoms made from plastisol and porcine skeletal muscle samples are used to evaluate the model accuracy. The effect of different compression models and model parameters on accuracy is studied, and the impact of needle-tissue interaction on the needle remote center of motion is examined. With the correct combination of compression model and parameters, the model simulation can predict needle tip position with submillimeter accuracy.

IEEE ROBOTICS AND AUTOMATION LETTERS (2023)

Article Mathematics, Applied

Non-fragile PD control of linear time-delay positive discrete-time systems

Jason J. R. Liu, James Lam, Xiaomei Wang, Ka-Wai Kwok

Summary: This paper addresses the challenging problem of designing proportional-derivative (PD) controllers for positive linear systems in the discrete-time domain. The specific focus is on designing a PD controller for a system with constant time delay that ensures both closed-loop stability and positivity preservation. The synthesis process considers the additive gain variation of the controller. The paper presents systematic formulation and tractable algorithms for finding the PD controller gains for positive stabilization, and validates the performance through numerical examples. (c) 2023 Elsevier Inc. All rights reserved.

APPLIED MATHEMATICS AND COMPUTATION (2023)

Article Robotics

A Fast Soft Robotic Laser Sweeping System Using Data-Driven Modeling Approach

Kui Wang, Xiaomei Wang, Justin Di-Lang Ho, Ge Fang, Bohao Zhu, Rongying Xie, Yun-Hui Liu, Kwok Wai Samuel Au, Jason Ying-Kuen Chan, Ka-Wai Kwok

Summary: This article presents a simple, compact two-segment soft robot for flexible laser ablation, capable of omnidirectional bending and precise, fast steering of laser collimator. The proposed soft robot modeling and control scheme based on Koopman operators is validated through experiments, demonstrating its accuracy in laser path following across various contours/patterns.

IEEE TRANSACTIONS ON ROBOTICS (2023)

Article Computer Science, Artificial Intelligence

Positive Consensus of Fractional-Order Multiagent Systems Over Directed Graphs

Jason J. R. Liu, James Lam, Ka-Wai Kwok

Summary: This article investigates the positive consensus problem of a special kind of interconnected positive systems over directed graphs. Based on the results in spectral graph theory, fractional-order systems (FOSs) theory, and positive systems theory, several necessary and/or sufficient conditions on the positive consensus of fractional-order multiagent systems (PCFMAS) are derived. A comprehensive comparison study shows that the proposed approaches have advantages over the existing ones.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Automation & Control Systems

Stability Analysis of Discrete-Time Cone-Preserving Systems With Time-Varying Delays

Bohao Zhu, James Lam, Xiujuan Lu, Ka-Wai Kwok

Summary: This letter investigates stability issues related to linear discrete-time cone-preserving systems with time-varying delays. The study examines the monotonicity of discrete-time systems with cone invariance and provides equivalent asymptotic stability conditions for discrete-time cone-preserving systems with time-varying delays based on the monotonicity of cone-preserving systems and the comparison principle. The results indicate that time delays do not affect asymptotic stability and also analyze the alpha-exponential stability to characterize the decay rate of the system. A numerical example is presented to illustrate the theoretical findings. These results contribute to the understanding of stability analysis of cone-preserving systems with time-varying delays.

IEEE CONTROL SYSTEMS LETTERS (2023)

Article Automation & Control Systems

A Tensegrity Joint for Low-Inertia, Compact, and Compliant Soft Manipulators

Yifeng Hao, Xiaomei Wang, Xiaoqi Song, Yingqi Li, Henry Fu, Alex Pui-Wai Lee, Kenneth Man-Chee Cheung, James Lam, Ka-Wai Kwok

Summary: Compact, low-inertia, and soft compliant robotic joint mechanisms are needed for safe interactions in human-robot collaborative tasks. Tensegrity joint, constrained by tension, provides mechanical stability without static/sliding friction. However, it is susceptible to actuation errors and requires complex kinematics modeling and sophisticated control. A low-inertia tensegrity joint covered with a FBG-embedded silicone sheath is proposed to enhance joint motion stability and enable self-contained sensing feedback.

ADVANCED INTELLIGENT SYSTEMS (2023)

Article Automation & Control Systems

Intelligent Shape Decoding of a Soft Optical Waveguide Sensor

Chi-Hin Mak, Yingqi Li, Kui Wang, Mengjie Wu, Justin Di-Lang Ho, Qi Dou, Kam-Yim Sze, Kaspar Althoefer, Ka-Wai Kwok

Summary: Optical waveguides offer flexible, quick, and compact options for soft sensing and electronic skins. By measuring and converting light intensities inside the waveguide, useful feedback such as strain or shape sensing can be obtained. Compared to other methods, optical waveguides offer greater scalability with fewer sensing nodes and less wiring.

ADVANCED INTELLIGENT SYSTEMS (2023)

Proceedings Paper Medicine, Research & Experimental

In Situ Flexible Needle Adjustment Towards MRI-Guided Spinal Injections Based on Finite Element Simulation

Yanzhou Wang, Yangsheng Xu, Ka-Wai Kwok, Iulian Iordachita

Summary: This paper investigates the possibility of using robotic manipulations to correct the needle tip position in robot-assisted, MRI-guided spinal injections, where real time MRI images cannot be effectively used to guide the needle. The open-loop control of the needle tip is derived from finite element simulation, and the proposed method is tested with ex vivo animal muscle tissues and validated using cone beam computed tomography. Preliminary results show promise for in situ needle tip correction to improve needle insertion accuracy when real-time feedback is not readily available.

2023 INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS, ISMR (2023)

Article Automation & Control Systems

Automatic Multiparametric Magnetic Resonance Imaging-Based Prostate Lesions Assessment with Unsupervised Domain Adaptation

Jing Dai, Xiaomei Wang, Yingqi Li, Zhiyu Liu, Yui-Lun Ng, Jiaren Xiao, Joe King Man Fan, James Lam, Qi Dou, Varut Vardhanabhuti, Ka-Wai Kwok

Summary: In this study, a coarse mask-guided deep domain adaptation network (CMD(2)A-Net) is proposed for automated prostate lesion detection and classification. The experiments demonstrate that CMD(2)A-Net performs well on multiple datasets and achieves better results in benign and malignant lesion classification compared to existing models.

ADVANCED INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Decentralized H2 Control for Discrete-Time Networked Systems With Positivity Constraint

Jason J. R. Liu, Ka-Wai Kwok, James Lam

Summary: In this paper, we study the decentralized H2 state-feedback control problem for networked discrete-time systems with positivity constraint. We propose necessary and sufficient synthesis conditions for networked positive systems, unlike most previous works that only provide sufficient conditions for a single positive system. We develop a primal-dual iterative algorithm based on these conditions to solve the problem and avoid converging to a local minimum. Two illustrative examples are used to verify our proposed results.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

No Data Available