4.6 Article

Hybrid control for robot navigation - A hierarchical Q-learning algorithm

Journal

IEEE ROBOTICS & AUTOMATION MAGAZINE
Volume 15, Issue 2, Pages 37-47

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/MRA.2008.921541

Keywords

mobile robot navigation; hybrid control; hierarchical Q-learning; grid-topological map

Ask authors/readers for more resources

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Software Engineering

Two-stage image decomposition and color regulator for low-light image enhancement

Xinyi Yu, Hanxiong Li, Haidong Yang

Summary: This paper proposes an algorithm for low-light image enhancement that addresses the issues of noise and color distortion by integrating denoising and color restoration. Experimental results demonstrate that this method greatly improves the quality of low-light images.

VISUAL COMPUTER (2023)

Article Computer Science, Artificial Intelligence

Fault-Tolerant Stochastic Sampled-Data Fuzzy Control for Nonlinear Delayed Parabolic PDE Systems

Qian-Qian Li, Zi-Peng Wang, Tingwen Huang, Huai-Ning Wu, Han-Xiong Li, Junfei Qiao

Summary: This article addresses fault-tolerant stochastic sampled-data fuzzy control for nonlinear delayed parabolic PDE systems under spatially point measurements. A T-S fuzzy PDE model is used to accurately describe the system. A fault-tolerant SD fuzzy controller with stochastic sampling is designed considering possible actuator failure, and a novel time-dependent Lyapunov functional is constructed to obtain sufficient conditions for the mean square exponential stability of the closed-loop system based on linear matrix inequalities. The effectiveness of the designed approach is illustrated through three examples.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2023)

Article Automation & Control Systems

Spatiotemporal Entropy for Abnormality Detection and Localization of Li-Ion Battery Packs

Peng Wei, Han-Xiong Li

Summary: In this article, a spatiotemporal entropy method is proposed to detect and locate thermal abnormalities of Li-ion battery (LIB) packs. The spatial entropy and temporal entropy are constructed from different scales based on Karhunen-Loeve (KL) decomposition, and then integrated into the comprehensive spatiotemporal entropy. The kernel density estimation is used to derive the detection threshold, and the entropy contribution function is designed for abnormality localization. Experimental results demonstrate the effectiveness of the proposed method in timely detecting and precisely locating abnormal cells at the early stage.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2023)

Article Engineering, Electrical & Electronic

Multiscale Convolution-Based Probabilistic Classification for Detecting Bare PCB Defects

Lei Lei, Han-Xiong Li, Hai-Dong Yang

Summary: This article proposes a multiscale convolution-based detection methodology for classifying defects in bare printed circuit boards (PCBs) under uncertainty. A novel window-based loss function is designed to tackle inter-class imbalance and uncertainty. A multiscale convolution network is constructed to process defects with intra-class variance, and large scale extraction features are fused on the small scale to guide the extraction process. Experimental studies demonstrate that the proposed methodology achieves satisfactory detection performance and visual interpretability compared to baseline methods.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Engineering, Electrical & Electronic

Collaborative Learning Classification Model for PCBs Defect Detection Against Image and Label Uncertainty

Xinyi Yu, Han-Xiong Li, Haidong Yang

Summary: Surface defect detection of printed circuit boards (PCBs) is a critical stage in ensuring product quality. Existing defect detection methods using deep learning models are limited by image uncertainty and label uncertainty. This paper proposes a novel collaborative learning classification model that addresses these difficulties. Results show that the proposed model achieves excellent performance on various quantitative metrics.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Automation & Control Systems

From Online Systems Modeling to Fault Detection for a Class of Unknown High-Dimensional Distributed Parameter Systems

Yun Feng, Yaonan Wang, Qin Wan, Xiaogang Zhang, Bing-Chuan Wang, Han-Xiong Li

Summary: So far, fault detection for distributed parameter systems (DPSs) has been mostly model-based and heavily reliant on prior known model information, limiting their usability in industrial applications. In this article, a brand-new framework is proposed for online systems modeling and fault detection of unknown high-dimensional DPSs. The framework includes an interaction between the two parts, where the systems modeling error is transformed into residual signals for fault detection and the online modeling switches to offline mode based on fault-detection results. The effectiveness of the proposed method is validated through experiments on sensor fault diagnosis for the thermal process of a 2-D battery cell.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2023)

Article Automation & Control Systems

A Spatio-Temporal Inference System for Abnormality Detection and Localization of Battery Systems

Peng Wei, Han-Xiong Li

Summary: In this article, a spatio-temporal inference system is proposed to detect and locate thermal abnormalities of battery systems. The system includes three modules: spatio-temporal processing module, abnormality inference module, and spatial inference module. By analyzing the distributed temperatures on the battery system, the monitoring statistic is developed in the spatio-temporal processing module. The abnormality inference module detects abnormalities based on the derived statistic index. The spatial Bayes model is designed to estimate the abnormality location. The experiments demonstrate that the proposed system can detect and locate internal short circuit faults before they result in thermal runaways.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Automation & Control Systems

Control-Oriented Galerkin-Spectral Model for 3-D Thermal Diffusion of Pouch-Type Batteries

Yu Zhou, Hua Deng, Han-Xiong Li

Summary: This work develops a Galerkin-spectral model for the 3-D thermal diffusion in pouch cells, which is essential for onboard temperature monitoring of lithium-ion batteries in automobile applications. The model is obtained by space decomposition and simplification of the original physical model, and a low-order representation is extracted using spectral expansion. Experimental and simulation studies demonstrate the satisfactory reduced-order performance and practical validity of the proposed model.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Automation & Control Systems

Robust Adaptive Fault-Tolerant Control for a Riser-Vessel System With Input Hysteresis and Time-Varying Output Constraints

Zhijia Zhao, Yiming Liu, Tao Zou, Keum-Shik Hong, Han-Xiong Li

Summary: In this study, a novel adaptive fault-tolerant control strategy is proposed to address the vibration issues in marine risers, ensuring system stability and performance.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

Quantum Language Model With Entanglement Embedding for Question Answering

Yiwei Chen, Yu Pan, Daoyi Dong

Summary: This article proposed a neural network model with an entanglement embedding module for quantum language models. The model explicitly captures the nonclassical correlations within word sequences and achieves superior performance on question answering tasks.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

Confidence-Aware Multiscale Learning for Online Modeling of Distributed Parameter Systems With Application to Curing Process

Xian-Bing Meng, C. L. Philip Chen, Han-Xiong Li

Summary: In industrial applications, the modeling and online applications of distributed parameter systems (DPSs) are difficult due to their infinite dimension, spatiotemporal coupled dynamics, nonlinearity, and model uncertainties. To address these issues, an online spatiotemporal modeling method is proposed based on confidence-aware multiscale learning. The proposed method integrates evolutionary learning-based spatial basis function, efficient broad learning system for temporal dynamics, and Gaussian process regression for spatiotemporal-scale learning to enable online confidence-aware prediction for DPSs. Experiments based on the curing process in snap curing oven demonstrate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS (2023)

Article Automation & Control Systems

Adaptive Fuzzy Fault-Tolerant Control for a Riser-Vessel System With Unknown Backlash

Zhijia Zhao, Yiming Liu, Ge Ma, Keum-Shik Hong, Han-Xiong Li

Summary: In this article, a new adaptive fuzzy fault-tolerant control (FTC) is proposed for a three-dimensional riser-vessel system with unknown backlash nonlinearity. A model for the smooth inverse dynamics of the backlash is introduced and the control input is divided into an expected input and a compensation error. Fuzzy adaptive technology is employed to achieve compensation considering the imprecision of system modeling and unknown external disturbances. The simulation results demonstrate the effectiveness of the derived scheme.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Automation & Control Systems

Adaptive Quantized Control of Flexible Manipulators Subject to Unknown Dead Zones

Zhijia Zhao, Yiming Liu, Sentao Cai, Zhifu Li, Yiwen Wang, Keum-Shik Hong, Han-Xiong Li

Summary: This article proposes an adaptive control method for a flexible manipulator to deal with distributed disturbances, unknown dead zones, and input quantization. The unknown dead zone and input quantization are formulated and represented based on essential transformations. An adaptive robust quantized control with online updating laws is developed to ensure robustness, angle position, and reduce vibration. The Lyapunov theoretical analysis is employed to ensure bounded stability. Numerical simulations and experiments are conducted to verify the feasibility and superiority of the proposed method using a Quanser platform.

IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Computation-Efficient Fault Detection Framework for Partially Known Nonlinear Distributed Parameter Systems

Yun Feng, Yaonan Wang, Yang Mo, Yiming Jiang, Zhijie Liu, Wei He, Han-Xiong Li

Summary: Fault detection for distributed parameter systems (DPSs) generally requires the complete model information to be known. However, it is common that accurate first-principles physical models are difficult to obtain for many industrial applications. Therefore, the applicability of traditional model-based methods is limited. In this study, an adaptive neural network (AdNN) is constructed to estimate the state variable and the unknown nonlinearity for a class of partially known nonlinear DPSs. Experimental results validate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Engineering, Electrical & Electronic

A Dual Adaptation-Based Spatial Model Predictive Control for Nonlinear Distributed Parameter Systems

Yaxin Wang, Han-Xiong Li, Shengli Xie

Summary: In this article, a spatial model predictive control (MPC) approach is proposed for a nonlinear distributed parameter system (DPS). A data-driven modeling method is utilized to predict the system performance, and a dual adaptation approach is developed to capture the most recent dynamics. Theoretical analysis guarantees stability, and simulations/experiments demonstrate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

No Data Available