4.5 Article

On kernel difference-weighted k-nearest neighbor classification

Journal

PATTERN ANALYSIS AND APPLICATIONS
Volume 11, Issue 3-4, Pages 247-257

Publisher

SPRINGER
DOI: 10.1007/s10044-007-0100-z

Keywords

nearest neighbor; distance-weighted KNN; pattern classification; classifier; kernel methods

Funding

  1. HKSAR Government,
  2. Hong Kong Polytechnic University
  3. National Natural Science Foundation of China (NSFC) [60332010]
  4. 863 Project [2006AA01Z308, 2006AA01Z193]

Ask authors/readers for more resources

Nearest neighbor (NN) rule is one of the simplest and the most important methods in pattern recognition. In this paper, we propose a kernel difference-weighted k-nearest neighbor (KDF-KNN) method for pattern classification. The proposed method defines the weighted KNN rule as a constrained optimization problem, and we then propose an efficient solution to compute the weights of different nearest neighbors. Unlike traditional distance-weighted KNN which assigns different weights to the nearest neighbors according to the distance to the unclassified sample, difference-weighted KNN weighs the nearest neighbors by using both the correlation of the differences between the unclassified sample and its nearest neighbors. To take into account the effective nonlinear structure information, we further extend difference-weighted KNN to its kernel version KDF-KNN. Our experimental results indicate that KDF-WKNN is much better than the original KNN and the distance-weighted KNN methods, and is comparable to or better than several state-of-the-art methods in terms of classification accuracy.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Robotics

A Class of Optimal Switching Mixed Data Injection Attack in Cyber-Physical Systems

Sheng Gao, Hao Zhang, Zhuping Wang, Chao Huang

Summary: This study explores an optimal strategy for mixed data injection attacks using input derivatives to disrupt system performance and minimize cost. Additionally, a switching mixed data injection attack strategy is proposed to increase complexity, concealment, and energy efficiency. Numerical results and comparative experiments are provided to demonstrate the effectiveness of the proposed method.

IEEE ROBOTICS AND AUTOMATION LETTERS (2021)

Article Engineering, Electrical & Electronic

Stochastic Event-Based Distributed Fusion Estimation Over Sensor Networks With Fading Channel

Xiaoyuan Zheng, Hao Zhang, Zhuping Wang, Chao Huang, Huaicheng Yan

Summary: This study investigates the problem of stochastic event-based distributed fusion estimation for a class of Gaussian systems, and proposes a two-step fusion estimation method based on stochastic event-triggered mechanisms. By considering channel fading and designing a fusion algorithm, the goal of eliminating discrepancies among local sensor estimations is achieved.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2022)

Article Automation & Control Systems

A GEVP formulation for robust predictor feedback controller design of linear systems with uncertain input delay

Chao Huang, Linlin Zhang, Changzhu Zhang, Hao Zhang

Summary: In this paper, a robust predictor feedback controller design is proposed for enlarging the admissible delay mismatch while maintaining the convergence rate within a prescribed level. The controller synthesis problem is shown to be cast into a generalised eigenvalue problem (GEVP).

INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE (2022)

Article Automation & Control Systems

System Identification Based on Invariant Subspace

Chao Huang, Gang Feng, Hao Zhang, Zhuping Wang

Summary: This article proposes a novel system identification method based on the notion of invariant subspace, with advantages including identifying linear continuous-time models from slowly sampled data, establishing consistency of model parameters, finding global optimum through solving linear least-square problems, and implementing identification algorithms online with explicit convergence rates.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2022)

Article Automation & Control Systems

Asynchronous Output Feedback Control of Hidden Semi-Markov Jump Systems With Random Mode-Dependent Delays

Yongxiao Tian, Huaicheng Yan, Hao Zhang, Jun Cheng, Hao Shen

Summary: This article focuses on the output feedback control problem for continuous-time hidden semi-Markov jump systems with time delays. By establishing emission probabilities relationship, the asynchronous information between controller modes and system modes is better described, and new parameter-dependent stabilization conditions are proposed.

IEEE TRANSACTIONS ON AUTOMATIC CONTROL (2022)

Article Computer Science, Artificial Intelligence

Interval Type-2 Fuzzy Control for HMM-Based Multiagent Systems via Dynamic Event-Triggered Scheme

Yuan Wang, Huaicheng Yan, Hao Zhang, Hao Shen, Hak-Keung Lam

Summary: This article discusses the design problem of interval type-2 Takagi-Sugeno fuzzy asynchronous controller for nonlinear multiagent systems in discrete-time context. It proposes a dynamic event-triggered scheme to mitigate the communication burden. The article utilizes a unique IT2 T-S fuzzy model and a hidden Markov model to handle the asynchronous phenomena and nonlinear characteristics. The effectiveness and practicality of the proposed control scheme are demonstrated through examples.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Aperiodic Sampled-Data Takagi-Sugeno Fuzzy Extended State Observer for a Class of Uncertain Nonlinear Systems With External Disturbance and Unmodeled Dynamics

Zhichen Li, Huaicheng Yan, Hao Zhang, Hak-Keung Lam, Congzhi Huang

Summary: In this article, a sampled-data ESO design approach is proposed for uncertain nonlinear systems. By using fuzzy modeling and Takagi-Sugeno fuzzy formulation, the nonlinear estimating efficiency and linear numerical tractability are integrated in a unified framework. An exponential convergence criterion for TSFESO is presented, and the observer design method is also provided. Numerical examples demonstrate the superiority and effectiveness of the proposed approaches.

IEEE TRANSACTIONS ON FUZZY SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

A temporal fusion transformer for short-term freeway traffic speed multistep prediction

Hao Zhang, Yajie Zou, Xiaoxue Yang, Hang Yang

Summary: This study adopts a novel architecture called TFT to predict freeway speed, which can capture short-term and long-term temporal dependence and improve prediction accuracy by incorporating various types of inputs.

NEUROCOMPUTING (2022)

Article Computer Science, Artificial Intelligence

Data-Based Optimal Consensus Control for Multiagent Systems With Policy Gradient Reinforcement Learning

Xindi Yang, Hao Zhang, Zhuping Wang

Summary: This article introduces a data-based distributed control algorithm to address the consensus control problem in multiagent systems, successfully overcoming the challenges of asynchronous learning. By incorporating an actor-critic structure and neural networks, the algorithm achieves convergence and optimality in both synchronous and asynchronous cases.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Engineering, Electrical & Electronic

Active Disturbance Rejection Formation Tracking Control for Uncertain Nonlinear Multi-Agent Systems With Switching Topology via Dynamic Event-Triggered Extended State Observer

Zhichen Li, Yu Zhao, Huaicheng Yan, Hao Zhang, Lu Zeng, Xiaolei Wang

Summary: This paper investigates the time-varying formation tracking control problem for multi-agent systems (MASs). The main objective is to achieve asymptotic convergence of formation tracking error despite nonparametric and nonvanishing uncertainties. A fuzzy extended state observer (FESO) based on event-triggered mechanism is proposed to estimate unmodeled dynamics and external disturbances. Furthermore, a distributed control law is developed using neighborhood formation tracking errors, and total disturbance compensation is introduced to attenuate uncertainty influence in real time. The effectiveness of the proposed control protocol is demonstrated using a numerical example on unmanned aerial vehicle swarm system.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS (2023)

Article Automation & Control Systems

Compensation-Based Output Feedback Control for Fuzzy Markov Jump Systems With Random Packet Losses

Min Xue, Huaicheng Yan, Hao Zhang, Xisheng Zhan, Kaibo Shi

Summary: This article discusses compensation-based output feedback control for Takagi-Sugeno fuzzy Markov jump systems subject to packet losses. Utilizing single exponential smoothing as a compensation scheme, an asynchronous output feedback controller is designed with stochastic stability and strict dissipativity. Novel sufficient conditions for controller existence based on mode-dependent Lyapunov function are derived, along with an algorithm for determining the optimal smoothing parameter. Simulation results demonstrate the validity and advantages of the design approach.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Automation & Control Systems

Enhanced Reduced-Order Extended State Observer for Motion Control of Differential Driven Mobile Robot

Bo Qin, Huaicheng Yan, Hao Zhang, Yueying Wang, Simon X. Yang

Summary: This paper proposes a control method based on an enhanced reduced-order extended state observer for precise motion control in mobile robot systems. The method reduces energy consumption by estimating unknown state error and negative disturbance and uses a simple state-feedback-feedforward controller to track the reference signal and compensate for negative disturbance.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

Data-Based Predictive Control via Multistep Policy Gradient Reinforcement Learning

Xindi Yang, Hao Zhang, Zhuping Wang, Huaicheng Yan, Changzhu Zhang

Summary: This article presents a model-free predictive control algorithm for real-time systems that improves system performance through data-driven multi-step policy gradient reinforcement learning. By learning from offline and real-time data, the algorithm avoids the need for knowledge of system dynamics in its design and application. Cooperative games are used to model predictive control as multi-agent optimization problems and ensure the optimal predictive control policy. Neural networks are employed to approximate the action-state value function and predictive control policy, with weights determined using weighted residual methods. Numerical results demonstrate the effectiveness of the proposed algorithm.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Automation & Control Systems

Novel Extended State Observer Design for Uncertain Nonlinear Systems via Refined Dynamic Event-Triggered Communication Protocol

Zhichen Li, Huaicheng Yan, Hao Zhang, Simon X. Yang, Mengshen Chen

Summary: This article investigates the design problem of an extended state observer (ESO) for uncertain nonlinear systems subject to limited network bandwidth. A dynamic event-triggered communication protocol is proposed for rational information exchange scheduling, achieving a desirable tradeoff between observation performance and communication resource efficiency. A novel paradigm of event-triggered Takagi-Sugeno fuzzy ESO is introduced, and the TSFESO design approach is derived to carry out exponential convergence for estimation error dynamics under the dynamic event-triggered mechanism. The effectiveness of the proposed method is verified through numerical examples, expanding the application scope of ESO with improved event-triggered strategies.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Computer Science, Artificial Intelligence

Distributed Localization for Multi-Agent Systems With Random Noise Based on Iterative Learning

Yunkai Lv, Hao Zhang, Zhuping Wang, Huaicheng Yan

Summary: This article focuses on the real-time localization problem in dynamic multi-agent systems with measurement and communication noises under directed graphs. It introduces barycentric coordinates to describe the relative position between agents and proposes a novel robust distributed localization estimation algorithm based on iterative learning. The algorithm uses a relative-distance unbiased estimator constructed from historical iterative information to suppress measurement noise, and a designed stochastic approximation method with two iterative-varying gains to inhibit communication noise. The asymptotic convergence of the proposed methods is derived under certain conditions of zero-mean and independent distribution of measurement and communication noises. Numerical simulations and robot experiments are conducted to test and verify the effectiveness and practicability of the proposed methods.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

No Data Available