4.6 Article

Selective ensemble of multiple local model learning for nonlinear and nonstationary systems

期刊

NEUROCOMPUTING
卷 378, 期 -, 页码 98-111

出版社

ELSEVIER
DOI: 10.1016/j.neucom.2019.10.015

关键词

Nonlinear and time-varying system; Online modeling and prediction; Local model learning; Selective ensemble

资金

  1. Chinese Scholarship Council at School of Electronics and Computer Science, University of Southampton, UK
  2. National Natural Science Foundation of China [61771077]
  3. Key Research Program of Chongqing Science & Technology Commission [CSTC2017jcyjBX0025]

向作者/读者索取更多资源

This paper proposes a selective ensemble of multiple local model learning for modeling and identification of nonlinear and nonstationary systems, in which the set of local linear models are self adapted to capture the newly emerging process characteristics and the prediction of the process output is also self adapted based on an optimally selected ensemble of subset linear local models. Specifically, our selective ensemble of multiple local model learning approach performs the model adaptation at two levels. At the level of local model adaptation, a newly emerging process state in the incoming data is automatically identified and a new local linear model is fitted to this newly emerged process state. At the level of online prediction, a subset of candidate local linear models are optimally selected and the prediction of the process output is computed as an optimal linear combiner of the selected subset local linear models. Two case studies involving chaotic time series prediction and modeling of a real-world industrial microwave heating process are used to demonstrate the effectiveness of our proposed approach, in comparison with other existing methods for modeling and identification of nonlinear and time-varying systems. (C) 2019 Published by Elsevier B.V.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Telecommunications

Autoencoder with fitting network for Terahertz wireless communications: A deep learning approach

Zhaohui Huang, Dongxuan He, Jiaxuan Chen, Zhaocheng Wang, Sheng Chen

Summary: This article proposes an improved autoencoder to enhance the robustness of Terahertz wireless communication against hybrid distortions. It encodes and decodes transmitted symbols and utilizes a fitting network to approximate the channel characteristics. Simulation results demonstrate that the proposed method can recover symbols and improve demodulation performance significantly under severe hybrid distortions.

CHINA COMMUNICATIONS (2022)

Article Engineering, Electrical & Electronic

Gaussian Dynamic Convolution for Efficient Single-Image Segmentation

Xin Sun, Changrui Chen, Xiaorui Wang, Junyu Dong, Huiyu Zhou, Sheng Chen

Summary: This study proposes a lightweight neural network approach based on Gaussian dynamic convolution (GDC) for single-image segmentation. The GDC method efficiently aggregates contextual information to achieve superior segmentation results, and demonstrates potential and generality in common semantic segmentation.

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY (2022)

Article Computer Science, Artificial Intelligence

Multi-Output Selective Ensemble Identification of Nonlinear and Nonstationary Industrial Processes

Tong Liu, Sheng Chen, Shan Liang, Shaojun Gan, Chris J. Harris

Summary: This article proposes a multi-output selective ensemble regression (SER) method for online identification of multi-output nonlinear time-varying industrial processes. The method achieves low online computational complexity and high prediction accuracy through adaptive local learning and optimization of the combining weights of the selected local multi-output models based on a probability metric.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022)

Article Automation & Control Systems

Multilabel Distribution Learning Based on Multioutput Regression and Manifold Learning

Chao Tan, Sheng Chen, Genlin Ji, Xin Geng

Summary: This study proposes a multi-label distribution learning algorithm based on multi-output regression and manifold learning, called MDLRML. By utilizing the smooth and similar information provided by manifold learning and label distribution learning, the algorithm links the manifolds in two spaces, enhancing classification accuracy and efficiency.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Computer Science, Artificial Intelligence

A Novel Probabilistic Label Enhancement Algorithm for Multi-Label Distribution Learning

Chao Tan, Sheng Chen, Genlin Ji, Xin Geng

Summary: In this paper, we propose a novel probabilistic label enhancement algorithm (PLEA) to address the label distribution learning problem in multi-label classification. By utilizing manifold learning, we can improve the accuracy of estimated label distributions associated with feature extraction and reduce computational complexity. Experimental results demonstrate the advantages of our proposed method in terms of accuracy and runtime performance.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2022)

Article Engineering, Electrical & Electronic

Simultaneous Multi-Beam Training for Millimeter-Wave Communication System

Yinxiao Zhuo, Ziyuan Sha, Zhaocheng Wang, Sheng Chen

Summary: In this paper, two angular domain separation based multi-beam training schemes were proposed to enable simultaneous training under single data stream constraint, with optimized non-orthogonal codebooks for improved beamforming gains. Simulation results demonstrate the effectiveness and superior performance of the proposed schemes over existing state-of-the-art technologies.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2022)

Article Computer Science, Artificial Intelligence

A label distribution manifold learning algorithm

Chao Tan, Sheng Chen, Xin Geng, Genlin Ji

Summary: In this paper, a novel label distribution manifold learning (LDML) method is proposed for accurately solving the multilabel distribution learning problem. Through manifold learning and multi-output kernel regression, accurate label distributions can be estimated and an enhanced maximum entropy model is formed. Experimental results demonstrate the advantages of the proposed LDML method in terms of learning accuracy.

PATTERN RECOGNITION (2023)

Article Engineering, Electrical & Electronic

Deep Learning Assisted mmWave Beam Prediction for Heterogeneous Networks: A Dual-Band Fusion Approach

Ke Ma, Shouliang Du, Haoming Zou, Wenqiang Tian, Zhaocheng Wang, Sheng Chen

Summary: Motivated by the inter-BS channel dependence, this paper proposes a method to fuse sub-6 GHz channel information and mmWave low-overhead measurement to predict the optimal mmWave beam in HetNets, reducing overhead and achieving high prediction accuracy using deep learning.

IEEE TRANSACTIONS ON COMMUNICATIONS (2023)

Article Engineering, Electrical & Electronic

Multiple-Objective Packet Routing Optimization for Aeronautical Ad-Hoc Networks

Jiankang Zhang, Dong Liu, Sheng Chen, Soon Xin Ng, Robert G. Maunder, Lajos Hanzo

Summary: This article proposes a discrete ε multi-objective genetic algorithm (ε-DMOGA) to optimize the end-to-end latency, end-to-end spectral efficiency (SE), and path expiration time (PET) in aeronautical ad-hoc networks. It incorporates a distance-based adaptive coding and modulation (ACM) scheme and queueing delay into the optimization metric.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2023)

Article Telecommunications

Joint Beamforming Design for Dual-Functional MIMO Radar and Communication Systems Guaranteeing Physical Layer Security

Fuwang Dong, Wei Wang, Xin Li, Fan Liu, Sheng Chen, Lajos Hanzo

Summary: This paper presents an advanced wireless solution based on the dual-functional radar and communication (DFRC) technique, and designs sophisticated beamforming schemes by considering physical layer security (PLS). It is shown that properly designed radar waveforms can serve as artificial noise for eavesdropping prevention and provide increased design degrees of freedom. A non-convex optimization problem is formulated to strike a balance among conflicting objectives, and a semidefinite relaxation (SDR)-based algorithm is proposed to find globally optimal solutions. A robust beamforming method is also developed to handle imperfect channel state information (CSI). Simulation results confirm the theoretical findings and demonstrate the superiority of the proposed methods.

IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING (2023)

Article Computer Science, Artificial Intelligence

A Novel Label Enhancement Algorithm Based on Manifold Learning

Chao Tan, Sheng Chen, Xin Geng, Genlin Ji

Summary: This study presents a label enhancement model to address the multi-label learning problem, improving the ability of label recognition through incremental subspace learning. Experimental results demonstrate its superior predictive performance compared to other methods.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

Weakly-supervised butterfly detection based on saliency map

Ting Zhang, Muhammad Waqas, Yu Fang, Zhaoying Liu, Zahid Halim, Yujian Li, Sheng Chen

Summary: This paper proposes a weakly-supervised butterfly detection model based on a saliency map (WBD-SM) to enhance the accuracy of butterfly detection in the ecological environment. Experimental results show that WBD-SM achieves higher recognition accuracy than VGG16 under different division ratios.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

Physics-Guided Generative Adversarial Networks for Sea Subsurface Temperature Prediction

Yuxin Meng, Eric Rigall, Xueen Chen, Feng Gao, Junyu Dong, Sheng Chen

Summary: This article proposes a framework combining generative adversarial networks (GANs) and numerical models for sea subsurface temperature prediction. By using GANs to learn the simplified physics between surface temperature and target subsurface temperature, and calibrating the parameters with observational data, the framework improves prediction performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Automation & Control Systems

Deep Cascade Gradient RBF Networks With Output-Relevant Feature Extraction and Adaptation for Nonlinear and Nonstationary Processes

Tong Liu, Zeyue Tian, Sheng Chen, Kai Wang, Chris J. Harris

Summary: This article proposes a deep cascade GRBF network for online modeling and prediction of high-dimensional processes with nonstationary characteristics. By integrating feature learning and online adaptation, the proposed method improves prediction accuracy and computational efficiency.

IEEE TRANSACTIONS ON CYBERNETICS (2023)

Article Engineering, Civil

AAKE-BIVT: Anonymous Authenticated Key Exchange Scheme for Blockchain-Enabled Internet of Vehicles in Smart Transportation

Akhtar Badshah, Muhammad Waqas, Fazal Muhammad, Ghulam Abbas, Ziaul Haq Abbas, Shehzad Ashraf Chaudhry, Sheng Chen

Summary: This study proposes an anonymous authenticated key exchange mechanism (AAKE-BIVT) for the smart transportation Internet of Vehicles (IoVs) supported by blockchain. AAKE-BIVT securely transmits traffic information and generates transactions through mutual authentication and key agreement. The study reveals that AAKE-BIVT is resistant to security attacks and outperforms existing techniques in terms of security, functionality, communication, and computation.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)