Attention mechanism in intelligent fault diagnosis of machinery: A review of technique and application

Transformers in Vision: A Survey

(2022) Salman Khan et al.   ACM COMPUTING SURVEYS

Bearing fault diagnosis method based on multi head graph attention network

(2022) Li Jiang et al.   MEASUREMENT SCIENCE and TECHNOLOGY

A digital twin auxiliary approach based on adaptive sparse attention network for diesel engine fault diagnosis

(2022) Jiajie Jiang et al.   Scientific Reports

Prognostics Analysis of Rolling Bearing Based on Bi-Directional LSTM and Attention Mechanism

(2022) Maan Singh Rathore et al.   Journal of Failure Analysis and Prevention

A grouping-attention convolutional neural network for performance degradation estimation of high-speed train lateral damper

(2022) Junxiao Ren et al.   APPLIED INTELLIGENCE

Intelligent fault diagnosis of rolling bearings under varying operating conditions based on domain-adversarial neural network and attention mechanism

(2022) Hao Wu et al.   ISA TRANSACTIONS

Multi-scale attention mechanism residual neural network for fault diagnosis of rolling bearings

(2022) Yan Wang et al.   PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE

Joint attention feature transfer network for gearbox fault diagnosis with imbalanced data

(2022) Biao Li et al.   MECHANICAL SYSTEMS AND SIGNAL PROCESSING

Intelligent fault diagnosis of machines with small & imbalanced data: A state-of-the-art review and possible extensions

(2021) Tianci Zhang et al.   ISA TRANSACTIONS

Feature Space Transformation for Fault Diagnosis of Rotating Machinery under Different Working Conditions

(2021) Gye-Bong Jang et al.   SENSORS

Early Fault Detection Method of Rolling Bearing Based on MCNN and GRU Network with an Attention Mechanism

(2021) Xiaochen Zhang et al.   SHOCK AND VIBRATION

A double-layer attention based adversarial network for partial transfer learning in machinery fault diagnosis

(2021) Yafei Deng et al.   COMPUTERS IN INDUSTRY

A BiGRU Autoencoder Remaining Useful Life Prediction Scheme With Attention Mechanism and Skip Connection

(2021) Yuhang Duan et al.   IEEE SENSORS JOURNAL

Extracting spatially global and local attentive features for rolling bearing fault diagnosis in electrical machines using attention stream networks

(2021) Yannis L. Karnavas et al.   IET Electric Power Applications

Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis

(2021) Yong Feng et al.   ISA TRANSACTIONS

Deep multi-scale adversarial network with attention: A novel domain adaptation method for intelligent fault diagnosis

(2021) Bo Zhao et al.   JOURNAL OF MANUFACTURING SYSTEMS

AKSNet: A novel convolutional neural network with adaptive kernel width and sparse regularization for machinery fault diagnosis

(2021) Zhuang Ye et al.   JOURNAL OF MANUFACTURING SYSTEMS

LSTM-based multi-layer self-attention method for remaining useful life estimation of mechanical systems

(2021) Jun Xia et al.   ENGINEERING FAILURE ANALYSIS

Hierarchical segment-channel attention network for explainable multichannel signal classification

(2021) Jiyoon Lee et al.   INFORMATION SCIENCES

Temporal convolutional network with soft thresholding and attention mechanism for machinery prognostics

(2021) Yiwei Wang et al.   JOURNAL OF MANUFACTURING SYSTEMS

A deep attention residual neural network-based remaining useful life prediction of machinery

(2021) Fuchuan Zeng et al.   MEASUREMENT

Frequency Hoyer attention based convolutional neural network for remaining useful life prediction of machinery

(2021) Xin Huang et al.   MEASUREMENT SCIENCE and TECHNOLOGY

Attention-Based Sequence to Sequence Model for Machine Remaining Useful Life Prediction

(2021) Mohamed Ragab et al.   NEUROCOMPUTING

A fault diagnosis method based on attention mechanism with application in Qianlong-2 autonomous underwater vehicle

(2021) Shaoxuan Xia et al.   OCEAN ENGINEERING

An end-to-end framework for remaining useful life prediction of rolling bearing based on feature pre-extraction mechanism and deep adaptive transformer model

(2021) Xuanyuan Su et al.   COMPUTERS & INDUSTRIAL ENGINEERING

MSWR-LRCN: A new deep learning approach to remaining useful life estimation of bearings

(2021) Yongyi Chen et al.   CONTROL ENGINEERING PRACTICE

Deep multi-scale separable convolutional network with triple attention mechanism: A novel multi-task domain adaptation method for intelligent fault diagnosis

(2021) Bo Zhao et al.   EXPERT SYSTEMS WITH APPLICATIONS

Dual-Attention Generative Adversarial Networks for Fault Diagnosis Under the Class-Imbalanced Conditions

(2021) Rugen Wang et al.   IEEE SENSORS JOURNAL

Structural Rotor Fault Diagnosis Using Attention-Based Sensor Fusion and Transformers

(2021) Aneesh G. Nath et al.   IEEE SENSORS JOURNAL

Attention-guided joint learning CNN with noise robustness for bearing fault diagnosis and vibration signal denoising

(2021) Huan Wang et al.   ISA TRANSACTIONS

Bearing fault diagnosis method based on attention mechanism and multilayer fusion network

(2021) Xiaohu Li et al.   ISA TRANSACTIONS

End to end multi-task learning with attention for multi-objective fault diagnosis under small sample

(2021) Zongliang Xie et al.   JOURNAL OF MANUFACTURING SYSTEMS

Machinery Fault Diagnosis Based on Deep Learning for Time Series Analysis and Knowledge Graphs

(2021) Haiying Liu et al.   Journal of Signal Processing Systems for Signal Image and Video Technology

A new data generation approach with modified Wasserstein auto-encoder for rotating machinery fault diagnosis with limited fault data

(2021) Ke Zhao et al.   KNOWLEDGE-BASED SYSTEMS

An adaptive anti-noise network with recursive attention mechanism for gear fault diagnosis in real-industrial noise environment condition

(2021) Yong Yao et al.   MEASUREMENT

Fault diagnosis based on SPBO-SDAE and transformer neural network for rotating machinery

(2021) Xianjun Du et al.   MEASUREMENT

Fault diagnosis for small samples based on attention mechanism

(2021) Xin Zhang et al.   MEASUREMENT

Intelligent fault diagnosis of rolling bearings under imbalanced data conditions using attention-based deep learning method

(2021) Jun Li et al.   MEASUREMENT

A novel remaining useful life prediction method based on gated attention mechanism capsule neural network

(2021) Chengying Zhao et al.   MEASUREMENT

Planetary gearbox fault diagnosis using bidirectional-convolutional LSTM networks

(2021) Junchuan Shi et al.   MECHANICAL SYSTEMS AND SIGNAL PROCESSING

A novel temporal convolutional network with residual self-attention mechanism for remaining useful life prediction of rolling bearings

(2021) Yudong Cao et al.   RELIABILITY ENGINEERING & SYSTEM SAFETY

A novel multi-scale convolution model based on multi-dilation rates and multi-attention mechanism for mechanical fault diagnosis

(2021) Caiyuan Chu et al.   DIGITAL SIGNAL PROCESSING

Graph Cardinality Preserved Attention Network for Fault Diagnosis of Induction Motor Under Varying Speed and Load Condition

(2021) Yao Tang et al.   IEEE Transactions on Industrial Informatics

CFs-focused intelligent diagnosis scheme via alternative kernels networks with soft squeeze-and-excitation attention for fast-precise fault detection under slow & sharp speed variations

(2021) Yuanhong Chang et al.   KNOWLEDGE-BASED SYSTEMS

A novel time–frequency Transformer based on self–attention mechanism and its application in fault diagnosis of rolling bearings

(2021) Yifei Ding et al.   MECHANICAL SYSTEMS AND SIGNAL PROCESSING

Fan Fault Diagnosis Based on Lightweight Multiscale Multiattention Feature Fusion Network

(2021) Zhixia Fan et al.   IEEE Transactions on Industrial Informatics

Feature-Level Attention-Guided Multitask CNN for Fault Diagnosis and Working Conditions Identification of Rolling Bearing

(2021) Huan Wang et al.   IEEE Transactions on Neural Networks and Learning Systems

Intelligent fault identification for industrial automation system via multi-scale convolutional generative adversarial network with partially labeled samples

(2020) Tongyang Pan et al.   ISA TRANSACTIONS

Fault diagnosis of reciprocating compressor based on group self-attention network

(2020) Ganchao Bao et al.   MEASUREMENT SCIENCE and TECHNOLOGY

Learning Attention Representation with a Multi-Scale CNN for Gear Fault Diagnosis under Different Working Conditions

(2020) Yong Yao et al.   SENSORS

A Compact Convolutional Neural Network Augmented with Multiscale Feature Extraction of Acquired Monitoring Data for Mechanical Intelligent Fault Diagnosis

(2020) Kaiyu Zhang et al.   JOURNAL OF MANUFACTURING SYSTEMS

Quantum recurrent encoder–decoder neural network for performance trend prediction of rotating machinery

(2020) Yong Chen et al.   KNOWLEDGE-BASED SYSTEMS

Intelligent Prognostics of Machining Tools Based on Adaptive Variational Mode Decomposition and Deep Learning Method with Attention Mechanism

(2020) Chongdang Liu et al.   NEUROCOMPUTING

Interpreting network knowledge with attention mechanism for bearing fault diagnosis

(2020) Zhi-bo Yang et al.   APPLIED SOFT COMPUTING

Industrial Remaining Useful Life Prediction by Partial Observation Using Deep Learning With Supervised Attention

(2020) Xiang Li et al.   IEEE-ASME TRANSACTIONS ON MECHATRONICS

Actual bearing compound fault diagnosis based on active learning and decoupling attentional residual network

(2020) Yanrui Jin et al.   MEASUREMENT

Fault detection and identification of rolling element bearings with Attentive Dense CNN

(2020) Spyridon Plakias et al.   NEUROCOMPUTING

Multiple degradation mode analysis via gated recurrent unit mode recognizer and life predictors for complex equipment

(2020) Qinyuan Luo et al.   COMPUTERS IN INDUSTRY

A novel transfer diagnosis method under unbalanced sample based on discrete-peak joint attention enhancement mechanism

(2020) Kun Xu et al.   KNOWLEDGE-BASED SYSTEMS

Motor fault diagnosis using attention mechanism and improved adaboost driven by multi-sensor information

(2020) Zhuo Long et al.   MEASUREMENT

LOSGAN: Latent Optimized Stable GAN for intelligent fault diagnosis with limited data in rotating machinery

(2020) Shen Liu et al.   MEASUREMENT SCIENCE and TECHNOLOGY

Machine Remaining Useful Life Prediction via an Attention-Based Deep Learning Approach

(2020) Zhenghua Chen et al.   IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS

SDA: Regularization with Cut-Flip and Mix-Normal for machinery fault diagnosis under small dataset

(2020) Haixin Lv et al.   ISA TRANSACTIONS

Fault diagnosis of rolling bearings using an Improved Multi-Scale Convolutional Neural Network with Feature Attention mechanism

(2020) Zifei Xu et al.   ISA TRANSACTIONS

Multiscale Convolutional Attention Network for Predicting Remaining Useful Life of Machinery

(2020) Biao Wang et al.   IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS

Gated Dual Attention Unit Neural Networks for Remaining Useful Life Prediction of Rolling Bearings

(2020) Yi Qin et al.   IEEE Transactions on Industrial Informatics

DeepHealth: A Self-Attention Based Method for Instant Intelligent Predictive Maintenance in Industrial Internet of Things

(2020) Weiting Zhang et al.   IEEE Transactions on Industrial Informatics

Attention in Natural Language Processing

(2020) Andrea Galassi et al.   IEEE Transactions on Neural Networks and Learning Systems

CCNet: Criss-Cross Attention for Semantic Segmentation

(2020) Zilong Huang et al.   IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

Understanding and Improving Deep Learning-Based Rolling Bearing Fault Diagnosis with Attention Mechanism

(2019) Xiang Li et al.   SIGNAL PROCESSING

A Review of Early Fault Diagnosis Approaches and Their Applications in Rotating Machinery

(2019) Wei et al.   Entropy

Planetary gear fault diagnosis using stacked denoising autoencoder and gated recurrent unit neural network under noisy environment and time-varying rotational speed conditions

(2019) Jun Yu et al.   MEASUREMENT SCIENCE and TECHNOLOGY

Bidirectional LSTM with attention mechanism and convolutional layer for text classification

(2019) Gang Liu et al.   NEUROCOMPUTING

A novel data-temporal attention network based strategy for fault diagnosis of chiller sensors

(2019) Ding Li et al.   ENERGY AND BUILDINGS

CarNet: A Dual Correlation Method for Health Perception of Rotating Machinery

(2019) Weiting Zhang et al.   IEEE SENSORS JOURNAL

An Attention-augmented Deep Architecture for Hard Drive Status Monitoring in Large-scale Storage Systems

(2019) Ji Wang et al.   ACM Transactions on Storage

Bearing Fault Diagnosis Based on Shallow Multi-Scale Convolutional Neural Network with Attention

(2019) Tengda Huang et al.   Energies

A recurrent neural network approach for remaining useful life prediction utilizing a novel trend features construction method

(2019) Sen Zhao et al.   MEASUREMENT

A two-stage attention aware method for train bearing shed oil inspection based on convolutional neural networks

(2019) Xiao Fu et al.   NEUROCOMPUTING

A novel deep learning method based on attention mechanism for bearing remaining useful life prediction

(2019) Yuanhang Chen et al.   APPLIED SOFT COMPUTING

Time Series Multiple Channel Convolutional Neural Network with Attention-Based Long Short-Term Memory for Predicting Bearing Remaining Useful Life

(2019) Jehn-Ruey Jiang et al.   SENSORS

A New Intelligent Bearing Fault Diagnosis Method Using SDP Representation and SE-CNN

(2019) Hui Wang et al.   IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT

Squeeze-and-Excitation Networks

(2019) Jie Hu et al.   IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

Understanding and Learning Discriminant Features based on Multiattention 1DCNN for Wheelset Bearing Fault Diagnosis

(2019) Huan Wang et al.   IEEE Transactions on Industrial Informatics

Macroscopic–Microscopic Attention in LSTM Networks Based on Fusion Features for Gear Remaining Life Prediction

(2019) Yi Qin et al.   IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS

Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks

(2018) Rui Zhao et al.   IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS

Artificial intelligence for fault diagnosis of rotating machinery: A review

(2018) Ruonan Liu et al.   MECHANICAL SYSTEMS AND SIGNAL PROCESSING

Remaining useful life estimation of engineered systems using vanilla LSTM neural networks

(2018) Yuting Wu et al.   NEUROCOMPUTING

Roller bearing fault diagnosis using stacked denoising autoencoder in deep learning and Gath–Geva clustering algorithm without principal component analysis and data label

(2018) Fan Xu et al.   APPLIED SOFT COMPUTING

A survey on Deep Learning based bearing fault diagnosis

(2018) Duy-Tang Hoang et al.   NEUROCOMPUTING

Batch-normalized deep neural networks for achieving fast intelligent fault diagnosis of machines

(2018) Jinrui Wang et al.   NEUROCOMPUTING

Learning from class-imbalanced data: Review of methods and applications

(2017) Guo Haixiang et al.   EXPERT SYSTEMS WITH APPLICATIONS

A recurrent neural network based health indicator for remaining useful life prediction of bearings

(2017) Liang Guo et al.   NEUROCOMPUTING

Domain Adaptation via Transfer Component Analysis

(2010) Sinno Jialin Pan et al.   IEEE TRANSACTIONS ON NEURAL NETWORKS

PROMETHEE: A comprehensive literature review on methodologies and applications

(2009) Majid Behzadian et al.   EUROPEAN JOURNAL OF OPERATIONAL RESEARCH