4.7 Article

Machine-Learning-Driven Digital Twin for Lifecycle Management of Complex Equipment

Journal

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TETC.2022.3143346

Keywords

Complex equipment; digital twin; machine learning; operation and maintenance health management

Funding

  1. Guangdong Province Key Areas Research and Development Program [2019B090919002]
  2. Open Fund of the Aerospace Servo Drive and Transmission Technology Laboratory [LASAT-2021-01]
  3. Natural Science Foundation of Guangdong Province, China [2021A1515011946]

Ask authors/readers for more resources

Embedding machine learning modules into digital twin technology enables responsive, predictable, and adaptable full life cycle management of complex equipment. The application of this approach in maintenance of diesel locomotives successfully alerts abnormal axle temperatures one week in advance. The combination of digital twin and machine learning has great potential for future research directions.
The full life cycle management of complex equipment is considered fundamental to the intelligent transformation and upgrading of the modern manufacturing industry. Digital twin technology and machine learning have been emerging technologies in recent years. The application of these two technologies in the full life cycle management of complex equipment can make each stage of the life cycle more responsive, predictable, and adaptable. This paper first proposes a technical system that embeds machine learning modules into digital twins. Next, on this basis, a full life cycle digital twin for complex equipment is constructed, and joint application of sub-models and machine learning is explored. Then, the application of a combination of the digital twin in maintenance with machine learning in predictive maintenance of diesel locomotives is presented. The effectiveness of the proposed management method is verified by experiments. The abnormal axle temperature can be alarmed about one week in advance. Lastly. possible application advantages of the combination of digital twin and machine learning in addressing future research direction in this field are introduced.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Theory & Methods

Heterogeneous Network Access and Fusion in Smart Factory: A Survey

Dan Xia, Chun Jiang, Jiafu Wan, Jiong Jin, Victor C. M. Leung, Miguel Martinez-Garcia

Summary: This article provides a survey on heterogeneous networks in smart factories, focusing on access control, fusion, and management in the context of expanding IIoT connectivity. It explores the challenges posed by the contradiction between high QoS requirements and limited network bandwidth in smart factory networks, and discusses existing and future network technologies that can address these challenges. Additionally, it analyzes current network fusion architecture and identifies areas for improvement.

ACM COMPUTING SURVEYS (2023)

Article Automation & Control Systems

Layerwise Security Protection for Deep Neural Networks in Industrial Cyber Physical Systems

Wei Jiang, Ziwei Song, Jinyu Zhan, Di Liu, Jiafu Wan

Summary: This article proposes a layerwise protection framework to protect the core IP of deep neural networks (DNNs) against security attacks. The framework utilizes CPU and FPGA coscheduling to improve the execution efficiency of confidentiality protection.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2022)

Article Automation & Control Systems

Dual-Threshold Attention-Guided GAN and Limited Infrared Thermal Images for Rotating Machinery Fault Diagnosis Under Speed Fluctuation

Haidong Shao, Wei Li, Baoping Cai, Jiafu Wan, Yiming Xiao, Shen Yan

Summary: This article proposes a dual-threshold attention-guided GAN (DTAGAN) to generate high-quality infrared thermal (IRT) images to assist fault diagnosis in rotating machinery under speed fluctuation and limited samples. The comparative experiments show that DTAGAN is superior to comparison methods in fault diagnosis of rotor-bearing system under speed fluctuation and limited samples.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Automation & Control Systems

Novel Joint Transfer Network for Unsupervised Bearing Fault Diagnosis From Simulation Domain to Experimental Domain

Yiming Xiao, Haidong Shao, SongYu Han, Zhiqiang Huo, Jiafu Wan

Summary: This article proposes a novel joint transfer network for unsupervised bearing fault diagnosis from the simulation domain to the experimental domain. It uses bearing simulation data to construct the source domain, an improved loss function to achieve alignment across domains, and a weight allocation mechanism to suppress negative transfer.

IEEE-ASME TRANSACTIONS ON MECHATRONICS (2022)

Article Computer Science, Artificial Intelligence

Digital-twin based real-time resource allocation for hull parts picking and processing

Xiangdong Wang, Xiaofeng Hu, Jiafu Wan

Summary: This paper proposes a real-time resource allocation method for hull part smart picking and processing system (SPPS) based on digital twin (DT). Firstly, a multi-agent model of the multi-gantry crane system is established in virtual space to achieve real-time task allocation. Next, a real-time picking and processing scheduling policy is proposed to reduce the idle time of all workstations. Finally, the services available in the DT platform can be applied to optimize the system performance. Experimental results show that the proposed method can effectively improve workstation utilization rate and load balance.

JOURNAL OF INTELLIGENT MANUFACTURING (2022)

Article Computer Science, Interdisciplinary Applications

Hybrid robust convolutional autoencoder for unsupervised anomaly detection of machine tools under noises

Shen Yan, Haidong Shao, Yiming Xiao, Bin Liu, Jiafu Wan

Summary: Anomaly detection of machine tools is crucial in the machinery industry. Deep learning has shown potential in this area, but challenges including the lack of labeled data and noise disturbances still exist. This paper proposes a hybrid robust convolutional autoencoder (HRCAE) to address these challenges and achieves better performance in unsupervised anomaly detection compared to other methods.

ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING (2023)

Article Chemistry, Analytical

A Deep-Learning-Based Collaborative Edge-Cloud Telemedicine System for Retinopathy of Prematurity

Zeliang Luo, Xiaoxuan Ding, Ning Hou, Jiafu Wan

Summary: Retinopathy of prematurity is a visually impairing disease with increasing incidence, making timely diagnosis and treatment significant. To address the lack of timely and effective screening in remote areas, a deep learning-based collaborative edge-cloud telemedicine system is proposed. By combining AI algorithms and a collaborative edge-cloud architecture, the system enables timely screening and diagnosis of retinopathy of prematurity in areas with limited medical resources.

SENSORS (2023)

Article Computer Science, Artificial Intelligence

Automobile Component Recognition Based on Deep Learning Network with Coarse-Fine-Grained Feature Fusion

Tan Jinbiao, Wan Jiafu, Dan Xia

Summary: With the development of artificial intelligence, machine vision technology based on deep learning is an effective way to improve production efficiency. This paper proposes an intelligent component recognition method suitable for small datasets, aiming to explore an automatic system for component recognition suitable for industrial manufacturing environments. The method generates the dataset through an automated system architecture and a feature-based image cropping method, and designs a deep learning network based on coarse-fine-grained feature fusion to generate an intelligent recognition model of components. The designed network achieves an accuracy of 95.11% and outperforms traditional classical networks on multiple datasets.

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Digital Twin Four-Dimension Fusion Modeling Method Design and Application to the Discrete Manufacturing Line

Jieyu Xie, Jiafu Wan

Summary: This paper introduces the key technology of digital twins in intelligent manufacturing and proposes a digital twin four-dimensional fusion modeling method to solve the application problems of digital twin technology in discrete manufacturing. The proposed method can describe the geometric and physical characteristics of a physical entity, map its behavior mechanism, and reveal the control logic and virtual-real mapping rules, providing important support for virtual-real intelligent mutual control.

BIG DATA AND COGNITIVE COMPUTING (2023)

Article Computer Science, Hardware & Architecture

Digital Twin and Artificial Intelligence for Intelligent Planning and Energy-Efficient Deployment of 6G Networks in Smart Factories

Dan Xia, Jianhua Shi, Ke Wan, Jiafu Wan, Miguel Martinez-Garcia, Xin Guan

Summary: This article proposes a DT-based system architecture and a mobile-enhanced edge computing-cloud collaborative mechanism for intelligent planning and deployment of 6G networks, aiming to improve network performance and reduce operational costs.

IEEE WIRELESS COMMUNICATIONS (2023)

Article Automation & Control Systems

Knowledge-graph-based multi-domain model integration method for digital-twin workshops

Xiangdong Wang, Xiaofeng Hu, Zijie Ren, Tianci Tian, Jiafu Wan

Summary: The digital twin workshop is a new workshop operation paradigm that combines virtual and physical space for precise decision-making. However, integrating models from different domains and updating parameters pose challenges. This paper proposes a knowledge graph (KG)-based multi-domain model integration method for digital twin workshops, which includes model elements, ontology, data, semantic integration, and network connection. The efficacy of the proposed method is demonstrated through scenarios in the subassembly workshop for hull construction.

INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY (2023)

Article Computer Science, Artificial Intelligence

A Lightweight and Multisource Information Fusion Method for Real-Time Monitoring of Lump Coal on Mining Conveyor Belts

Ligang Wu, Liang Zhang, Le Chen, Jianhua Shi, Jiafu Wan

Summary: This paper proposes a method based on a lightweight neural network and multisource information fusion for real-time monitoring of lump coal in the process of mining conveyor belt transportation. By performing image preprocessing, optimizing feature extraction, and fusing feature information, effective monitoring of lump coal is achieved.

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Equipment electrocardiogram (EECG): making intelligent production line more robust

Baotong Chen, Lei Wang, Shujun Yu, Jiafu Wan, Xuhui Xia

Summary: The regulation of production efficiency and equipment maintenance in intelligent production lines is a challenging problem. Existing approaches lack dynamic indicators to characterize the operational status and equipment workload. Inspired by human electrocardiogram, the electric drive signal of the equipment is proposed as a measure to monitor equipment performance and workload variations. Deep learning is used to monitor equipment performance, combining EECG features with multi-source heterogeneous data. An EECG-driven synchronous mapping approach is proposed to address workload imbalance and equipment degeneracy. The EECG-based solution is validated on a laboratory-level prototype platform, ensuring robust running of the assembly process in the presence of disturbances.

JOURNAL OF INTELLIGENT MANUFACTURING (2023)

Article Engineering, Industrial

Towards trustworthy rotating machinery fault diagnosis via attention uncertainty in transformer

Yiming Xiao, Haidong Shao, Minjie Feng, Te Han, Jiafu Wan, Bin Liu

Summary: To ensure researchers trust deep diagnostic models, interpretable rotating machinery fault diagnosis (RMFD) research has been developed. However, there is limited work on quantifying uncertainty in results and explaining its sources and composition. This paper proposes a Bayesian variational learning method to introduce uncertainty into the attention weights of Transformer and constructs a probabilistic Bayesian Transformer for trustworthy RMFD. By inferring prior and variational posterior distributions of attention weights, uncertainty is perceived, and an uncertainty quantification and decomposition scheme is developed to achieve confidence characterization of results and separation of epistemic and aleatoric uncertainty. The proposed method is validated in three out-of-distribution generalization scenarios.

JOURNAL OF MANUFACTURING SYSTEMS (2023)

Article Engineering, Biomedical

ROP-GAN: an image synthesis method for retinopathy of prematurity based on generative adversarial network

Ning Hou, Jianhua Shi, Xiaoxuan Ding, Chuan Nie, Cuicui Wang, Jiafu Wan

Summary: In this study, we propose an image synthesis method for retinopathy of prematurity (ROP) based on generative adversarial networks. The method utilizes image segmentation and adversarial autoencoder techniques to generate diverse ROP images. Experimental results demonstrate that the proposed method can generate realistic ROP fundus images.

PHYSICS IN MEDICINE AND BIOLOGY (2023)

No Data Available