4.6 Review

A tutorial review of neural network modeling approaches for model predictive control

Journal

COMPUTERS & CHEMICAL ENGINEERING
Volume 165, Issue -, Pages -

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.compchemeng.2022.107956

Keywords

Time-series forecasting; Feed-forward neural networks; Recurrent neural networks; Encoder-decoder architecture; Model predictive control; Nonlinear systems; Chemical processes

Ask authors/readers for more resources

This article presents an overview of recent developments in time-series neural network modeling and its use in model predictive control (MPC). A tutorial on constructing a neural network-based model is provided, along with discussion on key implementation issues. A nonlinear process example is introduced to demonstrate different neural network-based modeling approaches and evaluate their performance. Finally, future research directions on neural network modeling and its integration with MPC are briefly discussed.
An overview of the recent developments of time-series neural network modeling is presented along with its use in model predictive control (MPC). A tutorial on the construction of a neural network-based model is provided and key practical implementation issues are discussed. A nonlinear process example is introduced to demonstrate the application of different neural network-based modeling approaches and evaluate their performance in terms of closed-loop stability and prediction accuracy. Finally, the paper concludes with a brief discussion of future research directions on neural network modeling and its integration with MPC.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Chemical

Microscopic and data-driven modeling and operation of thermal atomic layer etching of aluminum oxide thin films

Sungil Yun, Matthew Tom, Junwei Luo, Gerassimos Orkoulas, Panagiotis D. Christofides

Summary: With increasing demands for microchips and the nano-scale semiconductor manufacturing industry, atomic layer etching (ALE) has become a critical etching process. This work develops microscopic models to characterize the thermal ALE process of aluminum oxide thin films with two precursors, setting the foundation for real-time, model-based operational parameter calculations.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2022)

Article Engineering, Chemical

Physics-informed machine learning modeling for predictive control using noisy data

Mohammed S. Alhajeri, Fahim Abdullah, Zhe Wu, Panagiotis D. Christofides

Summary: This work investigates the impact of Gaussian and non-Gaussian noise on the performance of partially-connected recurrent neural network models used for modeling chemical processes. Two techniques, Monte Carlo dropout and co-teaching, are employed to reduce overfitting and improve model accuracy and controller performance.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2022)

Article Engineering, Chemical

On generalization error of neural network models and its application to predictive control of nonlinear processes

Mohammed S. Alhajeri, Aisha Alnajdi, Fahim Abdullah, Panagiotis D. Christofides

Summary: To approximate nonlinear dynamic systems using time-series data, recurrent neural networks (RNNs) and long short-term memory (LSTM) networks are often used. Incorporating prior knowledge in machine learning-based models can further improve accuracy. This study develops a methodological framework to quantify the generalization error bounds for partially-connected RNNs and LSTM models. The proposed approach shows improved performance in predictive control systems compared to traditional approaches under Lyapunov-based MPC.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2023)

Article Engineering, Chemical

Modeling and Control of Nonlinear Processes Using Sparse Identification: Using Dropout to Handle Noisy Data

Fahim Abdullah, Mohammed S. Alhajeri, Panagiotis D. Christofides

Summary: SINDy is a nonlinear modeling technique that shows superior performance in handling time-series data but requires careful consideration of noise. In this study, SINDy is combined with ensemble learning to identify multiple models for improving overall nonlinear model performance.

INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH (2022)

Article Engineering, Chemical

Encrypted model predictive control design for security to cyberattacks

Atharva Suryavanshi, Aisha Alnajdi, Mohammed Alhajeri, Fahim Abdullah, Panagiotis D. Christofides

Summary: In this work, secure and private communication links are established between sensor-controller and controller-actuator elements using semi-homomorphic encryption to ensure cyber-security in model predictive control (MPC) of nonlinear systems. The Paillier cryptosystem is implemented for encryption-decryption operations in the communication links. The closed-loop encrypted MPC is designed with a certain degree of robustness to the quantization errors in nonlinear systems, and the trade-off between accuracy and computational cost is discussed. Chemical process examples are employed to demonstrate the implementation of the proposed encrypted MPC design.

AICHE JOURNAL (2023)

Article Engineering, Chemical

Machine learning-based ethylene and carbon monoxide estimation, real-time optimization, and multivariable feedback control of an experimental electrochemical reactor

Berkay Citmaci, Junwei Luo, Joon Baek Jang, Carlos G. Morales-Guio, Panagiotis D. Christofides

Summary: The electrochemical reduction of CO2 gas is a new technique for mitigating the global climate crisis and storing energy from renewable sources. However, there is a lack of explicit models for CO2 reduction and limited effort in developing process modeling and control of CO2 electrochemical reactors. This study focuses on developing a control scheme for a rotating cylinder electrode (RCE) reactor using artificial and recurrent neural network modeling, nonlinear optimization, and process controller design. The experimental results demonstrate the effectiveness of the control system in regulating the production rates of ethylene and carbon monoxide.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2023)

Article Computer Science, Interdisciplinary Applications

Data-based modeling and control of nonlinear process systems using sparse identification: An overview of recent results

Fahim Abdullah, Panagiotis D. Christofides

Summary: This paper discusses recent developments in the data-based modeling and control of nonlinear chemical process systems using sparse identification of nonlinear dynamics (SINDy). Challenges of handling time-scale multiplicities and noisy sensor data when using SINDy are addressed, and novel methods devised to overcome these challenges are described. Modeling guidelines for using the proposed techniques for process systems are provided.

COMPUTERS & CHEMICAL ENGINEERING (2023)

Article Engineering, Chemical

Real-time adaptive sparse-identification-based predictive control of nonlinear processes

Fahim Abdullah, Panagiotis D. Christofides

Summary: This study presents a sparse identification-based model predictive control framework that incorporates online updates of the sparse-identified model to consider nonlinear dynamics and model uncertainty in process systems. The method involves obtaining a nonlinear first-order ordinary differential equation model using sparse identification for nonlinear dynamics (SINDy), which is integrated into Lyapunov-based MPC (LMPC) and Lyapunov-based economic MPC (LEMPC) for steady-state operation and optimal economic performance. An online model update scheme is proposed to improve prediction accuracy, utilizing prediction errors and process data. The proposed methodology is demonstrated to enhance dynamic performance and ensure closed-loop stability and optimality in a chemical process example.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2023)

Article Engineering, Chemical

Encrypted Model Predictive Control of a Nonlinear Chemical Process Network

Yash A. Kadakia, Atharva Suryavanshi, Aisha Alnajdi, Fahim Abdullah, Panagiotis D. Christofides

Summary: This work focuses on developing and applying Encrypted Lyapunov-based Model Predictive Control (LMPC) in a nonlinear chemical process network for Ethylbenzene production. The Paillier cryptosystem is employed for encryption-decryption operations in the communication channels between the sensor-controller and controller-actuator to enhance system cybersecurity. The impact of quantization parameter on the performance of the controller and the overall encryption to control input calculation time is examined through closed-loop simulations under the encrypted LMPC scheme.

PROCESSES (2023)

Article Mathematics

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

Aisha Alnajdi, Fahim Abdullah, Atharva Suryavanshi, Panagiotis D. Christofides

Summary: In this study, a general form of nonlinear two-time-scale systems is presented and machine learning techniques are used to approximate the dynamics of both subsystems. A Lyapunov-based model predictive control scheme is designed, and conditions for closed-loop stability are derived. The theory is validated with a nonlinear chemical process example.

MATHEMATICS (2023)

Article Engineering, Chemical

Encrypted distributed model predictive control with state estimation for nonlinear processes

Yash A. Kadakia, Aisha Alnajdi, Fahim Abdullah, Panagiotis D. Christofides

Summary: This research focuses on encrypted distributed control architectures to improve the operational safety, cybersecurity, and computational efficiency of large-scale nonlinear systems. The study demonstrates the effectiveness of using encrypted DMPC with state estimation in scenarios where only partial state measurements are available.

DIGITAL CHEMICAL ENGINEERING (2023)

Article Engineering, Chemical

Encrypted decentralized model predictive control of nonlinear processes with delays

Yash A. Kadakia, Aisha Alnajdi, Fahim Abdullah, Panagiotis D. Christofides

Summary: This work aims to enhance the operational safety, cybersecurity, computational efficiency, and closed-loop performance of large-scale nonlinear time-delay systems by employing a decentralized model predictive controller with encrypted networked communication. The nonlinear process is partitioned into multiple subsystems, each controlled by a distinct Lyapunov-based MPC. Predictors are integrated to handle input and state delays, while encryption is used to enhance cybersecurity.

CHEMICAL ENGINEERING RESEARCH & DESIGN (2023)

Article Computer Science, Interdisciplinary Applications

Integrating machine learning detection and encrypted control for enhanced cybersecurity of nonlinear processes

Yash A. Kadakia, Atharva Suryavanshi, Aisha Alnajdi, Fahim Abdullah, Panagiotis D. Christofides

Summary: This study presents an encrypted two-tier control architecture integrated with a machine learning-based cyberattack detector to enhance the safety, security, and performance of nonlinear processes. The upper tier utilizes an encrypted nonlinear model predictive controller to improve performance, while the lower tier uses an encrypted set of linear controllers for stabilization. To mitigate the risk of cyberattacks, a machine learning-based detector is developed to identify attacks and switch to the secure lower tier. The study includes a comprehensive stability analysis and provides practical implementation guidelines.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Engineering, Chemical

Machine learning-based predictive control of nonlinear time-delay systems: Closed-loop stability and input delay compensation

Aisha Alnajdi, Atharva Suryavanshi, Mohammed S. Alhajeri, Fahim Abdullah, Panagiotis D. Christofides

Summary: The purpose of this work is to study machine-learning-based model predictive control of nonlinear systems with time-delays. The proposed approach involves initially building a machine learning model (i.e., Long Short Term Memory (LSTM)) to capture the process dynamics in the absence of time delays. Then, an LSTM-based model predictive controller (MPC) is designed to stabilize the nonlinear system without time delays. Closed-loop stability results are then presented, establishing robustness of this LSTM-based MPC towards small time-delays in the states. To handle input delays, we design an LSTM-based MPC with an LSTM-based predictor that compensates for the effect of input delays. The predictor is used to predict future states using the process measurement, and then the predicted states are used to initialize the LSTM-based MPC. Stabilization of the time-delay system with both state and input delays around the steady state is achieved through the featured design. The approach is applied to a chemical process example, and its performance and robustness properties are evaluated via simulations.

DIGITAL CHEMICAL ENGINEERING (2023)

Article Computer Science, Interdisciplinary Applications

Discovering governing partial differential equations from noisy data

Nohan Joemon, Melpakkam Pradeep, Lokesh K. Rajulapati, Raghunathan Rengaswamy

Summary: This paper introduces a smoothing-based approach for discovering partial differential equations from noisy measurements. The method is data-driven and improves performance by incorporating first principles knowledge. The effectiveness of the algorithm is demonstrated in a real system using a new benchmark metric.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Multi-objective inverse design of finned heat sink system with physics-informed neural networks

Zhibin Lu, Yimeng Li, Chang He, Jingzheng Ren, Haoshui Yu, Bingjian Zhang, Qinglin Chen

Summary: This study proposes a new inverse design method using a physics-informed neural network to identify optimal heat sink designs. A hybrid PINN accurately approximates the governing equations of heat transfer processes, and a surrogate model is constructed for integration with optimization algorithms. The proposed method accelerates the search for Pareto-optimal designs and reduces search time. Comparing different scenarios facilitates real-time observation of multiphysics field changes, improving understanding of optimal designs.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

On the use of machine learning to generate in-silico data for batch process monitoring under small-data scenarios

Luca Gasparini, Antonio Benedetti, Giulia Marchese, Connor Gallagher, Pierantonio Facco, Massimiliano Barolo

Summary: In this paper, a method for batch process monitoring with limited historical data is investigated. The methodology utilizes machine learning algorithms to generate virtual data and combines it with real data to build a process monitoring model. Automatic procedures are developed to optimize parameters, and indicators and metrics are proposed to assist virtual data generation activities.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

BEELINE: BilevEl dEcomposition aLgorithm for synthesis of Industrial eNergy systEms

Julia Jimenez-Romero, Adisa Azapagic, Robin Smith

Summary: Energy transition is a significant and complex challenge for the industry, and developing cost-effective solutions for synthesizing utility systems is crucial. The research combines mathematical formulation with realistic configurations and conditions to represent utility systems and provides a basis for synthesizing energy-efficient utility systems for the future.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Optimal nonlinear dynamic sparse model selection and Bayesian parameter estimation for nonlinear systems

Samuel Adeyemo, Debangsu Bhattacharyya

Summary: This work develops algorithms for estimating sparse interpretable data-driven models. The algorithms select the optimal basis functions and estimate the model parameters using Bayesian inferencing. The algorithms estimate the noise characteristics and model parameters simultaneously. The algorithms also exploit prior analysis and special properties for efficient pruning, and use a modified Akaike information criterion for model selection.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Designing a sustainable disruption-oriented supply chain under joint pricing and resiliency considerations: A case study

Abbasali Jafari-Nodoushan, Mohammad Hossein Dehghani Sadrabadi, Maryam Nili, Ahmad Makui, Rouzbeh Ghousi

Summary: This study presents a three-objective model to design a forward supply chain network considering interrelated operational and disruptive risks. Several strategies are implemented to cope with these risks, and a joint pricing strategy is used to enhance the profitability of the supply chain. The results show that managing risks and uncertainties simultaneously can improve sustainability goals and reduce associated costs.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Higher-order interior point methods for convex nonlinear programming

T. A. Espaas, V. S. Vassiliadis

Summary: This paper extends the concept of higher-order search directions in interior point methods to convex nonlinear programming. It provides the mathematical framework for computing higher-order derivatives and highlights simplified computation for special cases. The paper also introduces a dimensional lifting procedure for transforming general nonlinear problems into more efficient forms and describes the algorithmic development required to employ these higher-order search directions.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

A hybrid deterministic-stochastic algorithm for the optimal design of process flowsheets with ordered discrete decisions

David A. Linan, Gabriel Contreras-Zarazua, Eduardo Sanhez-Ramirez, Juan Gabriel Segovia-Hernandez, Luis A. Ricardez-Sandoval

Summary: This study proposes a parallel hybrid algorithm for optimal design of process flowsheets, which combines stochastic method with deterministic algorithm to achieve faster and improved convergence.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Novel spatiotemporal graph attention model for production prediction and energy structure optimization of propylene production processes

Xiaoyong Lin, Zihui Li, Yongming Han, Zhiwei Chen, Zhiqiang Geng

Summary: A novel GAT-LSTM model is proposed for the production prediction and energy structure optimization of propylene production processes. It outperforms other models and can provide the optimal raw material scheme for actual production processes.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Machine learning in process systems engineering: Challenges and opportunities

Prodromos Daoutidis, Jay H. Lee, Srinivas Rangarajan, Leo Chiang, Bhushan Gopaluni, Artur M. Schweidtmann, Iiro Harjunkoski, Mehmet Mercangoz, Ali Mesbah, Fani Boukouvala, Fernando Lima, Antonio del Rio Chanona, Christos Georgakis

Summary: This paper provides a concise perspective on the potential of machine learning in the PSE domain, based on discussions and talks during the FIPSE 5 conference. It highlights the need for domain-specific techniques in molecular/material design, data analytics, optimization, and control.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

A practically implementable reinforcement learning control approach by leveraging offset-free model predictive control

Hesam Hassanpour, Prashant Mhaskar, Brandon Corbett

Summary: This work addresses the problem of designing an offset-free implementable reinforcement learning (RL) controller for nonlinear processes. A pre-training strategy is proposed to provide a secure platform for online implementations of the RL controller. The efficacy of the proposed approach is demonstrated through simulations on a chemical reactor example.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Efficient Gas Leak Simulation Surrogate Modeling and Super Resolution for Gas Detector Placement Optimization

Hunggi Lee, Donghyeon Lee, Jaewook Lee, Dongil Shin

Summary: This study introduces an innovative framework that utilizes a limited number of sensors to detect chemical leaks early, mitigating the risk of major industrial disasters, and providing faster and higher-resolution results.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

A study on comparative environmental impact assessment of thermochemical cycles and steam methane reforming processes for hydrogen production processes

Sibel Uygun Batgi, Ibrahim Dincer

Summary: This study examines the environmental impacts of three alternative hydrogen-generating processes and determines the best environmentally friendly option for hydrogen production by comparing different impact categories. The results show that the solar-based HyS cycle options perform the best in terms of global warming potential, abiotic depletion, acidification potential, ozone layer depletion, and human toxicity potential.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Equation-based and data-driven modeling: Open-source software current state and future directions

LaGrande Gunnell, Bethany Nicholson, John D. Hedengren

Summary: A review of current trends in scientific computing shows a shift towards open-source and higher-level programming languages like Python, with increasing career opportunities in the next decade. Open-source modeling tools contribute to innovation in equation-based and data-driven applications, and the integration of data-driven and principles-based tools is emerging. New compute hardware, productivity software, and training resources have the potential to significantly accelerate progress, but long-term support mechanisms are still necessary.

COMPUTERS & CHEMICAL ENGINEERING (2024)

Article Computer Science, Interdisciplinary Applications

Economic and environmental optimisation of mixed plastic waste supply chains in Northern Italy comparing incineration and pyrolysis technologies

Daniel Cristiu, Federico d'Amore, Fabrizio Bezzo

Summary: This study presents a multi-objective mixed integer linear programming framework to optimize the supply chain for mixed plastic waste in Northern Italy. Results offer quantitative insights into economic and environmental performance, balancing trade-offs between maximizing gross profit and minimizing greenhouse gas emissions.

COMPUTERS & CHEMICAL ENGINEERING (2024)