An AIPC-based controller for chemical process operations: Development and validation on a rigorous dynamic model
Authors:
- Hai WangHWHai Wang
- Shaojun LiSLShaojun Li
- Nan ZhangNZNan Zhang
Preprint
- 11 June 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
This paper proposes an AIPC-based controller integrating a PINN surrogate with monotonicity constraints, a TD3 agent, and a steady-state detection module, along with an operator experience integration strategy (AIPC-OE) that activates rule-based corrective actions near constraint boundaries. Three reward functions are evaluated to guide reward design. Validated on a rigorous dynamic model of an industrial pre-distillation column, the controller reduces side-stream FBP overshoot by 89% vs. PID and achieves 44% faster settling than PID in the baseline scenario. Under crude property variation, AIPC-OE further reduces side-stream overshoot by 44% compared to standalone AIPC. Under simultaneous variation of crude properties and throughput, both AIPC and AIPC-OE substantially suppress side-stream FBP overshoot relative to MPC (2.0°C and 2.3°C vs. 7.3°C). To our knowledge, this is the first validation of a PINN-augmented DRL controller on a rigorous first-principles dynamic model of an industrial distillation column, demonstrating its potential for practical deployment in complex chemical processes.Keywords
This publication has 12 references indexed in Scilit:
- A Twin Agent Reinforcement Learning Framework by Integrating Deterministic and Stochastic PoliciesIndustrial & Engineering Chemistry Research, 2024
- Comparison of Reinforcement Learning and Model Predictive Control for a Nonlinear Continuous ProcessIFAC-PapersOnLine, 2024
- Enhanced reinforcement learning in two-layer economic model predictive control for operation optimization in dynamic environmentChemical Engineering Research and Design, 2023
- TASAC: A twin-actor reinforcement learning framework with a stochastic policy with an application to batch process controlControl Engineering Practice, 2023
- Accelerating reinforcement learning with case-based model-assisted experience augmentation for process controlNeural Networks, 2022
- A reinforcement learning-based economic model predictive control framework for autonomous operation of chemical reactorsChemical Engineering Journal, 2022
- Investigation of a Model‐Based Deep Reinforcement Learning Controller Applied to an Air Separation Unit in a Production EnvironmentChemie Ingenieur Technik, 2021
- Computing operation procedures for chemical plants using whole-plant simulation modelsControl Engineering Practice, 2021
- Online reinforcement learning for a continuous space system with experimental validationJournal of Process Control, 2021
- Reinforcement Learning for Batch-to-Batch Bioprocess Optimisation2019