Data-Driven Integral Reinforcement Learning for Plug Flow Reactor Nonlinear PDE Model via the Method of Characteristics
Preprint
- 10 October 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
This paper develops a characteristics-based integral reinforcement learning(IRL) framework for the control of a nonlinear nonisothermal plug-flowreactor modeled as a convection--reaction hyperbolic distributed-parametersystem with distributed actuation. Exploiting the transport structure, themethod of characteristics yields an exact representation in terms of afamily of parameterized nonlinear ODE trajectories driven by re-indexeddistributed inputs. Building on this representation, an online IRLpolicy-iteration scheme is derived from an integral Bellman relation,enabling data-driven policy evaluation and improvement from measuredspatio-temporal trajectories without requiring explicit knowledge of thenonlinear drift dynamics. Monotonic improvement of the characteristicvalue functions is established for admissible policy updates, and aLyapunov functional induced by the characteristic value function is usedto establish a dissipation property for the closed-loop PDE. Numerical simulations demonstrate regulation toward a desiredsteady profile, robustness to bounded disturbances and moderatemodel uncertainties, and nominal closed-loop performancecomparable to offline LQR and IRL--LQR benchmarks.Keywords
This publication has 42 references indexed in Scilit:
- Optimal Adaptive Reinforcement Learning Control for a Convection‐Reaction Distributed Parameter SystemOptimal Control Applications and Methods, 2025
- Adaptive Control of Hyperbolic PDEs2019
- Stability and Boundary Stabilization of 1-D Hyperbolic Systems2016
- Reinforcement Learning and Approximate Dynamic Programming for Feedback Control2012
- Characteristics‐Based Model Predictive Control of a Catalytic Flow Reversal ReactorThe Canadian Journal of Chemical Engineering, 2007
- Optimal temperature control of a steady‐state exothermic plug‐flow reactorAIChE Journal, 2002
- Nonlinear and Robust Control of PDE Systems2001
- Nonlinear inferential cascade control of exothermic fixed‐bed reactorsAIChE Journal, 2000
- Use of nonlinear transformations and a self-tuning regulator to develop an algorithm for catalytic reactor temperature controlThe Canadian Journal of Chemical Engineering, 1988
- Application of LQ and IMC controllers to a packed‐bed reactorAIChE Journal, 1987