Optimal Adaptive Reinforcement Learning Control for a Convection‐Reaction Distributed Parameter System
Authors:
- 28 July 2025
- journal article
- Published by Wiley in Optimal Control Applications and Methods
- Vol. 46 (6) , 2384-2395
Abstract
This article is devoted to optimal adaptive control for a distributed parameter convection‐reaction system by reinforcement learning (RL) strategy. The goal is to develop an RL‐based control technique aiming to learn the solution of the involved matrix Riccati differential equation online. Initially, we present a policy iteration (PI) algorithm that solves the optimal control problem online without utilizing any knowledge about the system dynamics, unlike traditional control methods, which often rely on full system dynamics, making them impractical for distributed parameter systems. Furthermore, the convergence of the iterative algorithm is validated under the condition that the starting policy is stabilizing. Additionally, an improved version is introduced with the objective of making the RL algorithm implementable from a realistic standpoint. Numerical simulations are performed to show the effectiveness of the developed algorithm. The proposed method provides a reliable and implementable approach for adaptive control in convection‐reaction systems, extending RL techniques to distributed parameter systems.Keywords
Funding Information
- Qatar University (CDIRCC‐2023‐112)
This publication has 37 references indexed in Scilit:
- Reinforcement learning in sustainable energy and electric systems: a surveyAnnual Reviews in Control, 2020
- Online adaptive algorithm for optimal control with integral reinforcement learningInternational Journal of Robust and Nonlinear Control, 2013
- LQ control design of a class of hyperbolic PDE systems: Application to fixed-bed reactorAutomatica, 2009
- Adaptive optimal control for continuous-time linear systems based on policy iterationAutomatica, 2009
- Representation and Control of Infinite Dimensional Systems2007
- Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approachAutomatica, 2005
- Nonlinear and Robust Control of PDE Systems2001
- An Introduction to Infinite-Dimensional Linear Systems Theory1995
- Optimal control of large space structures governed by a coupled system of ordinary and partial differential equationsMathematics of Control, Signals, and Systems, 1989
- Optimal Control of Systems Governed by Partial Differential Equations1971