Abstract
This article investigates critical challenges in optimal output tracking control, including residual tracking errors, potential instability caused by discount factors, and premature convergence due to inefficient termination criteria. We tackle these issues by developing a data-driven parallel Q-learning algorithm. Specifically, a utility function directly linked to system states is proposed to avoid the instability and error amplification issues in traditional discounted approaches. In addition, the algorithm uses dual lightweight controllers that use convergence properties to enhance learning efficiency. Based on dual controllers, a novel termination criterion is introduced to prevent premature convergence during the training process. Numerical simulations demonstrate that the proposed method eliminates tracking errors, accelerates convergence compared with traditional algorithms, and ensures stable convergence across diverse system dynamics.
Funding Information
  • National Natural Science Foundation of China (62473012, 62222301, 62021003)
  • National Science and Technology Major Project (2021ZD0112302, 2021ZD0112301)
  • Beijing Natural Science Foundation (F251019)

This publication has 35 references indexed in Scilit: