Abstract
Wastewater treatment plays a meaningful role in environmental protection, water recycling and public health, and its optimal control offers significant economic and social value. However, the wastewater treatment plant is a large-scale nonlinear system, and its own operation is affected by a series of uncontrollable factors such as the flow rate and composition of the incoming wastewater. This makes it extremely challenging for traditional control methods to realize precise control. To address these issues, this paper proposes a novel knowledge-guided policy optimization control method by integrating policy transfer and adaptive dynamic programming. First, an adaptive critic policy transfer framework based on the source domain knowledge selection method is introduced to construct knowledge extraction and data mining structures to enhance the learning efficiency of the target domain agent. Second, a source domain knowledge selection module is proposed to adaptively adjust the knowledge extracted by the target domain agent. Third, an adaptive termination module is designed to determine when the immature policy in the source domain should terminate during the target domain learning process. Finally, the theoretical stability of the method in this paper is demonstrated by designing a reasonable Lyapunov function. The system performance of the wastewater treatment plant under dry, rainy, and stormy weather conditions is evaluated, ultimately demonstrating the superior performance and adaptability of the proposed method.
Funding Information
  • National Natural Science Foundation of China (62222301, 62473012, 62021003)
  • National Science and Technology Major Project (2021ZD0112302, 2021ZD0112301)
  • Beijing Natural Science Foundation (F251019)

This publication has 37 references indexed in Scilit: