Reinforcement learning-based particle swarm optimization for sewage treatment control
Open Access
- 28 May 2021
- journal article
- research article
- Published by Springer Nature in Complex & Intelligent Systems
- Vol. 7 (5) , 2199-2210
Abstract
To solve the problem of high-energy consumption in activated sludge wastewater treatment, a reinforcement learning-based particle swarm optimization (RLPSO) was proposed to optimize the control setting in the sewage process. This algorithm tries to take advantage of the valid history information to guide the behavior of particles through a reinforcement learning strategy. First, an elite network is constructed by selecting elite particles and recording their successful search behavior. Then the network is trained and evaluated to effectively predict the particle velocity. In the periodic wastewater treatment process, the RLPSO runs repeatedly according to the optimized cycle. Finally, RLPSO was tested based on Benchmark Simulation Model 1 (BSM1) of sewage treatment, and the simulation results showed that it could effectively reduce the energy consumption on the premise of ensuring qualified water quality. Furthermore, the performance of RLPSO was analyzed using the benchmarks with higher dimension, which verifies the effectiveness of the algorithm and provides the possibility for RLPSO to be applied to a wider range of problems.Keywords
Funding Information
- National Natural Science Foundation of China (Grant No. 62003306)
- Natural Science Foundation of Zhejiang Province (LQ21F030009, LY19F030003)
This publication has 31 references indexed in Scilit:
- Removing violations of the effluent pollution in a wastewater treatment processChemical Engineering Journal, 2015
- The effect of activated carbon addition on membrane bioreactor processes for wastewater treatment and reclamation – A critical reviewBioresource Technology, 2015
- Simultaneous removal of nitrogen and phosphorus from swine wastewater in a sequencing batch biofilm reactorChinese Journal of Chemical Engineering, 2015
- A social learning particle swarm optimization algorithm for scalable optimizationInformation Sciences, 2015
- Nonlinear multiobjective model-predictive control scheme for wastewater treatment processJournal of Process Control, 2014
- Advanced Oxidation Processes in Water/Wastewater Treatment: Principles and Applications. A ReviewCritical Reviews in Environmental Science and Technology, 2014
- Wastewater treatment plant design and operation under multiple conflicting objective functionsEnvironmental Modelling & Software, 2013
- Optimal aeration control in a nitrifying activated sludge processWater Research, 2012
- Model-free control based on reinforcement learning for a wastewater treatment problemApplied Soft Computing, 2011
- The COST benchmark simulation model—current state and future perspectiveControl Engineering Practice, 2004