UPM Institutional Repository

Model-free control based on reinforcement learning for a wastewater treatment problem.


Syam, Syafiie and T., Alvarez and F., Tadeo and E., Martinezc (2011) Model-free control based on reinforcement learning for a wastewater treatment problem. Applied Soft Computing, 11 (1). pp. 73-82. ISSN 1568-4946


This article presents a proposal, based on the model-free learning control (MFLC) approach, for the control of the advanced oxidation process in wastewater plants. This is prompted by the fact that many organic pollutants in industrial wastewaters are resistant to conventional biological treatments, and the fact that advanced oxidation processes, controlled with learning controllers measuring the oxidation–reduction potential (ORP), give a cost-effective solution. The proposed automation strategy denoted MFLC-MSA is based on the integration of reinforcement learning with multiple step actions. This enables the most adequate control strategy to be learned directly from the process response to selected control inputs. Thus, the proposed methodology is satisfactory for oxidation processes of wastewater treatment plants, where the development of an adequate model for control design is usually too costly. The algorithm proposed has been tested in a lab pilot plant, where phenolic wastewater is oxidized to carboxylic acids and carbon dioxide. The obtained experimental results show that the proposed MFLC-MSA strategy can achieve good performance to guarantee on-specification discharge at maximum degradation rate using readily available measurements such as pH and ORP, inferential measurements of oxidation kinetics and peroxide consumption, respectively.

Download File

Full text not available from this repository.

Additional Metadata

Item Type: Article
Divisions: Faculty of Engineering
DOI Number: https://doi.org/10.1016/j.asoc.2009.10.018
Keywords: Wastewater treatment plants; Intelligent control; Oxidation–reduction potential.
Depositing User: Muizzudin Kaspol
Last Modified: 10 Nov 2014 09:54
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.1016/j.asoc.2009.10.018
URI: http://psasir.upm.edu.my/id/eprint/23219
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item