UPM Institutional Repository

Discrete-time nonlinear stochastic optimal control problem based on stochastic approximation approach


Citation

Kek, Sie Long and Sim, Sy Yi and Leong, Wah June and Teo, Kok Lay (2018) Discrete-time nonlinear stochastic optimal control problem based on stochastic approximation approach. Advances in Pure Mathematics, 8 (3). 232 - 244. ISSN 2160-0368; ESSN: 2160-0384

Abstract

In this paper, a computational approach is proposed for solving the discrete-time nonlinear optimal control problem, which is disturbed by a sequence of random noises. Because of the exact solution of such optimal control problem is impossible to be obtained, estimating the state dynamics is currently required. Here, it is assumed that the output can be measured from the real plant process. In our approach, the state mean propagation is applied in order to construct a linear model-based optimalcontrol problem, where the model output is measureable. On this basis, an output error, which takes into account the differences between the real output and the model output, is defined. Then, this output error is minimized by applying the stochastic approximation approach. During the computation procedure, the stochastic gradient is established, so as the optimal solution of the model used can be updated iteratively. Once the convergence is achieved, the iterative solution approximates to the true optimal solution of the original optimal control problem, in spite of model-reality differences. For illustration, an example on a continuous stirred-tank reactor problem is studied, and the result obtained shows the applicability of the approach proposed. Hence, the efficiency of the approach proposed is highly recommended.


Download File

[img] Text
Discrete-time nonlinear stochastic optimal control problem based on stochastic approximation approach.pdf
Restricted to Repository staff only

Download (350kB)
Official URL or Download Paper: https://theadl.com/detail.php?id=218&vol=1

Additional Metadata

Item Type: Article
Divisions: Faculty of Science
DOI Number: https://doi.org/10.4236/apm.2018.83012
Publisher: Scientific Research Publishing
Keywords: Nonlinear optimal control; Output error; Model-reality differences; Iterative solution; Stochastic approximation
Depositing User: Nurul Ainie Mokhtar
Date Deposited: 04 May 2020 00:26
Last Modified: 04 May 2020 00:26
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.4236/apm.2018.83012
URI: http://psasir.upm.edu.my/id/eprint/72308
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item