Computational & Technology Resources
an online resource for computational,
engineering & technology publications
Civil-Comp Proceedings
ISSN 1759-3433
CCP: 102
PROCEEDINGS OF THE FOURTEENTH INTERNATIONAL CONFERENCE ON CIVIL, STRUCTURAL AND ENVIRONMENTAL ENGINEERING COMPUTING
Edited by:
Paper 109

Computing Stochastic Optimal Feedback Controls Using an Iterative Solution of the Hamiltonian System

K. Marti and I. Stein

Aerospace Engineering and Technology
Federal Armed Forces University Munich
Neubiberg/Munich, Germany

Full Bibliographic Reference for this paper
K. Marti, I. Stein, "Computing Stochastic Optimal Feedback Controls Using an Iterative Solution of the Hamiltonian System", in , (Editors), "Proceedings of the Fourteenth International Conference on Civil, Structural and Environmental Engineering Computing", Civil-Comp Press, Stirlingshire, UK, Paper 109, 2013. doi:10.4203/ccp.102.109
Keywords: optimal regulators under stochastic uncertainty, stochastic Hamiltonian,.

Summary
reference

Stochastic optimal feedback controls are determined for dynamic control systems with random model parameters by means of the stochastic optimal open-loop feedback method, which is also the basis of model predictive control. Based on the stochastic Hamiltonian of the optimum control problem with random parameters, the class of H-minimal controls is determined by solving a finite-dimensional stochastic program for the minimization of the expected Hamiltonian with respect to the input at each time point. Having a H-minimal control, a two-point boundary value problem (BVP) with random parameters is formulated for the computation of optimal state and co-state trajectories. Inserting then these trajectories into the H-minimal control, stochastic optimal open-loop controls are found for each remaining time interval with an arbitrary intermediate starting time point. Evaluating the stochastic optimal open-loop controls at the corresponding intermediate starting time point only, a stochastic optimal open-loop feedback control is obtained. For the numerical solution of the two-point boundary value with random parameters the following techniques are considered: i) Linearizing the basic two-point (BVP); ii) Transformation of the linearized two-point (BVP) into a fixed point condition for the adjoint trajectory and applying then iterative methods; iii) Approximation of the variables on the remaining time interval by constant ones to obtain a system of linear equations for the required values at the intermediate starting time points; iv) Taylor expansion of the variables with respect to the underlying parameter vector at its conditional mean value and reducing the twopoint (BVP) to a linear two-point (BVP) for the trajectories and their sensitivities. v) Solving this two-point (BVP) by using a matrix Riccati differential equation.

purchase the full-text of this paper (price £20)

go to the previous paper
go to the next paper
return to the table of contents
return to the book description
purchase this book (price £65 +P&P)