Theory of Optimal Control Using Bisimulations
We consider the synthesis of optimal controls for continuous feedback systems by recasting the problem to a hybrid optimal control problem: to synthesize optimal enabling conditions for switching between locations in which the control is constant. An algorithmic solution is obtained by translating the hybrid automaton to a finite automaton using a bisimulation and formulating a dynamic programming problem with extra conditions to ensure non-Zenoness of trajectories. We show that the discrete value function converges to the viscosity solution of the Hamilton-Jacobi-Bellman equation as a discretization parameter tends to zero.
Unable to display preview. Download preview PDF.
- 8.O. Maler, A Pnueli, J. Sifakis. On the synthesis of discrete controllers for timed systems. In Proc. STACS’ 95, E.W. Mayr and C. Puech, eds. LNCS 900, Springer-Verlag, p. 229–242, 1995.Google Scholar
- 11.H.S. Witsenhausen. A class of hybrid-state continuous-time dynamic systems. IEEE Trans. AC, vol. 11, no. 2, pp. 161–167, April, 1966.Google Scholar
- 12.H. Wong-Toi. The synthesis of controllers for linear hybrid automata. In Proc. 36th IEEE Conference on Decision and Control, pp. 4607–4612, 1997.Google Scholar