Abstract
This paper proposes the use of Sequential Monte Carlo (SMC) as the computational engine for general (non-convex) stochastic Model Predictive Control (MPC) problems. It shows how SMC methods can be used to find global optimisers of non-convex problems, in particular for solving open-loop stochastic control problems that arise at the core of the usual receding-horizon implementation of MPC. This allows the MPC methodology to be extended to nonlinear non-Gaussian problems. We illustrate the effectiveness of the approach by means of numerical examples related to coordination of moving agents.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amzal, B., Bois, F.Y., Parent, E., Robert, C.P.: Bayesian-Optimal Design via Interacting Particle systems. Journal of the American Statistical Association, Theory and Methods 101(474) (2006)
Andrieu, C., Doucet, A., Singh, S.S., Tadić, V.: Particle Methods for Change Detection, Identification and Control. Proceedings of the IEEE 92, 423–438 (2004)
Bertsekas, D.P.: Dynamic programming and optimal control. Athena Scientific, Belmont (1995)
Bertsekas, D.P.: Dynamic Programming and Suboptimal Control: A Survey from ADP to MPC. European J. of Control 11(4-5) (2005)
Del Moral, P.: Feynman-Kac formulae: genealogical and interacting particlesystems with applications. Springer, New York (2004)
Del Moral, P., Doucet, A., Jasra, A.: Sequential Monte Carlo Samplers. J. Royal Statist. Soc. B 68(3), 411–436 (2006)
Doucet, A., de Freitas, J.F.G., Gordon, N.J.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)
Hwang, C.R.: Laplace’s method revisited: weak convergence of probability measures. Ann. Probab. 8(6), 1177–1182 (1980)
Johansen, A.M., Doucet, A., Davy, M.: Particle methods for Maximum Likelihood Parameter Estimation in Latent Variable Models. Statistics and Computing 18(1), 47–57 (2008)
Lecchini Visintini, A., Glover, W., Lygeros, J., Maciejowski, J.M.: Monte carlo optimization for conflict resolution in air traffic control. IEEE Trans. Intell. Transp. Syst. 7(4), 470–482 (2006)
Lecchini Visintini, A., Lygeros, J., Maciejowski, J.M.: Simulated Annealing: Rigorous finite-time guarantees for optimization on continuous domains. In: Platt, J.C., Koller, D., Singer, Y., Roweis, S. (eds.) Advances in NIPS 20, pp. 865–872. MIT Press, Cambridge (2008)
Maciejowski, J.M.: Predictive control with Constraints. Prentice-Hall, Englewood Cliffs (2002)
Muller, P., Sanso, B.G., De Iorio, M.: Optimal Bayesian design by Inhomogeneous Markov Chain Simulation. Journal of the American Statistical Association, 788–798 (2004)
Rawlings, J.B., Bakshi, B.R.: Particle filtering and moving horizon estimation. Comput. Chem. Eng. 30, 1529–1541 (2006)
Robert, C.P., Casella, G.: Monte Carlo Statistical Methods, 2nd edn. Springer, Heidelberg (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kantas, N., Maciejowski, J.M., Lecchini-Visintini, A. (2009). Sequential Monte Carlo for Model Predictive Control. In: Magni, L., Raimondo, D.M., Allgöwer, F. (eds) Nonlinear Model Predictive Control. Lecture Notes in Control and Information Sciences, vol 384. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01094-1_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-01094-1_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01093-4
Online ISBN: 978-3-642-01094-1
eBook Packages: EngineeringEngineering (R0)