Abstract
In this paper we present the problem of combining optimal control with efficient information gathering in an uncertain environment. We assume that the decision maker has the ability to choose among a discrete set of sources of information, where the outcome of each source is stochastic. Different sources and outcomes determine a reduction of uncertainty, expressed in terms of constraints on system variables and set-points, in different directions. This paper proposes an optimization-based decision making algorithm that simultaneously determines the best source to query and the optimal sequence of control moves, according to the minimization of the expected value of an index that weights both dynamic performance and the cost of querying. The problem is formulated using stochastic programming ideas with decision-dependent scenario trees, and a solution based on mixed-integer linear programming is presented. The results are demonstrated on a simple supply-chain management example with uncertain market demand.
This work was partially supported by the European Commission under the HYCON Network of Excellence, contract number FP6-IST-511368, and under the WIDE project, contract number FP7-IST-224168.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bemporad, A., Borrelli, F., Morari, M.: Min-max control of constrained uncertain discrete-time linear systems. IEEE Transactions On Automatic Control 48(9), 1600–1606 (2003)
Bemporad, A., Giorgetti, N.: Logic-based methods for optimal control of hybrid systems. IEEE Transactions On Automatic Control 51(6), 963–976 (2006)
Bemporad, A., Muñoz de la Peña, D., Piazzesi, P.: Optimal control of investments for quality of supply improvement in electrical energy distribution networks. Automatica 42(8), 1331–1336 (2006)
Bertsekas, D.P., Tsitsiklis, J.T.: Neuro-Dynamic Programming. Athena Scientific, Belmont (1996)
Birge, J.R., Louveaux, F.V.: Introduction to Stochastic Programming. Springer, New York (1997)
Blei, D.M., Kaelbling, L.P.: Shortest paths in a dynamic uncertain environment. In: IJCAI Workshop on Adaptive Spatial Representations of Dynamic Environments (1999)
Chong, C.Y., Kumar, S.P.: Sensor networks: Evolution, opportunities, and challenges. Proceedings of the IEEE 91, 1247–1256 (2003)
Perea-López, E., Ydstie, B.E., Grossmann, I.E.: A model predictive control strategy for supply chain optimization. Computers and Chemical Engineering 27(8-9), 1201–1218 (2003)
Kall, P., Wallace, S.W.: Stochastic Programming. Wiley, Chichester (1994)
Brauna, M.W., Rivera, D.E., Floresa, M.E., Carlyleb, W.M., Kempf, K.G.: A Model Predictive Control framework for robust management of multi-product, multi-echelon demand networks. Annual Reviews in Control 27(2), 229–245 (2003)
Muñoz de la Peña, D., Alamo, T., Bemporad, A., Camacho, E.F.: A decomposition algorithm for feedback min-max model predictive control. IEEE Transactions On Automatic Control 51(10), 1688–1692 (2006)
Neumann, P.: Communication in industrial automation - what is going on? Control Engineering Practice 15, 1332–1347 (2007)
Puterman, M.L.: Markov Decision Processes. Wiley and Sons, Chichester (1994)
Ross, S.: Introduction to Stochastic Dynamic Programming. Academic Press, London (1983)
Sahinidis, N.V.: Optimization under uncertainty: State-of-the-art and opportunities. Computers & Chemical Engineering 28(6-7), 971–983 (2004)
Scokaert, P.O.M., Mayne, D.Q.: Min-max feedback model predictive control for constrained linear systems. IEEE Transactions On Automatic Control 43, 1136–1142 (1998)
Sutton, R.S., Barto, A.T.: Reinforcement Learning. MIT Press, Cambridge (1998)
Tatikonda, S., Mitter, S.: Control under communication constraints. IEEE Transactions on Automatic Control 49, 1056–1068 (2004)
Williams, H.P.: Model Building in Mathematical Programming, 3rd edn. John Wiley & Sons, Chichester (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bernardini, D., de la Peña, D.M., Bemporad, A., Frazzoli, E. (2009). Simultaneous Optimal Control and Discrete Stochastic Sensor Selection. In: Majumdar, R., Tabuada, P. (eds) Hybrid Systems: Computation and Control. HSCC 2009. Lecture Notes in Computer Science, vol 5469. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00602-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-00602-9_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00601-2
Online ISBN: 978-3-642-00602-9
eBook Packages: Computer ScienceComputer Science (R0)