Abstract
This paper presents new results on switching control using neural networks. Given a set of candidate controllers, a pair of neural networks is trained to identify the stability region and estimate the closed-loop performance for each controller. The neural network outputs are used in the on-line switching rule to select the controller output to be applied to the system during each control period. The paper presents architectures and training procedures for the neural networks and sufficient conditions for stability of the closed-loop system using the proposed switching strategy. The neural-network-based switching strategy is applied to generate the switching strategy embeded in the SIMPLEX architecture, a real-time infrastructure for soft on-line control system upgrades. Results are shown for the real-time level control of a submerged vessel.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
J. Balakrishnan and K.S. Narendra. Adaptive control using multiple models. IEEE Trans. on Automatic Control, 42(2):171–187, Feb 1997.
Dimitri P. Bertsekas and John Tsitsiklis. Neuro-Dynamic Programming. Athena Scientific, Belmont, MA, 1996.
Christopher M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, Oxford, Great Britain, 1995.
M. Bodson, J. Lehoczky, R. Rajkumar, L. Sha, D. Soh, M. Smith, and J. Stephan. Control configuration in the presence of software failures. In Proc. 32nd IEEE Conf. Decision Control, volume 3, page 2284, San Antonio, TX, Dec 1993.
S.J. Bradtke, B.E. Ydstie, and A.G. Barto. Adaptive linear quadratic control using policy iteration. In Proc. American Control Conference, volume 3, pages 3475-9, Baltimore, MD, Jun 1994.
Michael S. Branicky. Stability of switched and hybrid systems. In Proc. 33rd IEEE Conf. Decision Control, volume 4, pages 3498–3503, Lake Buena Vista, FL, Dec 1994.
E.D. Ferreira and B.H. Krogh. Using neural networks to estimate regions of stability. In Proc. of 1997 American Control Conference, volume 3, pages 1989–93, Albuquerque, NM, Jun 1997.
J. Malmborg, B. Berhardsson, and K.J. Aström. A stabilizing switching scheme for multi-controller systems. In Proc. of the IFAC World Congress, volume F, pages 229–234, San Francisco, California, USA, 1996. IFAC'96, Elsevier Science.
A.S. Morse. Supervisory control of families of linear set-point controllers — part is Exact matching. IEEE Trans. on Automatic Control, 41(10):1413–31, Oct 1996.
D. Seto, L. Sha, A. Chutinan, and B.H. Krogh. The simplex architecture for safe on-line control system upgrades. Submitted to. 1998 American Control Conference.
L. Sha. A software architecture for dependable and evolvable industrial computing systems. In Proc. IPC'95, pages 145–156, Detroit, MI, May 1995.
J.N. Tsitsiklis and B. Van Roy. An analysis of temporal-difference learning with function approximation. IEEE Trans. on Automatic Control, 42(5):674–690, May 1997.
P. Werbos. A menu of designs in reinforcement learning over time. In W.T. Miller III, R.S. Sutton, and P. Werbos, editors, Neural Networks for control, chapter 3. MIT Press, 2nd edition, 1991.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ferreira, E.D., Krogh, B.H. (1998). Switching controllers based on neural network estimates of stability regions and controller performance. In: Henzinger, T.A., Sastry, S. (eds) Hybrid Systems: Computation and Control. HSCC 1998. Lecture Notes in Computer Science, vol 1386. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64358-3_36
Download citation
DOI: https://doi.org/10.1007/3-540-64358-3_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-64358-6
Online ISBN: 978-3-540-69754-1
eBook Packages: Springer Book Archive