Abstract
In this paper it is shown how Stochastic Approximation theory can be used to derive and analyse well-known Iterative Learning Control algorithms for linear systems. The Stochastic Approximation theory gives conditions that, when satisfied, ensure almost sure convergence of the algorithms to the optimal input in the presence of stochastic disturbances. The practical issues of monotonic convergence and robustness to model uncertainty are considered. Specific choices of the learning matrix are studied, as well as a model-free choice. Moreover, the model-free method is applied to a linear motor system, leading to greatly improved tracking.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Ahn, H.S., Moore, K.L., Chen, Y.: Kalman filter augmented iterative learning control on the iteration domain. In: IEEE American Control Conference, Minneapolis, U.S.A., pp. 250–255 (2006)
Arimoto, S.: Robustness of learning control for robotic manipulators. In: IEEE International Conference on Robotics and Automation, Cincinnati, Ohio USA, pp. 1528–1533 (May 1990)
Benveniste, A., Metivier, M., Priouret, P.: Adaptive Algorithms and Stochastic Approximation. Springer, Berlin (1990)
Butcher, M.: Data-driven methods for tracking improvement. PhD thesis, Ecole Polytechnique Fédérale de Lausane, Laboratoire d’Automatique (2009)
Butcher, M., Karimi, A., Longchamp, R.: A statistical analysis of certain iterative learning control algorithms. International Journal of Control 81(1), 156–166 (2008)
Chen, H.F.: Almost sure convergence of iterative learning control for stochastic systems. Sci. in China (Series F) 46(1), 1–13 (2003)
Chen, H.F., Fang, H.T.: Output tracking for nonlinear stochastic systems by iterative learning control. IEEE Transactions on Automatic Control 49(4), 583–588 (2004)
Dijkstra, B.G.: Iterative Learning Control with applications to a wafer stage. PhD thesis, Delft University of Technology, Delft, The Netherlands (2003)
Gunnarsson, S., Norrlöf, M.: On the disturbance properties of high order iterative learning control algorithms. Automatica 42(11), 2031–2034 (2006)
Hatonen, J.: Issues of algebra and optimality in Iterative Learning Control. PhD thesis, University of Oulu, Finland (2004)
Hatonen, J.J., Harte, T.J., Owens, D.H., Radcliffe, J.D., Lewin, P.L., Rogers, E.: A new robust iterative learning control algorithm for application on a gantry robot. In: IEEE Conference on Emerging Technologies in Factory Automation, Lisbon, Portugal, pp. 305–312 (2003)
Heinzinger, G., Fenwick, D., Paden, B., Miyaziki, F.: Robust learning control. In: 28th IEEE Conference on Decision and Control, Tampa, Florida USA, December 1989, pp. 436–440 (1989)
Nevelson, M.B., Hasminskii, R.Z.: Stochastic Approximation and Recursive Estimation. American Mathematical Society, Providence (1973)
Norrlöf, M.: An adaptive iterative learning control algorithm with experiments on an industrial robot. IEEE Transactions on Robotics and Automation 18(2), 245–251 (2002)
Norrlöf, M., Gunnarsson, S.: Disturbance aspects of iterative learning control. Engineering Applications of Artificial Intelligence 14(1), 87–94 (2001)
Norrlöf, M., Gunnarsson, S.: Time and frequency domain convergence properties in iterative learning control. International Journal of Control 75(14), 1114–1126 (2002)
Norrlöf, M., Gunnarsson, S.: Disturbance rejection using an ILC algorithm with iteration varying filter. Asian Journal of Control 6(3), 432–438 (2004)
Robbins, H., Monro, S.: A stochastic approximation method. Ann. Math. Stat. 22, 400–407 (1951)
Saab, S.S.: Optimal selection of the forgetting matrix into an iterative learning control algorithm. IEEE Transactions on Automatic Control 50(12), 2039–2043 (2005)
Saab, S.S.: A discrete-time stochastic learning control algorithm. IEEE Transactions on Automatic Control 46(6), 877–887 (2001)
Saab, S.S.: On a discrete-time stochastic learning control algorithm. IEEE Transactions on Automatic Control 46(8), 1333–1336 (2001)
Tao, M.K., Kosut, R.L., Gurcan, A.: Learning feedforward control. In: IEEE American Control Conference, Baltimore, Maryland USA, pp. 2575–2579 (June 1994)
Ye, Y., Wang, D.: Zero phase learning control using reversed time input runs. Journal of Dynamic Systems, Measurement and Control 127, 133–139 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Butcher, M., Karimi, A. (2010). Iterative Learning Control Using Stochastic Approximation Theory with Application to a Mechatronic System. In: Lévine, J., Müllhaupt, P. (eds) Advances in the Theory of Control, Signals and Systems with Physical Modeling. Lecture Notes in Control and Information Sciences, vol 407. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16135-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-16135-3_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16134-6
Online ISBN: 978-3-642-16135-3
eBook Packages: EngineeringEngineering (R0)