Abstract
Recent approaches to model-based manipulator control involve data-driven learning of the inverse dynamics relationship of a manipulator, eliminating the need for any knowledge of the system model. Ideally, such algorithms should be able to process large amounts of data in an online and incremental manner, thus allowing the system to adapt to changes in its model structure or parameters. Locally Weighted Projection Regression (LWPR) and other non-parametric regression techniques have been applied to learn manipulator inverse dynamics. However, a common issue amongst these learning algorithms is that the system is unable to generalize well outside of regions where it has been trained. Furthermore, learning commences entirely from ‘scratch,’ making no use of any a-priori knowledge which may be available. In this paper, an online, incremental learning algorithm incorporating prior knowledge is proposed. Prior knowledge is incorporated into the LWPR framework by initializing the local linear models with a first order approximation of the available prior information. It is shown that the proposed approach allows the system to operate well even without any initial training data, and further improves performance with additional online training.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Sciavicco, L., Scicliano, B.: Modelling and Control of Robot Manipulators, 2nd edn. Springer, Heidelberg (2000)
Craig, J., Hsu, P., Sastry, S.: Adaptive control of mechanical manipulators. In: Proc. 1986 IEEE Int Conf. on Robotics and Auto., April 1986, vol. 3, pp. 190–195 (1986)
Armstrong-Hélouvry, B., Dupont, P., de Wit, C.C.: A survey of models, analysis tools and compensation methods for the control of machines with friction. Automatica 30(7), 1083–1138 (1994)
Ayusawa, K., Venture, G., Nakamura, Y.: Identification of humanoid robots dynamics using floating-base motion dynamics. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2008, pp. 2854–2859 (September 2008)
Ortega, R., Spong, M.W.: Adaptive motion control of rigid robots: a tutorial. In: Proc of the 27th IEEE Conf on Decision and Control, vol. 2, pp. 1575–1584 (December 1988)
Khosla, P.: Categorization of parameters in the dynamic robot model. IEEE Transactions on Robotics and Automation 5(3), 261–268 (1989)
Nakanishi, J., Cory, R., Mistry, M., Peters, J., Schaal, S.: Operational Space Control: A Theoretical and Empirical Comparison. The Int Journal of Robotics Research 27(6), 737–757 (2008)
Vijayakumar, S., D’souza, A., Schaal, S.: Incremental online learning in high dimensions. Neural Comput. 17(12), 2602–2634 (2005)
Rasmussen, C., Williams, C.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)
Smola, A.J.: A tutorial on support vector regression. Statistics and Computing 14, 199–222 (2004)
Nguyen-Tuong, D., Peters, J., Seeger, M., Schölkopf, B., Verleysen, M.: Learning inverse dynamics: A comparison (2008), http://edoc.mpg.de/420029
Sun de la Cruz, J., Kulić, D., Owen, W.: Learning inverse dynamics for redundant manipulator control. In: 2010 International Conf. on Autonomous and Intelligent Systems (AIS), pp. 1–6 (June 2010)
Nguyen-Tuong, D., Peters, J.: Using model knowledge for learning inverse dynamics. In: IEEE Int. Conf. on Robotics and Automation, pp. 2677–2682 (2010)
Nguyen-Tuong, D., Scholkopf, B., Peters, J.: Sparse online model learning for robot control with support vector regression. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2009, pp. 3121–3126 (October 2009)
Schaal, S., Atkeson, C.G., Vijayakumar, S.: scalable techniques from nonparameteric statistics for real-time robot learning. Applied Intelligence 16(1), 49–60 (2002)
Schaal, S., Atkeson, C.G.: Constructive incremental learning from only local information. Neural Computation 10(8), 2047–2084 (1998)
Corke, P.I.: A robotics toolbox for MATLAB. IEEE Robotics and Automation Magazine 3(1), 24–32 (1996)
Chiaverini, S., Sciavicco, L., Siciliano, B.: Control of robotic systems through singularities. Lecture Notes in Control and Information Sciences, vol. 162, pp. 285–295. Springer, Heidelberg (1991)
Peters, J., Schaal, S.: Learning to Control in Operational Space. The Int. Journal of Robotics Research 27(2), 197–212 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
de la Cruz, J.S., Kulić, D., Owen, W. (2011). Online Incremental Learning of Inverse Dynamics Incorporating Prior Knowledge. In: Kamel, M., Karray, F., Gueaieb, W., Khamis, A. (eds) Autonomous and Intelligent Systems. AIS 2011. Lecture Notes in Computer Science(), vol 6752. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21538-4_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-21538-4_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21537-7
Online ISBN: 978-3-642-21538-4
eBook Packages: Computer ScienceComputer Science (R0)