Abstract
In this paper, we present inverse optimal control as a promising approach to transfer biological motions to humanoid robots. Inverse optimal control serves to identify the underlying optimality criteria of human motions from measurements. Based on these results optimal control models are established that can be used to control robot motion. Inverse optimal control problems are hard to solve since they require the simultaneous treatment of a parameter identification problem and an optimal control problem. We propose a bilevel approach to solve inverse optimal control problems which efficiently combines a direct multiple shooting technique for the optimal control problem solution with a derivative free trust region optimization technique to guarantee the match between optimal control problem solution and measurements. We apply inverse optimal control to determine optimality principles of human locomotion path generation to given target positions and orientations, using new motion capture data of human subjects. We show how the established optimal control model can be used to enable the humanoid robot HRP-2 to autonomously generate natural locomotion paths.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alexander, R.M.: The gaits of bipedal and quadrupedal animals. International Journal of Robotics Research 3(2), 49–59 (1984)
Alexander, R.M.: Optima for Animals. Princeton University Press, Princeton (1996)
Arechavaleta, G., Laumond, J.P., Hicheur, H., Berthoz, A.: On the nonholonomic nature of human locomotion. Autonomous Robots 25(1-2) (2008a)
Arechavaleta, G., Laumond, J.P., Hicheur, H., Berthoz, A.: An optimality principle governing human walking. IEEE Transactions on Robotics 24(1), 5–14 (2008b)
Billard, A., Mataric, M.: Learning human arm movements by imitation: Evaluation of a biologically inspired connectionist architecture. Robotics and Autonomous Systems 27(2-3), 145–160 (2001)
Bock, H.G.: Randwertproblemmethoden zur Parameteridentifizierung in Systemen nichtlinearer Differentialgleichungen. In: Bonner Mathematische Schriften, vol. 183, Universität Bonn (1987)
Bock, H.G., Plitt, K.J.: A multiple shooting algorithm for direct solution of optimal control problems. In: Proceedings of the 9th IFAC World Congress, Budapest, International Federation of Automatic Control, pp. 242–247 (1984)
Brogan, D., Johnson, N.: Realistic human walking paths. In: Proceedings of International Conference on Computer Animation and Social Agents, New-Brunswick, NJ, USA, pp. 94–101 (2003)
Chestnutt, J., Lau, M., Cheung, G., Kuffner, J., Hodgins, J., Kanade, T.: Footstep planning for the Honda ASIMO humanoid. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Barcelona, pp. 629–634 (2005)
Choi, M.G., Lee, J., Shin, S.Y.: Planning biped locomotion using motion capture data and probabilistic roadmaps. ACM Trans. on Graphics 22(2), 182–203 (2003)
Gutmann, J.S., Fukuchi, M., Fujita, M.: Real-time path planning for humanoid robot navigation. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence (IJCAI), Edinburgh, UK, pp. 1232–1237 (2005)
Hatz, K.: Estimating parameters in optimal control problems. Master’s thesis. IWR, Universität Heidelberg (2008)
Heuberger, C.: Inverse combinatorial optimization: A survey on problems, methods and results. Journal of Combinatorial Optimization (2004)
Hicheur, H., Pham, Q.C., Arechavaleta, G., Laumond, J.P., Berthoz, A.: The formation of trajectories during goal-oriented locomotion in humans I: A stereotyped behaviour. European Journal of Neuroscience 27 (2007)
Ikeuchi, K.: Dance and robotics. In: Digital Human Symposium (2009)
Kajita, S. et al. : Biped walking pattern generation by using preview control of zero-moment point. In: Proceedings of IEEE International Conference on Robotics and Automation (ICRA), pp. 1620–1626 (2003)
Kanehiro, F., Hirukawa, H., Kajita, S.: OpenHRP: Open architecture humanoid robotics platform. Int. J. of Robotics Research 23(2), 155–165 (2004)
Kaneko, K. et al. : The humanoid robot HRP-2. In: Proceedings of IEEE Int. Conf. on Robotics and Automation (ICRA), pp. 1083–1090 (2004)
Latombe, J.C.: Robot Motion Planning. Kluwer Academic Publishers, Dordrecht (1991)
Laumond, J.P. (ed.): Robot Motion Planning and Control. LNCIS. Springer, Heidelberg (1998)
Laumond, J.P., Arechavaleta, G., Truong, T.V.A., Hicheur, H., Pham, Q.C., Berthoz, A.: The words of the human locomotion. In: Proceedings of 13th International Symposium on Robotics Research (ISRR 2007), Springer Star Series (2007)
LaValle, S.M.: Planning Algorithms. Cambridge University Press, Cambridge (2006)
Leineweber, D.B., Bauer, I., Bock, H.G., Schlöder, J.P.: a) An efficient multiple shooting based reduced SQP strategy for large-scale dynamic process optimization - part I: theoretical aspects. Comput. Chem. Engng. 27, 157–166 (2003a)
Liu, C.K., Hertzmann, A., Popovic, Z.: Learning physics-based motion style with inverse optimization. ACM Transactions on Graphics (SIGGRAPH 2005) 24 (2005)
Luo, Z.Q., Pang, J.S., Ralph, D.: Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge (1996)
Mombaur, K.: Using optimization to create self-stable human-like running. Robotica (2008)
Mombaur, K.: A numerical inverse optimal control method to identify optimality criteria of dynamical systems from measurements (2009) (preparation)
Mombaur, K., Laumond, J.P., Yoshida, E.: An optimal control model unifying holonomic and nonholonomic walking. In: Proceedings of IEEE Humanoids, Daejon, Korea (2008)
Nakazawa, A., Nakaoka, S., Ikeuchi, K., Yokoi, K.: Imitating human dance motions through motion structure analysis. In: Proceedings of IEEE IROS, vol. 3, pp. 2539–2544 (2002)
Nelder, J.A., Mead, R.: A simplex method for function minimization. Computer Journal 7, 308–313 (1965)
Pettré, J., Siméon, T., Laumond, J.P.: A 2-stage locomotion planner for digital actors. In: ACM Eurographics Symposium on Computer Animation (2003)
Powell, M.J.D.: Developments of newuoa for unconstrained minimization without derivatives. IMA Journal of Numerical Analysis 28, 649–664 (2008)
Schultz, G., Mombaur, K.: Modeling and optimal control of human-like running (2008) (submitted)
Stasse, O., Davison, A.J., Sellaouti, R., Yokoi, K.: Real-time 3D SLAM for humanoid robot considering pattern generator information. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Bejing, China, pp. 348–355 (2006)
Suleiman, W., Yoshida, E., Kanehiro, F., Laumond, J.P., Monin, A.: On human motion imitation by humanoid robot. In: Proceedings of IEEE ICRA (2008)
Ye, J.: Necessary and sufficient optimality conditions for mathematical programs with equilibrium constraints. Journal of Mathematical Analysis and Applications 307, 350–369 (2005)
Yoshida, E., Belousov, I., Esteves, C., Laumond, J.P., Sakaguchi, T., Yokoi, K.: Planning 3-d collision-free dynamic robotic motion through iterative reshaping. IEEE Transactions on Robotics 24(5), 1186–1198 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mombaur, K., Laumond, JP., Truong, A. (2011). An Inverse Optimal Control Approach to Human Motion Modeling. In: Pradalier, C., Siegwart, R., Hirzinger, G. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 70. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19457-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-19457-3_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-19456-6
Online ISBN: 978-3-642-19457-3
eBook Packages: EngineeringEngineering (R0)