“Lucy, Take the Noodle Box!”: Domestic Object Manipulation Using Movement Primitives and Whole Body Motion
For robots acting - and failing - in everyday environments, a predictable behaviour representation is important so that it can be utilised for failure analysis, recovery, and subsequent improvement. Learning from demonstration combined with dynamic motion primitives is one commonly used technique for creating models that are easy to analyse and interpret; however, mobile manipulators complicate such models since they need the ability to synchronise arm and base motions for performing purposeful tasks. In this paper, we analyse dynamic motion primitives in the context of a mobile manipulator - a Toyota Human Support Robot (HSR) - and introduce a small extension of dynamic motion primitives that makes it possible to perform whole body motion with a mobile manipulator. We then present an extensive set of experiments in which our robot was grasping various everyday objects in a domestic environment, where a sequence of object detection, pose estimation, and manipulation was required for successfully completing the task. Our experiments demonstrate the feasibility of the proposed whole body motion framework for everyday object manipulation, but also illustrate the necessity for highly adaptive manipulation strategies that make better use of a robot’s perceptual capabilities.
KeywordsLearning from demonstration Dynamic motion primitives Whole body motion Everyday object manipulation Toyota HSR
We gratefully acknowledge the support by the b-it International Center for Information Technology. We would like to thank Sven Schneider for all useful discussions and insights.
- 4.Chen, N., Bayer, J., Urban, S., van der Smagt, P.: Efficient movement representation by embedding dynamic movement primitives in deep autoencoders. In: IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 434–440 (November 2015)Google Scholar
- 7.Karlsson, M., Robertsson, A., Johansson, R.: Autonomous interpretation of demonstrations for modification of dynamical movement primitives. In: Proceedings of 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 316–321 (2017)Google Scholar
- 8.Kirc̀anski, M.V., Boric, M.D.: Symbolic singular value decomposition for a PUMA robot and its application to a robot operation near singularities. Int. J. Robot. Res. 12(5), 460–472 (1993)Google Scholar
- 9.Kober, J., Peters, J.: reinforcement learning in robotics: a survey, pp. 579–610 (2012)Google Scholar
- 10.Lee, J.: A survey of robot learning from demonstrations for human-robot collaboration. https://arxiv.org/abs/1710.08789 (2017)
- 11.Lim, B., Ra, S., Park, F.C.: Movement Primitives, Principal Component Analysis, and the Efficient Generation of Natural Motions. In: Proceedings of the 2005 IEEE international conference on Robotics and Automation, pp. 4630–4635 (April 2005)Google Scholar
- 12.Lioutikov, R., Kroemer, O., Maeda, G., Peters, J.: Learning manipulation by sequencing motor primitives with a two-armed robot. In: Menegatti, E., Michael, N., Berns, K., Yamaguchi, H. (eds.) Intelligent Autonomous Systems 13. AISC, vol. 302, pp. 1601–1611. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-08338-4_115CrossRefGoogle Scholar
- 13.Liu, W., et al.: SSD: single shot multibox detector. CoRR. arXiv:1512.02325 (2015)
- 14.Matamoros, M., Rascon, C., Hart, J., Holz, D., Beek, L.: RoboCup@Home 2018: Rules and Regulations (2018). http://www.robocupathome.org/rules/2018_rulebook.pdf
- 16.Paraschos, A., Daniel, C., Peters, J., Neumann, G.: Probabilistic movement primitives. In: Proceedings of 26th International Conference on Neural Information Processing Systems, vol. 2, pp. 2616–2624 (2013)Google Scholar
- 17.Park, D.H., Hoffmann, H., Pastor, P., Schaal, S.: Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. In: Humanoids 2008–8th IEEE-RAS International Conference on Humanoid Robots, pp. 91–98 (December 2008)Google Scholar
- 19.Provan, G.: Diagnosing hybrid systems using consistency-based methods. In: 29th International Workshop Principles of Diagnosis DX 2018 (2018)Google Scholar