Skip to main content
SpringerLink
Log in

Annotating Everyday Grasps in Action

  • Chapter
  • First Online:
Dance Notations and Robot Motion

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 111))

Abstract

Grasping has been well studied in the robotics and human subjects literature, and numerous taxonomies have been developed to capture the range of grasps employed in work settings or everyday life. But how completely do these taxonomies capture grasping actions that we see every day? In a study to classify all actions during a typical day, we found that single entries in an existing grasp taxonomy were insufficient, apparently capturing not one grasp, but many. When we investigated, we found that these seemingly different grasps could be distinguished by features related to the grasp in action, such as the intended motion, force, and stiffness. In collaboration with our subjects, we developed an annotation scheme for untrained annotators to use, which captured the differences we observed between grasping actions. This chapter describes our annotation scheme. We discuss parallels to and differences from Laban Movement Analysis, which has been long developed to capture motion and action, but does not focus on grasping. We also discuss parallels to impedance or operational space control, with the goal of moving from annotations to actionable robot control.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. C.L. MacKenzie, T. Iberall, The Grasping Hand, vol. 104 (Elsevier, Amsterdam, 1994)

    Google Scholar 

  2. N. Kamakura, M. Matsuo, H. Ishii, F. Mitsuboshi, Y. Miura, Patterns of static prehension in normal hands. Am. J. Occup. Ther. 34(7), 437–445 (1980)

    Article  Google Scholar 

  3. M.R Cutkosky, On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Int. Conf. Robot. Autom. (ICRA) 5(3):269–279 (1989)

    Google Scholar 

  4. D.J. Buckland, S.J. Edwards, J.D. McCoy-Powlen, Developmental and Functional Hand Grasps, 1st edn. (Slack Incorporated, 2002)

    Google Scholar 

  5. T. Feix, R. Pawlik, H. Schmiedmayer, J. Romero, D. Kragic, A comprehensive grasp taxonomy, in Robotics, Science and Systems: Workshop on Understanding the Human Hand for Advancing Robotic Manipulation, June 2009

    Google Scholar 

  6. S. Ekvall, D. Kragic, Grasp recognition for programming by demonstration, in IEEE International Conference on Robotics and Automation (ICRA) (IEEE, 2005), pp. 748–753

    Google Scholar 

  7. G. Heumer, H.B. Amor, M. Weber, B. Jung, Grasp recognition with uncalibrated data gloves—a comparison of classification methods, in IEEE Virtual Reality Conference, VR’07 (IEEE, 2007), pp. 19–26

    Google Scholar 

  8. A.M. Dolar, R.D. Howe, The highly adaptive SDM hand: design and performance evaluation. Int. J. Robot. Res. 29(5), 585–597 (2010)

    Article  Google Scholar 

  9. S. Bing Kang, K. Ikeuchi, Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps. IEEE Int. Conf. Robot. Autom. (ICRA) 13(1):81–95 (1997)

    Google Scholar 

  10. R. Wimmer, Grasp sensing for human-computer interaction, in Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (ACM, 2011), pp. 221–228

    Google Scholar 

  11. J. Newlove, J. Dalby, Laban for All (Routledge, 2003)

    Google Scholar 

  12. N. Hogan, Impedance control: an approach to manipulation: Part III: implementation. J. Dyn. Syst. Meas. Contr. 107(1), 8–16 (1985)

    Article  MATH  Google Scholar 

  13. O. Khatib, A unified approach for motion and force control of robot manipulators: the operational space formulation. IEEE Int. Conf. Robot. Autom. (ICRA) 3(1):43–53 (1987)

    Google Scholar 

  14. J. Liu, F. Feng, Y. Nakamura, N. Pollard, Grasp taxonomy in action online database: http://graphics.cs.cmu.edu/nsp/projects/graspDatabase/database.html (2014)

  15. J. Liu, F. Feng, Y. Nakamura, N. Pollard, A taxonomy of everyday grasps in action, in IEEE International Conference on Humanoid Robots (Humanoids 2014), November 2014

    Google Scholar 

  16. I.G. Schlesinger, Der mechanische aufbau der künstlichen glieder, in Ersatzglieder und Arbeitshilfen (Springer, Berlin, 1919), pp. 321–661

    Google Scholar 

  17. J.R. Napier, R. Tuttle, Hands (Princeton University Press, New Jersey, 1993)

    Google Scholar 

  18. I.A. Kapandji, L.H. Honoré. The Physiology of the Joints: Annotated Diagrams of the Mechanics of the Human Joints, vol. 1 (E.&S. Livingstone, London, 1970)

    Google Scholar 

  19. J.Z. Zheng, S. De La Rosa, A.M. Dollar, An investigation of grasp type and frequency in daily household and machine shop tasks, in IEEE International Conference on Robotics and Automation (ICRA) (IEEE, 2011), pp. 4169–4175

    Google Scholar 

  20. L.Y. Chang, N.S. Pollard, Video survey of pre-grasp interactions in natural hand activities, in Robotics: Science and Systems (RSS) 2009 Workshop on Understanding the Human Hand for Advancing Robotic Manipulation, June 2009

    Google Scholar 

  21. F. Worgotter, E.E. Aksoy, N. Kruger, J. Piater, A. Ude, M. Tamosiunaite, A simple ontology of manipulation actions based on hand-object relations. IEEE Trans. Auton. Mental Dev. 5(2):117–134 (2013)

    Google Scholar 

  22. J.M. Elliott, K.J. Connolly, A classification of manipulative hand movements. Dev. Med. Child Neurol. 26(3), 283–296 (1984)

    Article  Google Scholar 

  23. I.M. Bullock, R.R. Ma, A.M. Dollar, A hand-centric classification of human and robot dexterous manipulation. IEEE Trans. Haptics 6(2):129–144 (2013)

    Google Scholar 

  24. T. Torigoe, Comparison of object manipulation among 74 species of non-human primates. Primates 26(2), 182–194 (1985)

    Article  MathSciNet  Google Scholar 

  25. B. Kopp, A. Kunkel, H. Flor, T. Platz, U. Rose, K.-H. Mauritz, K. Gresser, K.L. McCulloch, E. Taub, The arm motor ability test: reliability, validity, and sensitivity to change of an instrument for assessing disabilities in activities of daily living. Arch. Phys. Med. Rehabil. 78(6):615–620 (1997)

    Google Scholar 

  26. C. Collin, D.T. Wade, S. Davies, V. Horne, The Barthel ADL index: a reliability study. Disabil. Rehabil. 10(2), 61–63 (1988)

    Google Scholar 

  27. J.M. Linacre, A.W. Heinemann, B.D. Wright, C.V. Granger, B.B. Hamilton, The structure and stability of the functional independence measure. Arch. Phys. Med. Rehabil. 75(2):127–132 (1994)

    Google Scholar 

  28. N. Pollock, M.A. McColl, A. Carswell, T. Sumsion, The Canadian occupational performance measure. Client-Centred Practice Occup. Ther. A Guide Implementation 103–114 (2006)

    Google Scholar 

  29. Y.S. Choi, T. Deyle, T. Chen, J.D. Glass, C.C. Kemp, A list of household objects for robotic retrieval prioritized by people with ALS, in IEEE International Conference on Rehabilitation Robotics, ICORR 2009 (IEEE, 2009), pp. 510–517

    Google Scholar 

  30. J.R. Napier, The prehensile movements of the human hand. J. Bone Joint Surg. 38(4):902–913 (1956)

    Google Scholar 

  31. A.A. Samadani, S. Burton, R. Gorbet, D. Kulic, Laban effort and shape analysis of affective hand and arm movements, in 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII) (IEEE, 2013), pp. 343–348

    Google Scholar 

Download references

Acknowledgement

This research was supported by NSF awards IIS-1218182 and IIS-1344361. We would like to thank Daniel Troniak and Michael Koval for many helpful comments, discussion and suggestions.

Author information

Authors and Affiliations

  1. School of Computer Science, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA, 15213, USA

    Jia Liu, Fangxiaoyu Feng, Yuzuko C. Nakamura & Nancy S. Pollard

Authors
  1. Jia Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fangxiaoyu Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuzuko C. Nakamura
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nancy S. Pollard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jia Liu .

Editor information

Editors and Affiliations

  1. LAAS-CNRS, Toulouse Cedex 4, France

    Jean-Paul Laumond

  2. LAAS-CNRS, Toulouse Cedex 4, France

    Naoko Abe

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Liu, J., Feng, F., Nakamura, Y.C., Pollard, N.S. (2016). Annotating Everyday Grasps in Action. In: Laumond, JP., Abe, N. (eds) Dance Notations and Robot Motion. Springer Tracts in Advanced Robotics, vol 111. Springer, Cham. https://doi.org/10.1007/978-3-319-25739-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25739-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25737-2

  • Online ISBN: 978-3-319-25739-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation