Skip to main content

Grasp-Pose Prediction for Hand-Held Objects

  • Conference paper
  • First Online:
Emerging Technology in Modelling and Graphics

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 937))

Abstract

Robotic grasp prediction of small objects is a recent challenge, incorporating concepts such as depth perception, geometric matching, deep feature-engineering, etc. However, the entirety of the existing literature focuses on the usage of simple two-fingered robotic hands to grasp handheld objects. Our paper promotes the use of five-fingered humanoid hands for better grasping and proposes a novel hand grasp-pose prediction model that learns features present in small objects to predict appropriate poses that can be assumed by the fingers of the robotic hand to facilitate complex grasp prediction, as observed in humans. We make use of the coil-100 dataset that comprises images of various handheld objects and employ a supervised learning mechanism to perform multi-label classification over a set of eight selected grasp-poses.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. T. Shin-ichi, M. Satoshi, Nipponia 13, 7 (2000)

    Google Scholar 

  2. L.R. Hochberg, D. Bacher, B. Jarosiewicz, N.Y. Masse, J.D. Simeral, J. Vogel, S. Haddadin, J. Liu, S.S. Cash, P. van der Smagt et al., Nature 485(7398), 372 (2012)

    Article  Google Scholar 

  3. M.T. Mason, J.K. Salisbury Jr, Compliance and force control for computer controlled manipulators. IEEE Trans. Syst. Man, Cybern. (1985)

    Google Scholar 

  4. A.T. Miller, S. Knoop, H.I. Christensen, P.K. Allen, in IEEE International Conference on Robotics and Automation. Proceedings, ICRA’03, vol. 2 (IEEE, 2003), pp. 1824–1829

    Google Scholar 

  5. A. Bicchi, V. Kumar, in ICRA, vol. 348 (Citeseer, 2000), p. 353

    Google Scholar 

  6. A. Reinhold, Category: victor scheinman (2013). https://commons.wikimedia.org/wiki/File:Scheinman_MIT_Arm.agr.jpg#filelinks

  7. D. Reid, Southampton remedi hand beats hollywood (2005). http://www.technovelgy.com/graphics/content05/southampton-remedi-hand2.jpg

  8. G.E. Hinton, R.R. Salakhutdinov, Science 313(5786), 504 (2006)

    Article  MathSciNet  Google Scholar 

  9. S. Hershey, S. Chaudhuri, D.P. Ellis, J.F. Gemmeke, A. Jansen, R.C. Moore, M. Plakal, D. Platt, R.A. Saurous, B. Seybold, et al., in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2017), pp. 131–135

    Google Scholar 

  10. W. Yin, H. Schütze, B. Xiang, B. Zhou, arXiv preprint arXiv:1512.05193 (2015)

  11. V. Lippiello, F. Ruggiero, B. Siciliano, L. Villani, IEEE/ASME Trans. Mechatron. 18(3), 1050 (2013)

    Article  Google Scholar 

  12. K. Lakshiminarayana, in ASME Paper, 78-DET-32 (1978)

    Google Scholar 

  13. V.D. Nguyen, in Proceedings of 1986 ACM Fall Joint Computer Conference (IEEE Computer Society Press, 1986), pp. 129–137

    Google Scholar 

  14. J. Ponce, D. Stam, B. Faverjon, Int. J. Robot. Res. 12(3), 263 (1993)

    Article  Google Scholar 

  15. A. Rodriguez, M.T. Mason, S. Ferry, Int. J. Robot. Res. 31(7), 886 (2012)

    Article  Google Scholar 

  16. M. Dogar, K. Hsiao, M. Ciocarlie, S. Srinivasa, Manipulator motion planning using flexible obstacle avoidance based on model learning. Int. J. Adv. Robot. Syst. (SAGE Publications Sage UK: London, England) (2012)

    Google Scholar 

  17. C. Goldfeder, M. Ciocarlie, H. Dang, P.K. Allen, in ICRA’09. IEEE International Conference on Robotics and Automation (IEEE, 2009), pp. 1710–1716

    Google Scholar 

  18. J. Weisz, P.K. Allen, in 2012 IEEE International Conference on Robotics and Automation (ICRA) (IEEE, 2012), pp. 557–562

    Google Scholar 

  19. F.T. Pokorny, Y. Bekiroglu, J. Exner, M. Björkman, D. Kragic, in RSS 2014 Workshop: Information-Based Grasp and Manipulation Planning, (2014)

    Google Scholar 

  20. J. Bohg, A. Morales, T. Asfour, D. Kragic, IEEE Trans. Robot. 30(2), 289 (2014)

    Article  Google Scholar 

  21. A. Collet, D. Berenson, S.S. Srinivasa, D. Ferguson, in IEEE International Conference on Robotics and Automation, ICRA’09 (IEEE, 2009), pp. 48–55

    Google Scholar 

  22. C. Papazov, S. Haddadin, S. Parusel, K. Krieger, D. Burschka, Int. J. Robot. Res. 31(4), 538 (2012)

    Article  Google Scholar 

  23. J.H. Piater, Learning visual features to predict hand orientations (2002)

    Google Scholar 

  24. D.L. Bowers, R. Lumia, IEEE Trans. Fuzzy Syst. 11(3), 320 (2003)

    Article  Google Scholar 

  25. A. Morales, P.J. Sanz, A.P. Del Pobil, in IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2 (IEEE, 2002), pp. 1711–1716

    Google Scholar 

  26. J. Maitin-Shepard, M. Cusumano-Towner, J. Lei, P. Abbeel, in 2010 IEEE International Conference on Robotics and Automation (ICRA) (IEEE, 2010), pp. 2308–2315

    Google Scholar 

  27. P. Viola, M. Jones, in Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1 (IEEE, 2001), p. I

    Google Scholar 

  28. H. Lee, R. Grosse, R. Ranganath, A.Y. Ng, in Proceedings of the 26th Annual International Conference on Machine Learning (ACM, 2009), pp. 609–616

    Google Scholar 

  29. R. Socher, B. Huval, B. Bath, C.D. Manning, A.Y. Ng, in Advances in Neural Information Processing Systems, (2012), pp. 656–664

    Google Scholar 

  30. J. Glover, D. Rus, N. Roy, in Proceedings of Robotics: Science and Systems IV (Zurich, Switzerland, 2008), pp. 278–285

    Google Scholar 

  31. R. Detry, E. Baseski, M. Popovic, Y. Touati, N. Kruger, O. Kroemer, J. Peters, J. Piater, in IEEE 8th International Conference on Development and Learning, ICDL 2009 (IEEE, 2009), pp. 1–7

    Google Scholar 

  32. H. Lee, P. Pham, Y. Largman, A.Y. Ng, in Advances in Neural Information Processing Systems, (2009), pp. 1096–1104

    Google Scholar 

  33. A.R. Mohamed, G.E. Dahl, G. Hinton et al., IEEE Trans. Audio Speech Lang. Process. 20(1), 14 (2012)

    Article  Google Scholar 

  34. R. Collobert, J. Weston, L. Bottou, M. Karlen, K. Kavukcuoglu, P. Kuksa, J. Mach. Learn. Res. 12(Aug), 2493 (2011)

    Google Scholar 

  35. M. Osadchy, Y.L. Cun, M.L. Miller, J. Mach. Learn. Res. 8(May), 1197 (2007)

    Google Scholar 

  36. Y. LeCun, F.J. Huang, L. Bottou, in Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2 (IEEE, 2004), pp. II–104

    Google Scholar 

  37. P. Duygulu, K. Barnard, J.F. de Freitas, D.A. Forsyth, in European Conference on Computer Vision (Springer, 2002), pp. 97–112

    Google Scholar 

  38. Y. Wei, W. Xia, J. Huang, B. Ni, J. Dong, Y. Zhao, S. Yan, arXiv preprint arXiv:1406.5726 (2014)

  39. J. Wang, Y. Yang, J. Mao, Z. Huang, C. Huang, W. Xu, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2285–2294 (2016)

    Google Scholar 

  40. A. Sharma, et al., in 2015 13th International Conference on Document Analysis and Recognition (ICDAR) (IEEE, 2015), pp. 986–990

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abhirup Das .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Das, A., Chattopadhyay, A., Alia, F., Kumari, J. (2020). Grasp-Pose Prediction for Hand-Held Objects. In: Mandal, J., Bhattacharya, D. (eds) Emerging Technology in Modelling and Graphics. Advances in Intelligent Systems and Computing, vol 937. Springer, Singapore. https://doi.org/10.1007/978-981-13-7403-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-7403-6_19

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-7402-9

  • Online ISBN: 978-981-13-7403-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics