Skip to main content

Human Manipulation Segmentation and Characterization Based on Instantaneous Work

  • Conference paper
  • First Online:
Robot 2019: Fourth Iberian Robotics Conference (ROBOT 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1092))

Included in the following conference series:

  • 1330 Accesses

Abstract

This paper is related to the observation of human operator manipulating objects for teaching a robot to reproduce the action. Assuming the robotic system is equipped with basic manipulation skills, we focus here on the automatic segmentation of the observed manipulation, for extracting the relevant key frames in which the manipulation is best described. The segmentation method proposed is based on the instantaneous work, and presents the advantage of not depending on the force and pose sensing locations. The proposed approach is experimented with two different manipulation skills, sliding and folding, under different settings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The experiments were approved by a local Ethics Evaluation Committee.

  2. 2.

    http://codamotion.com/.

  3. 3.

    https://optoforce.com/.

References

  1. Almeida, D., Karayiannidis, Y.: Folding assembly by means of dual-arm robotic manipulation. In: IEEE ICRA, pp. 3987–3993, May 2016

    Google Scholar 

  2. Billard, A., Calinon, S., Dillmann, R., Schaal, S.: Robot Programming by Demonstration, pp. 1371–1394. Springer, Berlin (2008)

    Chapter  Google Scholar 

  3. Calinon, S.: Robot Programming by Demonstration. A Probabilistic Approach. EPFL Press, Lausanne (2009)

    Google Scholar 

  4. De Schutter, J., De Laet, T., Rutgeerts, J., Decré, W., Smits, R., Aertbeliën, E., Claes, K., Bruyninckx, H.: Constraint-based task specification and estimation for sensor-based robot systems in the presence of geometric uncertainty. Int. J. Robot. Res. 26, 433–455 (2007)

    Article  Google Scholar 

  5. Kormushev, P., Calinon, S., Caldwell, D.G.: Imitation learning of positional and force skills demonstrated via kinesthetic teaching and haptic input. Adv. Robot. 25(5), 581–603 (2011)

    Article  Google Scholar 

  6. Kovács, E.: Rotation about an arbitrary axis and reflection through an arbitrary plane. In: Annales Mathematicae et Informaticae, vol. 40, pp. 175–186, January 2012

    Google Scholar 

  7. Kragic, D., Gustafson, J., Karaoguz, H., Jensfelt, P., Krug, R.: Interactive, collaborative robots: challenges and opportunities. In: IJCAI-18, pp. 18–25 (2018)

    Google Scholar 

  8. Murray, R.M., Sastry, S.S., Zexiang, L.: A Mathematical Introduction to Robotic Manipulation, 1st edn. CRC Press, Boca Raton (1994)

    MATH  Google Scholar 

  9. Pedersen, M., Nalpantidis, L., Andersen, R., Schou, C., Bogh, S., Kruger, V., Madsen, O.: Robot skills for manufacturing: from concept to industrial deployment. Robot. Comput.-Integr. Manuf. 37, 282–291 (2016)

    Article  Google Scholar 

  10. Perez-D’Arpino, C., Shah, J.A.: C-learn: learning geometric constraints from demonstrations for multi-step manipulation in shared autonomy. In: IEEE ICRA, pp. 4058–4065, May 2017

    Google Scholar 

  11. Piperagkas, G.S., Mariolis, I., Ioannidis, D., Tzovaras, D.: Key-frame extraction with semantic graphs in assembly processes. IEEE Robot. Autom. Lett. 2(3), 1264–1271 (2017)

    Article  Google Scholar 

  12. Ureche, A.L.P., Umezawa, K., Nakamura, Y., Billard, A.: Task parameterization using continuous constraints extracted from human demonstrations. IEEE Trans. Rob. 31(6), 1458–1471 (2015)

    Article  Google Scholar 

  13. Villani, V., Pini, F., Leali, F., Secchi, C.: Survey on human-robot collaboration in industrial settings: safety, intuitive interfaces and applications. Mechatronics 55, 248–266 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

Supported by the Elkartek MALGUROB and the SARAFun project under the European Union’s Horizon 2020 research & innovation programme, grant agreement No. 644938. The authors would like to thank Dr. Pierre Barralon for the fruitfull discussions that led to the segmentation approach presented here.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anthony Remazeilles .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Remazeilles, A., Rasines, I., Fernandez, A., McIntyre, J. (2020). Human Manipulation Segmentation and Characterization Based on Instantaneous Work. In: Silva, M., Luís Lima, J., Reis, L., Sanfeliu, A., Tardioli, D. (eds) Robot 2019: Fourth Iberian Robotics Conference. ROBOT 2019. Advances in Intelligent Systems and Computing, vol 1092. Springer, Cham. https://doi.org/10.1007/978-3-030-35990-4_28

Download citation

Publish with us

Policies and ethics