Skip to main content

Intuitive Industrial Robot Programming Interface with Augmented Reality Environment

  • Chapter
  • First Online:
Book cover Robotics: Industry 4.0 Issues & New Intelligent Control Paradigms

Part of the book series: Studies in Systems, Decision and Control ((SSDC,volume 272))

  • 1397 Accesses

Abstract

The integration costs of industrial robots into small medium-sized enterprises (SMEs) are nowadays one of the main obstacles, to make automated solutions in this sector profitable. An essential role plays the human-robot interface (HRI), which is in robots standard implementation for averagely trained technicians overly complicated and time consuming. A new intuitive HRI, based on augmented reality, is presented to shorten programming phase during in commissioning of robot cells in the production line. The proposed system was implemented on a portable computer with a head-mounted camera and wearable display for the operator. In demonstrative scenery was with the presented hardware setup shown, how basic visualization and simulation functionalities and intuitive programming procedures of industrial robots in the AR environment could be implemented. In addition to the trajectory visualization in an AR environment, the robot’s gripper pose simulation was shown, as it would be visible in operators’ field of view. With the usage of a 6D camera tracked AR-Stylus, combined with the projection of the robots’ gripper 3D model in the AR environment, an elevated level of operator integration into AR environment can be achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Petterson, T., Pretlove, J., Scorub, C., Engedal, T., Lokstad, T.: Augmented reality for programming industrial robots. In: The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings, pp. 319–320 (2006)

    Google Scholar 

  2. Akan, B., Ameri, A., Curuklu, B., Asplund, L.: Intuitive industrial robot programming through incremental multimodal language and augmented reality. In: IEEE International Conference on Robotics and Automation (2011)

    Google Scholar 

  3. Olwall, A., Gustafsson, J., Lindfors, C.: Spacial augmented reality on industrial CNC-machines. In: Proceedings of SPIE, vol. 6804, pp. 680409-1–680409-9 (2008)

    Google Scholar 

  4. Fang, H., Ong, S.K., Nee, A.Y.-C.: Robot programming using augmented reality. In: IEEE, Sept (2009)

    Google Scholar 

  5. Marin, R., Sanz, P., Sanchez, J.: A very high level interface to teleoperate a robot via web including augmented reality. In: IEEE International Conference on Robotics and Automation (Cat. No. 02CH37292). Proceedings (2002)

    Google Scholar 

  6. Jara, C.A., Candelas, F.A., Gil, P., Fernandez, M., Torres, F.: An augmented reality interface for training robotics through the web. Communication, pp. 189–194 (2005)

    Google Scholar 

  7. Po, C.-W., Wang, R., Kin, K., Twigg, C., Han., S., Yang, M.-H., Chien, S.-Y.: Accurate 6Dof tracking of a passive stylus. In: The 30th Annual ACM Symposium on user Interface Software and Technology, Proceedings, pp. 365–374 (2017)

    Google Scholar 

  8. Siciliano, B., Khatib, O.: Springer Handbook of Robotics. Springer, Heidelberg (2008)

    Book  Google Scholar 

  9. OpenCV 2.4.13.7 documentation page. https://docs.opencv.org/2.4. Last accessed 15 Apr 2019

  10. Yuschenko, A.S.: Man and robot—ergonomic problems of collaborative robotics. In: World of psychology, pp. 86–102 (2018)

    Google Scholar 

Download references

Acknowledgements

This work is financially supported by RFBR, project No. 18-07-0131. I would also like to express my gratitude to FKS-Maschinenbau GmbH for the great support in making the experimental setup possible.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexander Schwandt .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Schwandt, A., Yuschenko, A. (2020). Intuitive Industrial Robot Programming Interface with Augmented Reality Environment. In: Kravets, A. (eds) Robotics: Industry 4.0 Issues & New Intelligent Control Paradigms. Studies in Systems, Decision and Control, vol 272. Springer, Cham. https://doi.org/10.1007/978-3-030-37841-7_19

Download citation

Publish with us

Policies and ethics