Skip to main content

Web-Based Human Robot Interaction via Live Video Streaming and Voice

  • Conference paper
  • First Online:
  • 5515 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10462))

Abstract

Human-robot interaction (HRI) becomes one of the new technology coming into people’s sight in recent years. A natural way to interact with robots is crucial in creating more intelligent robots. This paper shows a novel way to control and communicate with robots by monitoring live video captured from camera and doing voice interaction on web. Control commands from web are sent to control robots via Robot Operating System (ROS). The HRI process relies totally on web, users can interact with robots as long as they can connect to the wi-fi shared by robots.

This research was partially supported by the National Natural Science Foundation of China under Grant No. 61473038.

This is a preview of subscription content, log in via an institution.

References

  1. Kosuge, K., Hirata, Y.: Human-robot interaction. In: IEEE International Conference on Robotics and Biomimetics, ROBIO, pp. 8–11. IEEE (2004)

    Google Scholar 

  2. Gallardo-Estrella, L., Poncela, A.: Human/robot interface for voice teleoperation of a robotic platform. Lect. Notes Comput. Sci. 6691, 240–247 (2011)

    Article  Google Scholar 

  3. Ido, J., Takemura, K., Matsumoto, Y., Ogasawara, T.: Robotic receptionist aska: a research platform for human-robot interaction. In: 11th IEEE International Workshop on Robot and Human Interactive Communication, Proceedings, pp. 306–311 (2002)

    Google Scholar 

  4. Du, G.L., Zhang, P., Yang, L.Y., Su, Y.B.: Robot teleoperation using a vision-based manipulation method. In: International Conference on Audio Language and Image Processing, pp. 945–949 (2010)

    Google Scholar 

  5. Rai, R.: Socket. IO Real-Time Web Application Development. Packt Publishing Ltd., Mumbai (2013)

    Google Scholar 

  6. Johnston, A.B., Burnett, D.C.: WebRTC: APIs and RTCWEB protocols of the HTML5 real-time web. Digital Codex LLC (2012)

    Google Scholar 

  7. Ephraim, Y., Malah, D.: Speech enhancement using a minimum mean-square error log-spectral amplitude estimator. IEEE Trans. Acoust. Speech Signal Process. 33(2), 443–445 (1985)

    Article  Google Scholar 

  8. Zhang, Y., Liu, Y.: An improved MMSE-LSA speech enhancement algorithm based on human auditory masking property. In: 2013 International Conference on Asian Language Processing, pp. 151–154. IEEE (2013)

    Google Scholar 

  9. Benesty, J., Amand, F., Gilloire, A., Grenier, Y.: Adaptive filtering algorithms for stereophonic acoustic echo cancellation, vol. 5, no. 5, pp. 3099–3102 (1995)

    Google Scholar 

  10. Gilloire, A., Vetterli, M.: Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation. IEEE Trans. Signal Process. 40(8), 1862–1875 (1992)

    Article  MATH  Google Scholar 

  11. Wikipedia, Least mean squares filter – wikipedia, the free encyclopedia (2017). https://en.wikipedia.org/w/index.php?title=Least_mean_squares_filter&oldid=782836501

  12. Paleologu, C., Ciochină, S., Benesty, J., Grant, S.L.: An overview on optimized NLMS algorithms for acoustic echo cancellation. EURASIP J. Adv. Signal Process. 2015(1), 1 (2015)

    Article  Google Scholar 

  13. Xu, Y., Song, Y., Long, Y.-H., Zhong, H.-B., Dai, L.-R.: The description of iFlyTek speech lab system for NIST2009 language recognition evaluation. In: 7th International Symposium on Chinese Spoken Language Processing, pp. 157–161. IEEE (2010)

    Google Scholar 

  14. Lu, J., Miao, H.-T.: Applying cool edit Pro in EFL speaking and listening teaching research. Comput. Assist. Foreign Lang. Educ. Chin. 2, 82–97 (2008)

    Google Scholar 

  15. Poncela, A., Gallardo-Estrella, L.: Command-based voice teleoperation of a mobile robot via a human-robot interface. Robotica 33(1), 1–18 (2014)

    Article  Google Scholar 

  16. Cousins, S.: Welcome to ROS topics [ROS topics]. IEEE Rob. Autom. Mag. 17(1), 13–14 (2010)

    Article  Google Scholar 

  17. Castro, J.D.: Arch linux. In: Introducing Linux Distros, pp. 235–252. Springer, New York (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hongbin Ma .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Shi, J., Ma, H., Zhao, J., Liu, Y. (2017). Web-Based Human Robot Interaction via Live Video Streaming and Voice. In: Huang, Y., Wu, H., Liu, H., Yin, Z. (eds) Intelligent Robotics and Applications. ICIRA 2017. Lecture Notes in Computer Science(), vol 10462. Springer, Cham. https://doi.org/10.1007/978-3-319-65289-4_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65289-4_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65288-7

  • Online ISBN: 978-3-319-65289-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics