Skip to main content
SpringerLink
Log in

Voice Controlled Multi-robot System for Collaborative Task Achievement

  • Conference paper
  • First Online:
Robot Intelligence Technology and Applications 5 (RiTA 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 751))

Abstract

This paper describes a framework for machine cooperation and interaction designed to promote collaborative work with humans in a natural and flexible manner. More specifically, we propose a system where all the interactions with the robots are achieved through voice using Alexa Voice Service (AVS). Besides the implementation of a voice interface channel, we develop a navigation module that enables a robot to autonomously navigate through a map to reach a specific destination while avoiding obstacles. We provide the system with the ability to choose and operate the appropriate robot in context of multi-robot cooperation for task achievement. In addition, a user can intervene during the process of executing a relatively complex task by interacting with the robots via voice commands. To validate the proposed framework, we conduct experiments to quantify the performance during cooperative action involving the human and the system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Pyo, Y., Nakashima, K., Kuwahata, S., Kurazume, R., Tsuji, T., Morooka, K.I., Hasegawa, T.: Service robot system with an informationally structured environment. Robot. Auton. Syst. 74, 148–165 (2015)

    Article  Google Scholar 

  2. Yan, Z., Jouandeau, N., Cherif, A.A.: A survey and analysis of multi-robot coordination. Int. J. Adv. Robot. Syst. 10(12), 399 (2013)

    Article  Google Scholar 

  3. Gautam, A., Mohan, S.: A review of research in multi-robot systems. In: 2012 7th IEEE International Conference on Industrial and Information Systems (ICIIS), pp. 1–5. IEEE (2012)

    Google Scholar 

  4. Laengle, T., Lueth, T.C.: Decentralized control of distributed intelligent robots and subsystems. Annu. Rev. Autom. Program. 19, 281–286 (1994)

    Article  Google Scholar 

  5. Roumeliotis, S.I., Bekey, G.A.: Distributed multirobot localization. IEEE Trans. Robot. Autom. 18(5), 781–795 (2002)

    Article  Google Scholar 

  6. Martinelli, A., Pont, F., Siegwart, R.: Multi-robot localization using relative observations. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005, pp. 2797–2802. IEEE (2005)

    Google Scholar 

  7. Rekleitis, I., Dudek, G., Milios, E.: Multi-robot collaboration for robust exploration. Ann. Math. Artif. Intell. 31(1–4), 7–40 (2001)

    Article  Google Scholar 

  8. Yan, Z., Jouandeau, N., Cherif, A.A.: Multi-robot decentralized exploration using a trade-based approach. In: Proceedings of ICINCO (2), pp. 99–105 (2011)

    Google Scholar 

  9. Andre, T., Bettstetter, C.: Collaboration in multi-robot exploration: to meet or not to meet? J. Intell. Robot. Syst. 82(2), 325 (2016)

    Article  Google Scholar 

  10. Jennings, J.S., Whelan, G., Evans, W.F.: Cooperative search and rescue with a team of mobile robots. In: Proceedings of 8th International Conference on Advanced Robotics 1997, ICAR’97, pp. 193–200. IEEE (1997)

    Google Scholar 

  11. Dadgar, M., Jafari, S., Hamzeh, A.: A PSO-based multi-robot cooperation method for target searching in unknown environments. Neurocomputing 177, 62–74 (2016)

    Article  Google Scholar 

  12. Alami, R., Fleury, S., Herrb, M., Ingrand, F., Robert, F.: Multi-robot cooperation in the MARTHA project. IEEE Robot. Autom. Mag. 5(1), 36–47 (1998)

    Article  Google Scholar 

  13. Kube, C.R., Bonabeau, E.: Cooperative transport by ants and robots. Robot. Auton. Syst. 30(1), 85–101 (2000)

    Article  Google Scholar 

  14. Farinelli, A., Zanotto, E., Pagello, E.: Advanced approaches for multi-robot coordination in logistic scenarios. Robot. Auton. Syst. 90, 34–44 (2017)

    Article  Google Scholar 

  15. Spiliotopoulos, D., Androutsopoulos, I., Spyropoulos, C.D.: Human-robot interaction based on spoken natural language dialogue. In: Proceedings of the European Workshop on Service and Humanoid Robots, pp. 25–27 (2001)

    Google Scholar 

  16. Toptsis, I., Li, S., Wrede, B., Fink, G.A.: A multi-modal dialog system for a mobile robot. In: Eighth International Conference on Spoken Language Processing (2004)

    Google Scholar 

  17. Drygajlo, A., Prodanov, P.J., Ramel, G., Meisser, M., Siegwart, R.: On developing a voice-enabled interface for interactive tour-guide robots. Adv. Robot. 17(7), 599–616 (2003)

    Article  Google Scholar 

  18. Imam, A.T., Al-Rousan, T., Odeh, A.: Developing of natural language interface to robot-an Arabic language case study. Comput. Softw. 1256 (2014)

    Google Scholar 

  19. Han, J., Jo, M., Park, S., Kim, S.: The educational use of home robots for children. In: IEEE International Workshop on Robot and Human Interactive Communication, 2005, ROMAN 2005, pp. 378–383. IEEE (2005)

    Google Scholar 

  20. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Ng, A.Y.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3, no. 3.2, p. 5 (2009)

    Google Scholar 

  21. Developer.amazon.com.: Alexa. https://developer.amazon.com/alexa (2017). Accessed 2 Sept 2017

  22. Developer.amazon.com.: Alexa voice service. https://developer.amazon.com/alexa-voice-service (2017). Accessed 2 Sept 2017

  23. Developer.amazon.com.: Alexa skills kit—build for voice with amazon. https://developer.amazon.com/alexa-skills-kit (2017). Accessed 2 Sept 2017

  24. Fernández-Madrigal, J.A. (ed.): Simultaneous Localization and Mapping for Mobile Robots: Introduction and Methods: Introduction and Methods. IGI Global

    Google Scholar 

  25. Huang, S., Dissanayake, G.: Convergence and consistency analysis for extended Kalman filter based SLAM. IEEE Trans. Robot. 23(5), 1036–1049 (2007)

    Article  Google Scholar 

  26. Grisetti, G., Stachniss, C., Burgard, W.: Improved techniques for grid mapping with rao-blackwellized particle filters. IEEE Trans. Robot. 23(1), 34–46 (2007)

    Article  Google Scholar 

  27. Grisettiyz, G., Stachniss, C., Burgard, W.: Improving grid-based slam with Rao-Blackwellized particle filters by adaptive proposals and selective resampling. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005, ICRA 2005, pp. 2432–2437. IEEE (2005)

    Google Scholar 

  28. Thrun, S., Burgard, W., Fox, D.: Probabilistic Robotics. Curriculum Vitae (2005)

    Google Scholar 

  29. Fox, D., Burgard, W., Dellaert, F., Thrun, S.: Monte carlo localization: efficient position estimation for mobile robots. In: Proceedings of AAAI/IAAI, vol. 1999, no. 343–349, pp. 2–2 (1999)

    Google Scholar 

  30. Wiki.ros.org.: amcl—ROS Wiki. http://wiki.ros.org/amcl (2017). Accessed 9 Sept 2017

  31. Li, T., Sun, S., Duan, J.: Monte Carlo localization for mobile robot using adaptive particle merging and splitting technique. In: 2010 IEEE International Conference on Information and Automation (ICIA), pp. 1913–1918. IEEE (2010)

    Google Scholar 

  32. Marder-Eppstein, E., Berger, E., Foote, T., Gerkey, B., Konolige, K.: The office marathon: robust navigation in an indoor office environment. In: 2010 IEEE International Conference on Robotics and Automation (ICRA), pp. 300–307. IEEE (2010)

    Google Scholar 

  33. Zheng, K.: ROS navigation tuning guide (2017). arXiv:1706.09068

Download references

Author information

Authors and Affiliations

  1. Pattern Analysis and Machine Intelligence (PAMI) Research Group, Electrical and Computer Engineering Department, University of Waterloo, Waterloo, ON, Canada

    Chahid Ouali & Fakhri Karray

  2. University of Science and Technology, Zewail City, 6th of October, 12588, Egypt

    Mahmoud M. Nasr & Mahmoud A. M. AbdelGalil

Authors
  1. Chahid Ouali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mahmoud M. Nasr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahmoud A. M. AbdelGalil
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fakhri Karray
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chahid Ouali .

Editor information

Editors and Affiliations

  1. School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Jong-Hwan Kim

  2. Department of Civil and Environmental Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Hyun Myung

  3. School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Junmo Kim

  4. Department of Mechanical Engineering, The University of Auckland, Auckland, New Zealand

    Weiliang Xu

  5. Department of Computer and Information Technology, Purdue University, West Lafayette, Indiana, USA

    Eric T Matson

  6. Department of Computer Science and Engineering, Dongguk University, Seoul, Korea (Republic of)

    Jin-Woo Jung

  7. Department of Aerospace Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Han-Lim Choi

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ouali, C., Nasr, M.M., AbdelGalil, M.A.M., Karray, F. (2019). Voice Controlled Multi-robot System for Collaborative Task Achievement. In: Kim, JH., et al. Robot Intelligence Technology and Applications 5. RiTA 2017. Advances in Intelligent Systems and Computing, vol 751. Springer, Cham. https://doi.org/10.1007/978-3-319-78452-6_29

Download citation

Publish with us

Policies and ethics

Search

Navigation