Skip to main content

Intelligent Voice Agent and Service (iVAS) for Interactive and Multimodal Question and Answers

  • Conference paper
  • First Online:
Flexible Query Answering Systems (FQAS 2019)

Abstract

This paper describes MITRE’s Intelligent Voice Agent and Service (iVAS) research and prototype system that provides personalized answers to government customer service questions through intelligent and multimodal interactions with citizens. We report our novel approach to interpret a user’s voice or text query through Natural Language Understanding combined with a Machine Learning model trained on domain-specific data and interactive conversations to disambiguate and confirm user intent. We also describe the integration of iVAS with voice or text chatbot interface.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Herman, J.: U.S. federal AI virtual assistant pilot. In: Presentations Made at the U.S. General Services Administration Emerging Citizen Technology Program, Washington, D.C, 17 May 2017

    Google Scholar 

  • Hendry, J.: DHS attempts most ambitious Microsoft digital assistant build yet, ITNews, 29 March 2019. https://www.itnews.com.au/news/dhs-attempts-most-ambitious-microsoft-digital-assistant-build-yet-523101

  • Saon, G., et al.: English conversational telephone speech recognition by humans and machines, [cs.CL], 6 March 2017. arXiv:1703.02136v1

  • Xiong, W., et al.: Achieving human parity in conversational speech recognition (2016). arXiv:1610.05256

  • Park, D.S., et al.: Specaugment: a simple data augmentation method for automatic speech recognition, 18 April 2019. arXiv:1904.08779

  • Dai, A., Le, Q.: Semi-supervised sequence learning. In: Advances in Neural Information Processing (NIPS) (2015)

    Google Scholar 

  • Hu, Q., Lockett, J., et al.: Automated call classification and routing with speech technology and artificial intelligence. In: SpeechTek Conference, Washington DC, USA (2019)

    Google Scholar 

  • Sarma, P.K., Liang, Y., Sethares, W.A.: Domain adapted word embeddings for improved sentiment classification. In Proceedings of the Workshop on Deep Learning Approaches for Low-Resource NLP, pp. 51–59, Melbourne, Australia, 19 July 2018. c 2018 Association for Computational Linguistics

    Google Scholar 

  • Pennington, J., Socher, R., Manning, C.D.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, pp. 1532–1543, 25-29 October 2014. c 2014 Association for Computational Linguistics

    Google Scholar 

  • Peters, M., et al.: Deep contextualized word representations. In: NAACL (2018)

    Google Scholar 

  • Radford, A., Narasimhan, K., Salimans, T., Sutskever, I.: Improving language understanding with unsupervised learning, Technical report (2018). OpenAI

    Google Scholar 

  • Howard, J., Ruder, S.: Universal language model fine-tuning for text classification. In: ACL. Association for Computational Linguistics (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Qian Hu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lockett, J. et al. (2019). Intelligent Voice Agent and Service (iVAS) for Interactive and Multimodal Question and Answers. In: Cuzzocrea, A., Greco, S., Larsen, H., Saccà, D., Andreasen, T., Christiansen, H. (eds) Flexible Query Answering Systems. FQAS 2019. Lecture Notes in Computer Science(), vol 11529. Springer, Cham. https://doi.org/10.1007/978-3-030-27629-4_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-27629-4_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-27628-7

  • Online ISBN: 978-3-030-27629-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics