Abstract
Voice Assistants, and particularly the latest gadgets called smart speakers, allow end users to interact with applications by means of voice commands. As usual, end users are able to install applications (also called skills) that are available in repositories and fulfill multiple purposes. In this work we present an end-user environment to define skills for voice assistants based on the extraction of Web content and their organization into different voice navigation patterns. We describe the approach, the end-user development environment, and finally we present some case studies based on Alexa and Amazon Echo.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Siri, https://www.apple.com/es/siri/, last accessed 3/14/2019.
- 2.
Alexa skill repository: https://www.amazon.com/alexa-skills/b?ie=UTF8&node=13727921011, accessed February 20th 2019.
References
Zhang, N., Mi, X., Feng, X., Wang, X., Tian, Y., Qian, F.: Understanding and mitigating the security risks of voice-controlled third-party skills on amazon alexa and google home. arXiv preprint arXiv:1805.01525 (2018)
IFTTT and Amazon Alexa. https://ifttt.com/amazon_alexa. Accessed 13 Mar 2019
Rajalakshmi, A., Shahnasser, H.: Internet of Things using node-red and alexa. In: 2017 17th International Symposium on Communications and Information Technologies (ISCIT), pp. 1–4. IEEE, September 2017
Brambilla, M., Cabot, J., Wimmer, M.: Model-driven software engineering in practice. Synthesis Lect. Softw. Eng. 3(1), 1–207 (2017)
Elouali, N., Rouillard, J., Le Pallec, X., Tarby, J.C.: Multimodal interaction: a survey from model driven engineering and mobile perspectives. J. Multimodal User Interfaces 7(4), 351–370 (2013)
Licklider, J.C.R.: Man-computer symbiosis. IRE Trans. Hum. Factors Electron. 1, 4–11 (1960)
Cassell, J., et al.: Embodiment in conversational interfaces: rea. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 520–527. ACM, May 1999
Kadous, M.W., Sammut, C.: InCA: a mobile conversational agent. In: Zhang, C., W. Guesgen, H., Yeap, W.-K. (eds.) PRICAI 2004. LNCS (LNAI), vol. 3157, pp. 644–653. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-28633-2_68
White, R.W.: Skill discovery in virtual assistants. Commun. ACM 61(11), 106–113 (2018)
Bentley, F., Luvogt, C., Silverman, M., Wirasinghe, R., White, B., Lottrjdge, D.: Understanding the long-term use of smart speaker assistants. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 2(3), 91 (2018)
Kurniawati, E., Celetto, L., Capovilla, N., George, S.: Personalized voice command systems in multi modal user interface. In: 2012 IEEE International Conference on Emerging Signal Processing Applications, pp. 45–47. IEEE, January 2012
Ferrara, E., De Meo, P., Fiumara, G., Baumgartner, R.: Web data extraction, applications and techniques: a survey. Knowl. Based Syst. 70, 301–323 (2014)
Khare, R., Çelik, T.: Microformats: a pragmatic path to the semantic web. In: Proceedings of the 15th International Conference on WWW, pp. 865–866. ACM, May 2006
Bizer, C., Eckert, K., Meusel, R., Mühleisen, H., Schuhmacher, M., Völker, J.: Deployment of RDFa, microdata, and microformats on the web – a quantitative analysis. In: Alani, H., et al. (eds.) ISWC 2013. LNCS, vol. 8219, pp. 17–32. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41338-4_2
Van Kleek, M., Moore, B., Karger, D.R., André, P.: Atomate it! end-user context-sensitive automation using heterogeneous information sources on the web. In: Proceedings of the 19th International Conference on World Wide Web, pp. 951–960. ACM, April 2010
Ennals, R., Garofalakis, M.M.: Mashups for the masses (demo paper). In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data (SIGMOD 2007) (2007)
Firmenich, S., Bosetti, G., Rossi, G., Winckler, M.: End-user software engineering for the personal web. In: 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), pp. 216–218. IEEE, May 2017
Bosetti, G., Firmenich, S., Fernandez, A., Winckler, M., Rossi, G.: From search engines to augmented search services: an end-user development approach. In: Cabot, J., De Virgilio, R., Torlone, R. (eds.) ICWE 2017. LNCS, vol. 10360, pp. 115–133. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60131-1_7
Firmenich, S., Bosetti, G., Rossi, G., Winckler, M., Barbieri, T.: Abstracting and structuring web contents for supporting personal web experiences. In: Bozzon, A., Cudre-Maroux, P., Pautasso, C. (eds.) ICWE 2016. LNCS, vol. 9671, pp. 77–95. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-38791-8_5
Ko, A.J., et al.: The state of the art in end-user software engineering. ACM Comput. Surv. (CSUR) 43(3), 21 (2011)
Aldalur, I., Diaz, O.: Addressing web locator fragility: a case for browser extensions. In: Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 45–50. ACM, June 2017
Aldalur, I., Winckler, M., Díaz, O., Palanque, P.: Web augmentation as a promising technology for end user development. In: Paternò, F., Wulf, V. (eds.) New Perspectives in End-User Development, pp. 433–459. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60291-2_17
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ripa, G., Torre, M., Firmenich, S., Rossi, G. (2019). End-User Development of Voice User Interfaces Based on Web Content. In: Malizia, A., Valtolina, S., Morch, A., Serrano, A., Stratton, A. (eds) End-User Development. IS-EUD 2019. Lecture Notes in Computer Science(), vol 11553. Springer, Cham. https://doi.org/10.1007/978-3-030-24781-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-24781-2_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24780-5
Online ISBN: 978-3-030-24781-2
eBook Packages: Computer ScienceComputer Science (R0)