Designing of a Natural Voice Assistants for Mobile Through User Centered Design Approach

  • Sanjay Ghosh
  • Jatin PherwaniEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9169)


With rapid advances in natural language generation (NLG), voice has now become an indispensable modality for interaction with smart phones. Most of the smart phone manufacturers have their Voice Assistant application designed with some form of personalization to enhance user experience. However, these designs are significantly different in terms of usage support, features, naturalness and personality of the voice assistant avatar or the character. Therefore the question remains that what is the kind of Voice Assistant that users would prefer. In this study we followed a User Centered Design approach for the design of a Voice Assistant from scratch. Our primary objective was to define the personality of a Voice Assistant Avatar and formulating a few design guidelines for natural dialogues and expressions for the same. The attempt was kept to design the voice assistant avatar with optimal natural or human like aspects and behavior. This paper provides a summary of our journey and details of the methodology used in realizing the design of a natural voice assistant. As research contribution, apart from the methodology we also share some of the guidelines and design decisions which may be very useful for related research.


Voice assistant Conversational agent User centered design 


  1. 1.
    Breese, J., Ball, G.: Modeling emotional state and personality for conversational agents. Rapport technique MSR-TR-98-41, Microsoft research (1998)Google Scholar
  2. 2.
    Norman, D.: How might humans interact with robots.  Keynote address to the DARPA-NSF Workshop on Human-Robot Interaction, San Luis Obispo, CA (2001)Google Scholar
  3. 3.
    Ball, G., Breese, J.: Emotion and personality in a conversational agent. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 189–219. MIT Press, Cambridge (2000)Google Scholar
  4. 4.
    Torrey, C., Fussell, S.R., Kiesler, S.: How a robot should give advice. In: 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 275–282. IEEE (2013)Google Scholar
  5. 5.
    Meerbeek, B., Hoonhout, J., Bingley, P., Terken, J.: Investigating the relationship between the personality of a robotic TV assistant and the level of user control. In: The 15th IEEE International Symposium on Robot and Human Interactive Communication, ROMAN 2006, pp. 404–410. IEEE (2006)Google Scholar
  6. 6.
    Heylighen, F., Dewaele, J.-M.: Formality of language: definition, measurement and behavioral determinants. Interner Bericht, Center “Leo Apostel”, Vrije Universiteit Brüssel (1999)Google Scholar
  7. 7.
    Becker, C., Kopp, S., Wachsmuth, I.: Why emotions should be integrated into conversational agents. In: Conversational Informatics: An Engineering Approach, pp. 49–68 (2007)Google Scholar
  8. 8.
    Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161 (1980)CrossRefGoogle Scholar
  9. 9.
    Dryer, D.C.: Getting personal with computers: how to design personalities for agents. Appl. Artif. Intell. 13(3), 273–295 (1999)CrossRefGoogle Scholar
  10. 10.
    Costa, P.T., MacCrae, R.R.: Revised NEO Personality Inventory (NEO PI-R) and NEO Five-Factor Inventory (NEO FFI): Professional Manual. Psychological Assessment Resources (1992)Google Scholar
  11. 11.
    Pennebaker, J.W., King, L.A.: Linguistic styles: language use as an individual difference. J. Pers. Soc. Psychol. 77(6), 1296 (1999)CrossRefGoogle Scholar
  12. 12.
    Cowie, R., Cornelius, R.R.: Describing the emotional states that are expressed in speech. Speech Commun. 40(1), 5–32 (2003)CrossRefGoogle Scholar
  13. 13.
    Brown, P.: Politeness: Some Universals in Language Usage, vol. 4. Cambridge University Press, Cambridge (1987)Google Scholar
  14. 14.
    Cassell, J., Vilhjálmsson, H.: Fully embodied conversational avatars: making communicative behaviors autonomous. Auton. Agent. Multi-Agent Syst. 2(1), 45–64 (1999)CrossRefGoogle Scholar
  15. 15.
    Ball, G., Breese, J.: Relating personality and behavior: posture and gestures. In: Paiva, Ana C.R. (ed.) IWAI 1999. LNCS, vol. 1814, pp. 196–203. Springer, Heidelberg (2000)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Samsung R&D InstituteBangaloreIndia

Personalised recommendations