Enhancing Emotional Effectiveness of Virtual-Reality Experiences with Voice Control Interfaces

  • Hunter OskingEmail author
  • John A. Doucette
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1044)


Virtual Reality (VR) systems are becoming widespread, and can create deeply immersive experiences. Although the visual component of VR systems mimics the user’s presence in virtual spaces, dialogue control systems used in VR experiences are often adapted from older media. When selecting dialogue, older systems can break the illusion of presence in the virtual space, which is particularly jarring in interactive narratives. Using a voice control dialogue system may preserve this illusion and therefore enhance the emotional impact of narrative experiences. We evaluate this hypothesis on participants playing the same game that were assigned to use either a voice recognition or a more traditional point-and-click style interface. We find that the use of voice control with VR enhances the game’s emotional impact and users’ perceived enjoyment, as measured through a post-experiment survey instrument. We also present interesting qualitative results from interviews with participants. Our findings suggest that incorporating voice control into interactive VR narratives could improve their appeal for both consumer markets and psychological applications.


Virtual reality Interfaces Video games 


  1. 1.
    Ahn, S.J., Bostick, J., Ogle, E., Nowak, K.L., McGillicuddy, K.T., Bailenson, J.N.: Experiencing nature: embodying animals in immersive virtual environments increases inclusion of nature in self and involvement with nature. J. Comput. Mediat. Commun. 21(6), 399–419 (2016)CrossRefGoogle Scholar
  2. 2.
    Articy Software GmbH & Co.: Articy: draft the professional game design solution. Accessed 15 April 2019
  3. 3.
    Bowman, D.A., McMahan, R.P.: Virtual reality: how much immersion is enough? Computer 40(7), 36–43 (2007)CrossRefGoogle Scholar
  4. 4.
    Carey, K., Saltz, E., Rosenbloom, J., Micheli, M., Choi, J.O., Hammer, J.: Toward measuring empathy in virtual reality. In: Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, pp. 551–559. ACM (2017)Google Scholar
  5. 5.
    Diemer, J., Alpers, G.W., Peperkorn, H.M., Shiban, Y., Mühlberger, A.: The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front. Psychol. 6, 26 (2015)CrossRefGoogle Scholar
  6. 6.
    Dow, S., Mehta, M., Harmon, E., MacIntyre, B., Mateas, M.: Presence and engagement in an interactive drama. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1475–1484. ACM (2007)Google Scholar
  7. 7.
    El-Nasr, M.S., Milam, D., Maygoli, T.: Experiencing interactive narrative: a qualitative analysis of façade. Entertain. Comput. 4(1), 39–52 (2013)CrossRefGoogle Scholar
  8. 8.
    Fang, Y.M., Chen, K.M., Huang, Y.J.: Emotional reactions of different interface formats: comparing digital and traditional board games. Adv. Mech. Eng. 8(3), 1687814016641902 (2016)CrossRefGoogle Scholar
  9. 9.
    Lee, J., Kim, M., Kim, J.: A study on immersion and VR sickness in walking interaction for immersive virtual reality applications. Symmetry 9(5), 78 (2017)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Mateas, M., Stern, A.: Façade: an experiment in building a fully-realized interactive drama. In: Game Developers Conference, vol. 2, pp. 4–8 (2003)Google Scholar
  11. 11.
    Oculus VR Inc.: Oculus rift overview. Accesses 15 April 2019
  12. 12.
    Riva, G.: Affective interactions using virtual reality: the link between presence and emotions. CyberPsychol. Behav. 10(1), 45–56 (2007)CrossRefGoogle Scholar
  13. 13.
    Roth, C., Klimmt, C., Vermeulen, I.E., Vorderer, P.: The experience of interactive storytelling: comparing “Fahrenheit” with “Façade”. In: Anacleto, J.C., Fels, S., Graham, N., Kapralos, B., Saif El-Nasr, M., Stanley, K. (eds.) ICEC 2011. LNCS, vol. 6972, pp. 13–21. Springer, Heidelberg (2011). Scholar
  14. 14.
    Ryan, M.L.: Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. Johns Hopkins University Press, Baltimore (2001)Google Scholar
  15. 15.
    Sali, S., et al.: Playing with words: from intuition to evaluation of game dialogue interfaces. In: Proceedings of the Fifth International Conference on the Foundations of Digital Games, pp. 179–186. ACM (2010)Google Scholar
  16. 16.
    Seinfeld, S., et al.: Offenders become the victim in virtual reality: impact of changing perspective in domestic violence. Sci. Rep. 8(1), 2692 (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.New College of FloridaSarasotaUSA

Personalised recommendations