Skip to main content
SpringerLink
Log in

Emotion Elicitation Techniques in Virtual Reality

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12932))

Included in the following conference series:

Abstract

In this paper, we explore how state-of-the-art methods of emotion elicitation can be adapted in virtual reality (VR). We envision that emotion research could be conducted in VR for various benefits, such as switching study conditions and settings on the fly, and conducting studies using stimuli that are not easily accessible in the real world such as to induce fear. To this end, we conducted a user study (N = 39) where we measured how different emotion elicitation methods (audio, video, image, autobiographical memory recall) perform in VR compared to the real world. We found that elicitation methods produce largely comparable results between the virtual and real world, but overall participants experience slightly stronger valence and arousal in VR. Emotions faded over time following the same pattern in both worlds. Our findings are beneficial to researchers and practitioners studying or using emotional user interfaces in VR.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agethen, P., Sekar, V.S., Gaisbauer, F., Pfeiffer, T., Otto, M., Rukzio, E.: Behavior analysis of human locomotion in the real world and virtual reality for the manufacturing industry. ACM Trans. Appl. Percept. 15(3), Article 20, July 2018, 19 pages. https://doi.org/10.1145/3230648

  2. Anderson, P., Rothbaum, B.O., Hodges, L.F.: Virtual reality exposure in the treatment of social anxiety. Cognitive Behav. Practice 10(3), 240–247 (2003)

    Google Scholar 

  3. Atkinson, J., Campos, D.: Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers. Expert Syst. Appl. 47(2016), 35–41 (2016)

    Article  Google Scholar 

  4. Aymerich-Franch, L., Bailenson, J.: The use of doppelgangers in virtual reality to treat public speaking anxiety: a gender comparison. Presented at the (2014)

    Google Scholar 

  5. Baker, R.C., Guttfreund, D.O.: The effects of written autobiographical recollection induction procedures on mood. J. Clin. Psychol. 49(4), 563–568 (1993). https://doi.org/10.1002/1097-4679(199307)49:4<563::AID-JCLP2270490414>3.0.CO;2-W

  6. Baños, R.M., Liaño, V., Botella, C., Alcañiz, M., Guerrero, B., Rey, B.(eds.) Changing induced moods via virtual reality. Presented at the (2006)

    Google Scholar 

  7. Beale, R., Peter, C.: The role of affect and emotion in HCI. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868, pp. 1–11. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-85099-1_1

    Chapter  Google Scholar 

  8. Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Therapy Exp. Psychiatry 25(1), 49–59 (1994)

    Google Scholar 

  9. Braun, M., Weiser, S., Pfleging, B., Alt, F.: A Comparison of Emotion Elicitation Methods for Affective Driving Studies, pp. 77–81. Association for Computing Machinery, New York (2018). https://doi.org/10.1145/3239092.3265945

  10. Chirico, A., Cipresso, P., Gaggioli, A.: Psychophysiological specificity of four basic emotions through autobiographical recall and videos. Presented at the (2018)

    Google Scholar 

  11. Chirico, A., Gaggioli, A.: When virtual feels real: comparing emotional responses and presence in virtual and natural environments. Cyberpsychol. Behav. Soc. Networking 22(3), 220–226 (2019)

    Google Scholar 

  12. Chirico, A., Yaden, D.B., Riva, G., Gaggioli, A.: The potential of virtual reality for the investigation of awe. Front. Psychol. 7(2016), 1766 (2016)

    Google Scholar 

  13. Coan, J.A., Allen, J.J.B.: Handbook of Emotion Elicitation and Assessment. Oxford University Press, USA (2007)

    Google Scholar 

  14. Colley, M., Walch, M., Rukzio, E.: For a better (simulated) world: considerations for VR in external communication research. In: Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (AutomotiveUI 2019), pp. 442–449. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3349263.3351523

  15. Coyne, L., Takemoto, J.K., Parmentier, B.L., Merritt, T., Sharpton, R.A.: Exploring virtual reality as a platform for distance team-based learning. Currents Pharmacy Teach. Learn. 10(10), 1384–1390 (2018)

    Google Scholar 

  16. Dan-Glauser, E.S., Scherer, K.R.: The Geneva affective picture database (GAPED): a new 730-picture database focusing on valence and normative significance. Behav. Res. Methods 43(2), 468 (2011)

    Google Scholar 

  17. Dean, M., et al.: Comparison of elicitation methods for moral and affective beliefs in the theory of planned behaviour. Appetite 47(2), 244–252 (2006)

    Google Scholar 

  18. Deb, S., Carruth, D.W., Sween, R., Strawderman, L., Garrison, T.M.: Efficacy of virtual reality in pedestrian safety research. Appl. Ergon. 65(2017), 449–460 (2017). https://doi.org/10.1016/j.apergo.2017.03.007

    Article  Google Scholar 

  19. Dickinson, P., Gerling, K., Wilson, L., Parke, A.: Virtual reality as a platform for research in gambling behaviour. Comput. Hum. Behav. 107(2020), 106293 (2020)

    Google Scholar 

  20. Drace, S.: Evidence for the role of affect in mood congruent recall of autobiographic memories. Motivat. Emotion 37(3), 623–628 (2013)

    Google Scholar 

  21. Ekman, P.: An argument for basic emotions. Cogn. Emotion 6(3–4), 169–200 (1992)

    Google Scholar 

  22. Estupiñán, S., Rebelo, F., Noriega, P., Ferreira, C., Duarte, E.: Can virtual reality increase emotional responses (Arousal and Valence)? A pilot study. Presented at the (2014)

    Google Scholar 

  23. Felnhofer, A., et al.: Is virtual reality emotionally arousing? investigating five emotion inducing virtual park scenarios. Int. J. Hum Comput Stud. 82(2015), 48–56 (2015)

    Article  Google Scholar 

  24. Gendron, M.: Defining emotion: a brief history. Emotion Rev 2(4), 371–372 (2010)

    Google Scholar 

  25. Gosling, S.D., Rentfrow, P.J., Swann Jr., W.B.: A very brief measure of the Big-Five personality domains. J. Res. Personality 37(6), 504–528 (2003)

    Google Scholar 

  26. Gross, J.J., Levenson, R.W.: Emotion elicitation using films. Cognition Emotion 9(1), 87–108 (1995)

    Google Scholar 

  27. Jallais, C., Gilet, A.-L.: Inducing changes in arousal and valence: comparison of two mood induction procedures. Behav. Res. Methods 42(1), 318–325 (2010)

    Google Scholar 

  28. Janssen, J.H., et al.: Machines outperform laypersons in recognizing emotions elicited by autobiographical recollection. Human-Comput. Interaction 28(6), 479–517 (2013)

    Google Scholar 

  29. Jatupaiboon, N., Pan-ngum, S., Israsena, P.: Real-time EEG-based happiness detection system. Sci. World J. 2013 (2013)

    Google Scholar 

  30. Koelstra, S.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affective Comput. 3(1), 18–31 (2011)

    Google Scholar 

  31. Leidelmeijer, K.: Emotions: An Experimental Approach. Tilburg University Press (1991)

    Google Scholar 

  32. Mäkelä, V., et al.: Virtual field studies: conducting studies on public displays in virtual reality. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 2020). ACM, New York. https://doi.org/10.1145/3313831.3376796

  33. Mardini, W., Ali, G.A., Magdady, E., Al-momani, S.: Detecting human emotions using electroencephalography (EEG) using dynamic programming approach. Presented at the (2018). https://doi.org/10.1109/ISDFS.2018.8355324

  34. Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cognition Emotion 23(2), 209–237 (2009)

    Google Scholar 

  35. Mills, C., D’Mello, S.: On the validity of the autobiographical emotional memory task for emotion induction. PloS One 9(4), e95837 (2014)

    Google Scholar 

  36. Moussaïd, M., et al.: Crowd behaviour during high-stress evacuations in an immersive virtual environment. J. Roy. Soc. Interface 13(122), 20160414 (2016)

    Google Scholar 

  37. Pan, X., de C Hamilton, A.F.: Why and how to use virtual reality to study human social interaction: the challenges of exploring a new research landscape. British J. Psychol. 109(3), 395–417 (2018)

    Google Scholar 

  38. Paquette, S., Peretz, I., Belin, P.: The “Musical Emotional Bursts”: a validated set of musical affect bursts to investigate auditory affective processing. Frontiers Psychol. 4(2013), 509 (2013)

    Google Scholar 

  39. Paquette, S., Takerkart, S., Saget, S., Peretz, I., Belin, P.: Cross-classification of musical and vocal emotions in the auditory cortex. Ann. NY Acad. Sci. 1423(2018), 329–337 (2018)

    Article  Google Scholar 

  40. Peng, K.-C., Chen, T., Sadovnik, A., Gallagher, A.C.: A mixed bag of emotions: Model, predict, and transfer emotion distributions. Presented at the (2015)

    Google Scholar 

  41. Picard, R.W., Vyzas, E., Healey, J.: Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 23(10), 1175–1191 (2001)

    Google Scholar 

  42. Plutchik, R.: A general psychoevolutionary theory of emotion. Theories of emotion. Elsevier, pp. 3–33 (1980)

    Google Scholar 

  43. Repetto, C., et al.: Virtual reality and mobile phones in the treatment of generalized anxiety disorders: a phase-2 clinical trial. Personal Ubiquitous Comput. 17(2), 253–260 (2013)

    Google Scholar 

  44. Riva, G., Baños, R.M., Botella, C., Mantovani, F., Gaggioli, A.: Transforming experience: the potential of augmented reality and virtual reality for enhancing personal and clinical change. Front. Psych. 7(2016), 164 (2016)

    Google Scholar 

  45. Riva, G., et al.: Affective interactions using virtual reality: the link between presence and emotions. CyberPsychol. Behav. 10(1), 45–56 (2007)

    Google Scholar 

  46. Rivu, R., et al.: Remote VR studies - a framework for running virtual reality studies Remotely Via Participant-Owned HMDs. CoRR abs/2102.11207 (2021). https://arxiv.org/abs/2102.11207

  47. Rosenberg, E.L., Ekman, P.: Emotion: Methods of study (2000)

    Google Scholar 

  48. Russell, J.A.:1980. A circumplex model of affect. J. Personality Soc. Psychol. 39(6), 1161 (1980)

    Google Scholar 

  49. Russell, J.A., Barrett, L.F.: Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J. Personality Soc. Psychol. 76(5), 805 (1999)

    Google Scholar 

  50. Sachs, M.E., Habibi, A., Damasio, A., Kaplan, J.T.: Decoding the neural signatures of emotions expressed through sound. Neuroimage 174(2018), 1–10 (2018)

    Article  Google Scholar 

  51. Searles, K., Mattes, K.: It’s a mad, mad world: using emotion inductions in a survey. J. Exp. Pol. Sci. 2(2), 172–182 (2015). https://doi.org/10.1017/XPS.2015.5

  52. Shariati, A., et al.: Virtual reality social robot platform: a case study on arash social robot. Presented at the (2018)

    Google Scholar 

  53. Soleymani, M., Lichtenauer, J., Pun, T., Pantic, M.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affective Comput. 3(1), 42–55 (2012)

    Google Scholar 

  54. Uhrig, M.K., Trautmann, N., Baumgärtner, U., Treede, R.-D., Henrich, F., Hiller, W., Marschall, S.: Emotion elicitation: a comparison of pictures and films. Front. Psychol. 7(2016), 180 (2016)

    Google Scholar 

  55. Västfjäll, D.: Emotion induction through music: a review of the musical mood induction procedure. Musicae Scientiae 5(1\_suppl), 173–211 (2001)

    Google Scholar 

  56. Woo, S., Chang, D.-S., An, D., Hyun, D., Wallraven, C., Dangelmaier, M.: Emotion induction in virtual environments: a novel paradigm using immersive scenarios in driving simulators. In: SIGGRAPH Asia 2017 Posters (SA ’17). Association for Computing Machinery, New York, NY, USA, Article Article 49, 2 pages. https://doi.org/10.1145/3145690.3145693

Download references

Acknowledgements

The presented work was funded by the German Research Foundation (DFG) under project no. 316457582 and 425869382 and by dtec.bw – Digitalization and Technology Research Center of the Bundeswehr [Voice of Wisdom].

Author information

Authors and Affiliations

  1. Universität der Bundeswehr München, Neubiberg, Germany

    Radiah Rivu, Ville Mäkelä, Mariam Hassib & Florian Alt

  2. LMU Munich, Munich, Germany

    Ruoyu Jiang & Ville Mäkelä

  3. University of Waterloo, Waterloo, Canada

    Ville Mäkelä

Authors
  1. Radiah Rivu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruoyu Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ville Mäkelä
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mariam Hassib
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Florian Alt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Radiah Rivu .

Editor information

Editors and Affiliations

  1. Department of Electrical and Information Engineering, Polytechnic University of Bari, Bari, Italy

    Carmelo Ardito

  2. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Rosa Lanzilotti

  3. Computer Science Department, University of Pisa, Pisa, Italy

    Alessio Malizia

  4. Department of Computer Science, University of York, York, UK

    Helen Petrie

  5. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Antonio Piccinno

  6. Computer Science Department, University of Bari Aldo Moro, Bari, Italy

    Giuseppe Desolda

  7. Microsoft Research, Redmond, WA, USA

    Kori Inkpen

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rivu, R., Jiang, R., Mäkelä, V., Hassib, M., Alt, F. (2021). Emotion Elicitation Techniques in Virtual Reality. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12932. Springer, Cham. https://doi.org/10.1007/978-3-030-85623-6_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85623-6_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85622-9

  • Online ISBN: 978-3-030-85623-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation