Skip to main content
SpringerLink
Log in

Fostering Empathy and Privacy: The Effect of Using Expressive Avatars for Remote Communication

  • Conference paper
  • First Online:
Human-Computer Interaction. Design and User Experience Case Studies (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12764))

Included in the following conference series:

Abstract

The importance of effective remote communication is currently being emphasized as education moves from offline to online due to acceleration of the Untact Era (a contact-free society). In this study, we analyze the hindrances to effective distance learning, observe the effect on users of communicating through Expressive Avatar (EA), and suggest effective ways to use EA. First, through a questionnaire, 84% of the respondents quantitatively demonstrated experiencing a psychological burden due to exposure of their faces, in addition to low concentration during remote classes. Second, through in-depth interviews, they were found to prefer to replace their images with two- and/or three-dimensional avatars and believed that the avatars’ unique characteristics were important. Content using EA is expected to contribute to improved quality in distance learning by reducing psychological burden and promoting transmission of emotions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Allen, J., Rowan, L., Singh, P.: Teaching and teacher education in the time of COVID-19. Asia-Pac. J. Teach. Educ. 48, 233–236 (2020). https://doi.org/10.1080/1359866X.2020.1752051

    Article  Google Scholar 

  2. Ministry of Education. https://www.moe.go.kr/Incs. Accessed 5 Aug 2020

  3. Kim, S., Lee, G., Sakata, N., Billinghurst, M.: Improving co-presence with augmented visual communication cues for sharing experience through video conference. In: 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 83–92. IEEE, Munich (2014). https://doi.org/10.1109/ISMAR.2014.6948412

  4. Maristcircle. https://www.maristcircle.com/Incs. Accessed 27 Oct 2020

  5. Savitsky, B., Findling, Y., Ereli, A., Hendel, T.: Anxiety and coping strategies among nursing students during the covid-19 pandemic. Nurse Educ. Pract. 46, 102809 (2020). https://doi.org/10.1016/j.nepr.2020.102809

    Article  Google Scholar 

  6. Cheshin, A., Rafaeli, A., Bos, N.: Anger and happiness in virtual teams: emotional influences of text and behavior on others’ affect in the absence of non-verbal cues. Organ. Behav. Hum. Decis. Process. 116, 2–16 (2011). https://doi.org/10.1016/j.obhdp.2011.06.002

    Article  Google Scholar 

  7. Petrova, T.E., Riekhakaynen, E.I.: Processing of verbal and non-verbal patterns: an eye-tracking study of Russian. In: Yang, X.-S., Sherratt, S., Dey, N., Joshi, A. (eds.) Third International Congress on Information and Communication Technology. AISC, vol. 797, pp. 269–276. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1165-9_24

    Chapter  Google Scholar 

  8. Tossell, C.C., Kortum, P., Shepard, C., Barg-Walkow, L.H., Rahmati, A., Zhong, L.: A longitudinal study of emoticon use in text messaging from smartphones. Comput. Hum. Behav. 28, 659–663 (2012). https://doi.org/10.1016/j.chb.2011.11.012

    Article  Google Scholar 

  9. Gonzalez-Franco, M., Steed, A., Hoogendyk, S., Ofek, E.: Using facial animation to increase the enfacement illusion and avatar self-identification. IEEE Trans. Visual. Comput. Graphics 26, 2023–2029 (2020). https://doi.org/10.1109/TVCG.2020.2973075

    Article  Google Scholar 

  10. Teyssier, M., Bailly, G., Pelachaud, C., Lecolinet, E.: Conveying emotions through device-initiated touch. IEEE Trans. Affect. Comput. 1 (2020). https://doi.org/10.1109/TAFFC.2020.3008693.

  11. Di Fiore, F., Quax, P., Vanaken, C., Lamotte, W., Van Reeth, F.: Conveying emotions through facially animated avatars in networked virtual environments. In: Egges, A., Kamphuis, A., Overmars, M. (eds.) Motion in Games. LNCS, vol. 5277, pp. 222–233. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  12. Marengo, D., Giannotta, F., Settanni, M.: Assessing personality using emoji: an exploratory study. Personality Individ. Differ. 112, 74–78 (2017). https://doi.org/10.1016/j.paid.2017.02.037

    Article  Google Scholar 

  13. JiSun, S.: Online classes that teachers are really curious about. Sch. Libr. J., p. 234 (2020). ISBN: 9788969150813

    Google Scholar 

  14. Lee, S., Carlson, G., Jones, S., Johnson, A., Leigh, J., Renambot, L.: Designing an expressive avatar of a real person. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS, pp. 64–76. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15892-6_8

  15. Hanus, M.D., Fox, J.: Persuasive avatars: The effects of customizing a virtual salesperson’s appearance on brand liking and purchase intentions. Int. J. Hum. Comput. Stud. 84, 33–40 (2015). https://doi.org/10.1016/j.ijhcs.2015.07.004

    Article  Google Scholar 

  16. Norouzi, N., et al.: A systematic survey of 15 years of user studies published in the intelligent virtual agents conference. In: Proceedings of the 18th International Conference on Intelligent Virtual Agents, pp. 17–22. ACM, Sydney (2018). https://doi.org/10.1145/3267851.3267901

  17. Paul, E., Friesen, W.V.: Unmasking the Face: A Guide to Recognizing Emotions from Facial Expressions. Malor Books (2015)

    Google Scholar 

  18. Fu, Y., Li, R., Huang, T.S., Danielsen, M.: Real-time multimodal human–avatar interaction. IEEE Trans. Circuits Syst. Video Technol. 18, 467–477 (2008). https://doi.org/10.1109/TCSVT.2008.918441

    Article  Google Scholar 

  19. Gomez Jauregui, D.A., Argelaguet, F., Olivier, A.-H., Marchal, M., Multon, F., Lecuyer, A.: Toward “pseudo-haptic avatars”: modifying the visual animation of self-avatar can simulate the perception of weight lifting. IEEE Trans. Visual. Comput. Graphics 20, 654–661 (2014). https://doi.org/10.1109/TVCG.2014.45

    Article  Google Scholar 

  20. Candarli, D., Yuksel, H.G.: Students’ perceptions of video-conferencing in the classrooms in higher education. Procedia Soc. Behav. Sci. 47, 357–361 (2012). https://doi.org/10.1016/j.sbspro.2012.06.663

    Article  Google Scholar 

  21. Correia, A.-P., Liu, C., Xu, F.: Evaluating videoconferencing systems for the quality of the educational experience. Distance Educ. 41, 429–452 (2020). https://doi.org/10.1080/01587919.2020.1821607

    Article  Google Scholar 

  22. Cassell, J., Vilhja, H.: Fully embodied conversational avatars: making communicative behaviors autonomous 20

    Google Scholar 

  23. Lee, K., Choi, J., Marakas, G.M., Singh, S.N.: Two distinct routes for inducing emotions in HCI design. Int. J. Hum.-Comput. Stud. 124, 67–80 (2019). https://doi.org/10.1016/j.ijhcs.2018.11.012

    Article  Google Scholar 

  24. Dodds, T.J., Mohler, B.J., BĂĽlthoff, H.H.: Talk to the virtual hands: self-animated avatars improve communication in head-mounted display virtual environments. PLoS One 6, e25759 (2011). https://doi.org/10.1371/journal.pone.0025759

    Article  Google Scholar 

  25. Garau, M., Slater, M., Vinayagamoorthy, V., Brogni, A., Steed, A., Sasse, M.A.: The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. New Horiz. 8 (2003)

    Google Scholar 

  26. SuJin, L.: How to design Ontact: highly interactive online classes. VIVI2 (2020)

    Google Scholar 

  27. Parent, R.: Modeling and animating human figures. In: Computer Animation. pp. 283–315. Elsevier (2012). https://doi.org/10.1016/B978-0-12-415842-9.00009-5

  28. Tang, H., Hu, Y., Fu, Y., Hasegawa-Johnson, M., Huang, T.S.: Real-time conversion from a single 2D face image to a 3D text-driven emotive audio-visual avatar. In: 2008 IEEE International Conference on Multimedia and Expo, pp. 1205–1208. IEEE, Hannover (2008). https://doi.org/10.1109/ICME.2008.4607657

  29. Lugrin, J.-L., Wiedemann, M., Bieberstein, D., Latoschik, M.E.: Influence of avatar realism on stressful situation in VR. In: 2015 IEEE Virtual Reality (VR), pp. 227–228. IEEE, Arles (2015). https://doi.org/10.1109/VR.2015.7223378

Download references

Acknowledgements

This research was partially supported by SKT.

Author information

Authors and Affiliations

  1. Kookmin University, Seoul, South Korea

    Jieun Lee, Jeongyun Heo & Hayeong Kim

  2. Mookwon University, Daejeon, South Korea

    Sanghoon Jeong

Authors
  1. Jieun Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jeongyun Heo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hayeong Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sanghoon Jeong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jeongyun Heo .

Editor information

Editors and Affiliations

  1. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

Appendix

Appendix

Questionnaire

The Measurements centered on the experience of remote training users.

Q1. Have you ever had an experience in class where you couldn’t focus on learning because of what you see on the screen?

Q2. If you couldn’t concentrate on the class, why couldn’t you concentrate?

  1. 1)

    I want to check my face that others see

  2. 2)

    Because I feel the burden or awkward to show my face

  3. 3)

    I want to check what my state is like in my view

Q3. What are the inconveniences you face in online classes?

  1. 1)

    Lack of bonding with classmates through limited online encounters

  2. 2)

    show my face

  3. 3)

    It is difficult to determine if the student is focusing. (Teaching student or nearby classmates)

Q4. Was it easy for you to identify the instructor or student through the video screen during the online class?

Q5. Was it easy for you to grasp the teacher’s or student’s facial expressions through the video screen during the online class?

Q6. What poses do you prefer to be illuminated during online classes? (See Fig. 5)

Q7. Is it easy for you to understand the intentions of the instructor or student's behavior through videos during online classes?

Q8. What is your or your preferred expression that you would like to see on the video screen during online class? (See Fig. 6)

Q9. This is an avatar image designed by providing subtitle expressions to users who want to ask questions. Please select the one you think is the most convenient among the images provided to you. (See Fig. 7)

Q10. Look at the top image and check the usefulness, delivery efficiency, and friendliness for image delivery. (See Fig. 8)

Q11. Please select the image you like the most when viewing other users who are valuable in the online class through the photo above presented. (See Fig. 9)

Q12. Please select the image you like the most about what kind of visual form you prefer to appear to other users in the online class through the photo above presented.

Q13. Do you think that conducting online classes using avatars will be of great help in forming bonds with classmates who have not formed intimacy?

Q14. What percentage of the other person’s poses during online classes do you prefer? (See Fig. 10)

Q15. What aspect ratio do you prefer for the other person during online classes? (See Fig. 11)

Q16. What kind of gaze do you prefer during online class? (See Fig. 12)

Figures Related Questionnaire

Fig. 5
figure 5

Options for question 6

Full size image
Fig. 6
figure 6

Options for question 8

Full size image
Fig. 7
figure 7

Options for question 9

Full size image
Fig. 8
figure 8

Options for question 10

Full size image
Fig. 9
figure 9

Options for question 11

Full size image
Fig. 10
figure 10

Options for question 14

Full size image
Fig. 11
figure 11

Options for question 15

Full size image
Fig. 12
figure 12

Options for question 16

Full size image

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lee, J., Heo, J., Kim, H., Jeong, S. (2021). Fostering Empathy and Privacy: The Effect of Using Expressive Avatars for Remote Communication. In: Kurosu, M. (eds) Human-Computer Interaction. Design and User Experience Case Studies. HCII 2021. Lecture Notes in Computer Science(), vol 12764. Springer, Cham. https://doi.org/10.1007/978-3-030-78468-3_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78468-3_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78467-6

  • Online ISBN: 978-3-030-78468-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation