Skip to main content
SpringerLink
Log in

Affective Computing for Enhancing Affective Touch-Based Communication Through Extended Reality

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2019 (ICCSA 2019)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11620))

Included in the following conference series:

Abstract

Nowadays, affective computing (AC), especially affective touch, plays a significant role in the next generation of human-computer, computer-computer and human-human communications. This is because it allows more senses in human communication to be included simultaneously and interactively, enabling innovative communications both between computers and humans, and between humans and humans. In this paper, we discuss applications and methodologies that researchers, including the author, have recently achieved by utilizing affective computing, affective touch, and extended reality (XR). Our purpose is to review our research work experience and other state-of-the-art results and propose a line of research to use these results in a future work or application. To begin with, we give an overview of extensive works using affective computing and emotion recognition systems for social media. After that, we explore some recent interesting research works about affective touch. Next, augmented reality (AR)-based applications using affective touch communication and affective computing are presented. Then, we review recent virtual reality-based systems using affective touch communication and affective computing. By understanding these approaches for extended reality-based applications with affective touch communication and affective computing presented recently by leading researchers, we believe that it will encourage sustainable advancements regarding human interactions in an integrated cross-disciplinary area.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Rudovic, O., Lee, J., Dai, M., Schuller, B., Picard, R.W.: Personalized machine learning for robot perception of affect and engagement in autism therapy. Sci. Robot. 3, eaao6760 (2018)

    Google Scholar 

  2. Kerdvibulvech, C.: An innovative real-time mobile augmented reality application in arts. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017, Part II. LNCS, vol. 10325, pp. 251–260. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60928-7_22

    Chapter  Google Scholar 

  3. Wu, C.-H., Huang, Y.-M., Hwang, J.-P.: Review of affective computing in education/learning: trends and challenges. Br. J. Educ. Technol. (BJET) 47(6), 1304–1323 (2016)

    Article  Google Scholar 

  4. Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)

    Article  Google Scholar 

  5. Politou, E.A., Alepis, E., Patsakis, C.: A survey on mobile affective computing. Comput. Sci. Rev. 25, 79–100 (2017)

    Article  Google Scholar 

  6. Kratzwald, B., Ilic, S., Kraus, M., Feuerriegel, S., Prendinger, H.: Deep learning for affective computing: text-based emotion recognition in decision support. Decis. Support Syst. 115, 24–35 (2018)

    Article  Google Scholar 

  7. Zhao, S., Yao, H., Gao, Y., Ding, G., Chua, T.-S.: Predicting personalized image emotion perceptions in social networks. IEEE Trans. Affect. Comput. 9(4), 526–540 (2018)

    Article  Google Scholar 

  8. Dai, W., Han, D., Dai, Y., Xu, D.: Emotion recognition and affective computing on vocal social media. Inf. Manage. 52(7), 777–788 (2015)

    Article  Google Scholar 

  9. Masson, H.L., Van De Plas, S., Daniels, N., de Beeck, H.P.O.: The multidimensional representational space of observed socio-affective touch experiences. NeuroImage 175, 297–314 (2018)

    Article  Google Scholar 

  10. Heraz, A., Clynes, M.: Recognition of emotions conveyed by touch through force-sensitive screens: observational study of humans and machine learning techniques. J. Med. Internet Res. (JMIR) Ment. Health 5(3), e10104 (2018)

    Google Scholar 

  11. Kerdvibulvech, C.: A study of interactive digital multimedia applications. In: Ho, Y.-S., Sang, J., Ro, Y.M., Kim, J., Wu, F. (eds.) PCM 2015, Part I. LNCS, vol. 9314, pp. 192–199. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24075-6_19

    Chapter  Google Scholar 

  12. Cabibihan, J.-J., Chauhan, S.S.: Physiological responses to affective tele-touch during induced emotional stimuli. IEEE Trans. Affect. Comput. 8(1), 108–118 (2017)

    Article  Google Scholar 

  13. Roberts, J.: Using affective computing for proxemic interactions in mixed-reality. In: Proceedings of the Symposium on Spatial User Interaction (SUI), p. 176 (2018)

    Google Scholar 

  14. Datcu, D., Rothkrantz, L.: Affective computing and augmented reality for car driving simulators. In: Acta Polytechnica CTU Proceedings, vol. 12, pp. 13–23 (2017)

    Google Scholar 

  15. Kerdvibulvech, C.: A novel integrated system of visual communication and touch technology for people with disabilities. In: Gervasi, O., et al. (eds.) ICCSA 2016, Part II. LNCS, vol. 9787, pp. 509–518. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-42108-7_39

    Chapter  Google Scholar 

  16. Delazio, A., Nakagaki, K., Klatzky, R.L., Hudson, S.E., Lehman, J.F., Sample, A.P.: Force jacket: pneumatically-actuated jacket for embodied haptic experiences. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI 2018), Montreal QC, Canada, 21–26 April 2018, Paper No. 320 (2018)

    Google Scholar 

  17. Ontiveros-Hernández, N.J., Pérez-Ramírez, M., Hernández, Y.: Virtual reality and affective computing for improving learning. Res. Comput. Sci. 65, 121–131 (2013)

    Google Scholar 

  18. Pérez-Ramírez, M., Ontiveros-Hernández, N.J., Ochoa-Ortíz, C.A., Hernández-Aguilar, J.A., Zayas-Pérez, B.E.: Intelligent tutoring systems based on virtual reality for the electrical domain. Res. Comput. Sci. 122, 163–174 (2016)

    Google Scholar 

  19. Rothkrantz, L.J.M.: An affective distant learning model using avatars as user stand-in. In: CompSysTech, pp. 288–295 (2017)

    Google Scholar 

  20. Ahmed, I., Harjunen, V., Jacucci, G., Hoggan, E.E., Ravaja, N., Spapé, M.M.A.: Reach out and touch me: effects of four distinct haptic technologies on affective touch in virtual reality. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI 2016), pp. 341–348 (2017). LNCS, vol. 9961, pp. 23–37

    Google Scholar 

  21. Ahmed, I., Harjunen, V., Jacucci, G., Ravaja, N., Spapé, Michiel M.: Total immersion: designing for affective symbiosis in a virtual reality game with haptics, biosensors, and emotive agents. In: Gamberini, L., Spagnolli, A., Jacucci, G., Blankertz, B., Freeman, J. (eds.) Symbiotic 2016. LNCS, vol. 9961, pp. 23–37. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57753-1_3

    Chapter  Google Scholar 

  22. Cooney, M., Pashami, S., Sant’Anna, A., Fan, Y., Nowaczyk, S.: Pitfalls of Affective Computing: how can the automatic visual communication of emotions lead to harm, and what can be done to mitigate such risks. In: Companion Proceedings of the the Web Conference (WWW), Lyon, France, 23–27 April 2018, pp. 1563–1566 (2018)

    Google Scholar 

  23. González-Franco, M., Ofek, E., Hinckley, K.: The uncanny valley of haptics. Sci. Robot. 3(17) (2018)

    Google Scholar 

  24. Fitzsimmons, M.: Apple’s Tim Cook: AR has the ability to amplify human performance (2018). https://www.techradar.com/news/apples-tim-cook-ar-has-the-ability-to-amplify-human-performance. Accessed 1 Apr 2019

  25. Kerdvibulvech, C.: Hand tracking by extending distance transform and hand model in real-time. Pattern Recognit. Image Anal. 25(3), 437–441 (2015)

    Article  Google Scholar 

Download references

Acknowledgments

This research presented herein was partially supported by a research grant from the Research Center, NIDA (National Institute of Development Administration).

Author information

Authors and Affiliations

  1. Graduate School of Communication Arts and Management Innovation, National Institute of Development Administration, 118 SeriThai Road, Klong-chan, Bangkapi, Bangkok, 10240, Thailand

    Chutisant Kerdvibulvech

  2. Department of Computer Science and Software Engineering, Research Institute of Big Data Analytics, Xi’an Jiaotong-Liverpool University, Suzhou Industrial Park, Suzhou, 215123, People’s Republic of China

    Sheng-Uei Guan

Authors
  1. Chutisant Kerdvibulvech
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sheng-Uei Guan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chutisant Kerdvibulvech .

Editor information

Editors and Affiliations

  1. Covenant University, Ota, Nigeria

    Sanjay Misra

  2. University of Perugia, Perugia, Italy

    Osvaldo Gervasi

  3. University of Basilicata, Potenza, Italy

    Beniamino Murgante

  4. Saint Petersburg State University, Saint Petersburg, Russia

    Elena Stankova

  5. Saint Petersburg State University, Saint Petersburg, Russia

    Vladimir Korkhov

  6. Polytechnic University of Bari, Bari, Italy

    Carmelo Torre

  7. University of Minho, Braga, Portugal

    Ana Maria A.C. Rocha

  8. Monash University, Clayton, VIC, Australia

    David Taniar

  9. Kyushu Sangyo University, Fukuoka, Japan

    Bernady O. Apduhan

  10. Polytechnic University of Bari, Bari, Italy

    Eufemia Tarantino

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kerdvibulvech, C., Guan, SU. (2019). Affective Computing for Enhancing Affective Touch-Based Communication Through Extended Reality. In: Misra, S., et al. Computational Science and Its Applications – ICCSA 2019. ICCSA 2019. Lecture Notes in Computer Science(), vol 11620. Springer, Cham. https://doi.org/10.1007/978-3-030-24296-1_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-24296-1_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-24295-4

  • Online ISBN: 978-3-030-24296-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation