Skip to main content

Emotion Recognition for Self-aid in Addiction Treatment, Psychotherapy, and Nonviolent Communication

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 11620))

Abstract

This position paper aims to highlight possible future directions of applications for Affective Computing (AC) and Emotion Recognition (ER) for self-aid applications, as they emerge from the experience of the ACER-EMORE Workshops Series. ER in Artificial Intelligence offers a growing number of problem-solving multidisciplinary opportunities. Most current AC and ER applications are focused on a somewhat controversial enterprise-centered approach, i.e., recognizing user emotions to enable a third-party to achieve its own goals, in areas such as e-commerce, cybersecurity, behavior profiling, user experience. In this work we propose to explore a human-centered research direction, aiming at using AC/ER to enhance user consciousness of emotional states, ultimately supporting the development of self-aid applications. The use of facial ER and text ER to help forms of assistive technologies in the fields of Psychotherapy and Communication is an example of such a human-centered approach.

A general framework for ER in Self-aid is depicted, and some relevant application domains are suggested and discussed: dependencies treatment (DT) (e.g., workaholism, sexaholism); non-violent communication (NVC) for people in leading roles using e-mail or chat communication; empathy learning for parents and teachers in the circle-of-security (COS) caring environment.

Far from being complete and comprehensive, the purpose of this work is to trigger discussions and ideas for feasible studies and applications of ER in self-aid, which we hope to see published in the future editions of our workshops, believing that it may be one of the drops needed in the ocean of a better world.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Gervasi, O., Franzoni, V., Riganelli, M., Tasso, S.: Automating facial emotion recognition. Web Intell. 17, 17–27 (2019)

    Article  Google Scholar 

  2. Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)

    Article  Google Scholar 

  3. Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)

    Article  Google Scholar 

  4. Alm, C.O., Roth, D., Sproat, R.: Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP) (2005)

    Google Scholar 

  5. Liu, H., Lieberman, H., Selker, T.: A model of textual affect sensing using real-world knowledge. In: Proceedings of the International Conference on Intelligent User Interfaces, pp. 125–132 (2003)

    Google Scholar 

  6. Franzoni, V., Li, Y., Mengoni, P.: A path-based model for emotion abstraction on facebook using sentiment analysis and taxonomy knowledge. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)

    Google Scholar 

  7. Milani, A., Rajdeep, N., Mangal, N., Mudgal, R.K., Franzoni, V.: Sentiment extraction and classification for the analysis of users’ interest in tweets. Int. J. Web Inf. Syst. 14, 29–40 (2018)

    Google Scholar 

  8. Mudgal, R.K., Niyogi, R., Milani, A., Franzoni, V.: Analysis of tweets to find the basis of popularity based on events semantic similarity. Int. J. Web Inf. Syst. 14(4), 438–452 (2018)

    Article  Google Scholar 

  9. Pennebaker, J.W., Mehl, M.R., Niederhoffer, K.G.: Psychological aspects of natural language use: our words. Our Selves. Annu. Rev. Psychol. 54(1), 547–577 (2002)

    Article  Google Scholar 

  10. Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A.: Sentiment in short strength detection informal text. J. Am. Soc. Inf. Sci. Technol. 61(12), 2544–2558 (2010)

    Article  Google Scholar 

  11. Biondi, G., Franzoni, V., Poggioni, V.: A deep learning semantic approach to emotion recognition using the IBM watson bluemix alchemy language. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 718–729. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_51

    Chapter  Google Scholar 

  12. Franzoni, V., Milani, A., Vallverdú, J.: Emotional affordances in human-machine interactive planning and negotiation. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)

    Google Scholar 

  13. Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, and results. Interact. Comput. 14(2), 119–140 (2002)

    Article  Google Scholar 

  14. Franzoni, V., Milani, A., Nardi, D., Vallverdú, J.: Emotional machines: the next revolution. Web Intell. 17, 1–7 (2019)

    Article  Google Scholar 

  15. Milani, A., Franzoni, V.: Soft behaviour modelling of user communities. J. Theor. Appl. Inf. Technol. 96, 217–226 (2018)

    Google Scholar 

  16. Dodds, P.S., Harris, K.D., Kloumann, I.M., Bliss, C.A., Danforth, C.M.: Temporal patterns of happiness and information in a global social network: Hedonometrics and Twitter. PLoS ONE 6(12), e26752 (2011)

    Article  Google Scholar 

  17. Dodds, P.S., Danforth, C.M.: Measuring the happiness of large-scale written expression: songs, blogs, and presidents. J. Happiness Stud. 11(4), 441–456 (2010)

    Article  Google Scholar 

  18. Hatch, M.J.: Irony and the social construction of contradiction in the humor of a management team. Organ. Sci. 8(3), 275–288 (2008)

    Article  Google Scholar 

  19. Berlyne, D.E.: Toward a theory of exploratory behavior: II. Arousal potential, perceptual curiosity, and learning. In: Conflict, Arousal, and Curiosity (2006)

    Google Scholar 

  20. Bohanek, J.G., Fivush, R., Walker, E.: Memories of positive and negative emotional events. Appl. Cogn. Psychol. 19(1), 51–66 (2005)

    Article  Google Scholar 

  21. Huang, A.H., Yen, D.C., Zhang, X.: Exploring the potential effects of emoticons. Inf. Manag. 45(7), 466–473 (2008)

    Article  Google Scholar 

  22. Lin, K.H.-Y., Yang, C., Chen, H.-H.: What emotions do news articles trigger in their readers? In: WISA 2018: Web Information Systems and Applications, pp. 170–181 (2018)

    Google Scholar 

  23. Cheshin, A., Rafaeli, A., Bos, N.: Anger and happiness in virtual teams: Emotional influences of text and behavior on others’ affect in the absence of non-verbal cues. Organ. Behav. Hum. Decis. Process. 116(1), 2–16 (2011)

    Article  Google Scholar 

  24. Ringberg, T., Reihlen, M.: Towards a socio-cognitive approach to knowledge transfer. J. Manag. Stud. 45(5), 912–935 (2008)

    Article  Google Scholar 

  25. Rogers, S.N., Gwanne, S., Lowe, D., Humphris, G., Yueh, B., Weymuller, E.A.: The addition of mood and anxiety domains to the University of Washington quality of life scale. Head Neck 24(6), 521–529 (2002)

    Article  Google Scholar 

  26. Needham, I., Abderhalden, C., Halfens, R.J.G., Fischer, J.E., Dassen, T.: Non-somatic effects of patient aggression on nurses: a systematic review. J. Adv. Nurs. 49(3), 283–296 (2005)

    Article  Google Scholar 

  27. Pilgrim, D., Bentall, R.: The medicalisation of misery: a critical realist analysis of the concept of depression (1999)

    Google Scholar 

  28. Whitney, J., Murray, J., Gavan, K., Todd, G., Whitaker, W., Treasure, J.: Experience of caring for someone with anorexia nervosa: qualitative study. Br. J. Psychiatry 187(5), 444–449 (2005)

    Article  Google Scholar 

  29. Lieberman, M.A., Goldstein, B.A.: Not all negative emotions are equal: the role of emotional expression in online support groups for women with breast cancer. Psychooncology 15(2), 160–168 (2006)

    Article  Google Scholar 

  30. Looije, R., Neerincx, M.A., Cnossen, F.: Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int. J. Hum Comput Stud. 68(6), 386–397 (2010)

    Article  Google Scholar 

  31. Eriksson, M., Svedlund, M.: “The intruder”: spouses’ narratives about life with a chronically ill partner. J. Clin. Nurs. 15(3), 324–333 (2006)

    Article  Google Scholar 

  32. Arora, S., Ashrafian, H., Davis, R., Athanasiou, T., Darzi, A., Sevdalis, N.: Emotional intelligence in medicine: a systematic review through the context of the ACGME competencies (2010)

    Google Scholar 

  33. Ryan, R.M., Connell, J.P., Plant, R.W.: Emotions in nondirected text learning. Learn. Individ, Differ (1990)

    Book  Google Scholar 

  34. Brackett, M.A.: The Emotion Revolution: Enhancing Social and Emotional Learning in School: Enhancing Social and Emotional Learning in School (2016)

    Google Scholar 

  35. Beaucousin, V., Lacheret, A., Turbelin, M.R., Morel, M., Mazoyer, B., Tzourio-Mazoyer, N.: FMRI study of emotional speech comprehension. Cereb. Cortex 17(2), 339–352 (2007)

    Article  Google Scholar 

  36. Munezero, M., Montero, C.S., Sutinen, E., Pajunen, J.: Are they different? affect, feeling, emotion, sentiment, and opinion detection in text. IEEE Trans. Affect. Comput. 5(2), 101–111 (2014)

    Article  Google Scholar 

  37. Franzoni, V., Poggioni, V.: Emotional book classification from book blurbs. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)

    Google Scholar 

  38. Franzoni, V., Milani, A., Biondi, G.: SEMO: a semantic model for emotion recognition in web objects. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)

    Google Scholar 

  39. Efrati, Y., Gola, M.: Compulsive sexual behavior: a twelve-step therapeutic approach. J. Behav. Addict. 7(2), 445–453 (2018)

    Article  Google Scholar 

  40. Volenik, A.: The twelve-step program as a response to contemporary addictive behaviors | Program 12 koraka kao odgovor na moderna ovisnička ponašanja. Obnovljeni Ziv (2014)

    Google Scholar 

  41. Bakker, A.B., Schaufeli, W.B., Leiter, M.P., Taris, T.W.: Work engagement: an emerging concept in occupational health psychology. Work Stress 22(3), 187–200 (2008)

    Article  Google Scholar 

  42. Schaufeli, W.B., Taris, T.W., Van Rhenen, W.: Workaholism, burnout, and work engagement: three of a kind or three different kinds of employee well-being? Appl. Psychol. 57(2), 173–203 (2008)

    Article  Google Scholar 

  43. Bakker, A.B., Demerouti, E., Burke, R.: Workaholism and relationship quality: a spillover-crossover perspective. J. Occup. Health Psychol. 14(1), 23 (2009)

    Article  Google Scholar 

  44. McMillan, L.H.W., O’Driscoll, M.P., Marsh, N.V., Brady, E.C.: Understanding workaholism: data synthesis, theoretical critique, and future design strategies. Int. J. Stress Manag. 8(2), 69–91 (2001)

    Article  Google Scholar 

  45. Powell, B., Cooper, G., Hoffman, K., Marvin, B.M.: The Circle of Security Intervention: Enhancing Attachment in Early Parent-Child Relationships (2014)

    Google Scholar 

  46. Gateway, Child Welfare Information, C.B.: Parent Education to Strengthen Families and Reduce the Risk of Maltreatment ISSUE., Washington, DC (2010)

    Google Scholar 

  47. Cassidy, J., et al.: Enhancing maternal sensitivity and attachment security in the infants of women in a jail-diversion program. Attach. Hum. Dev. 12(4), 333–353 (2010). Incarcer. Individ. their Child. viewed from Perspect. Attach. theory. Spec. issue

    Article  Google Scholar 

  48. Vazhappilly, J.J., Reyes, M.E.S.: Non-violent communication and marital relationship: efficacy of ‘emotion-focused couples’ communication program among filipino couples. Psychol. Stud. (Mysore) 62(3), 275–283 (2017)

    Article  Google Scholar 

  49. Zimmermann, W.: On promoting non violent communication in Syria. In: Proceedings of the 5th International Disaster and Risk Conference: Integrative Risk Management - The Role of Science, Technology and Practice, IDRC Davos 2014 (2014)

    Google Scholar 

  50. Marshall Rosenberg: Words are Windows (or They’re Walls) (1998)

    Google Scholar 

  51. Marvin, R., Cooper, G., Hoffman, K., Powell, B.: The circle of security project: attachment-based intervention with caregiver–pre-school child dyads. Attach. Hum. Dev. 4(1), 107–124 (2002)

    Article  Google Scholar 

  52. Franzoni, V., Biondi, G., Milani, A.: A web-based system for emotion vector extraction. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 653–668. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_46

    Chapter  Google Scholar 

  53. Biondi, G., Franzoni, V., Li, Y., Milani, A.: Web-based similarity for emotion recognition in web objects. In: Proceedings - 9th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2016 (2016)

    Google Scholar 

  54. Franzoni, V., Milani, A.: Structural and semantic proximity in information networks (2017)

    Google Scholar 

  55. Cilibrasi, R.L., Vitanyi, P.M.B.: The google similarity distance. IEEE Trans. Knowl. Data Eng. 19, 370–383 (2007)

    Article  Google Scholar 

  56. Franzoni, V., Milani, A., Pallottelli, S., Leung, C.H.C., Li, Y.: Context-based image semantic similarity. In: 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015 (2016)

    Google Scholar 

  57. Franzoni, V., Milani, A.: PMING distance: a collaborative semantic proximity measure. In: Proceedings - 2012 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2012 (2012)

    Google Scholar 

  58. Franzoni, V., Leung, C.H.C., Li, Y., Mengoni, P., Milani, A.: Set similarity measures for images based on collective knowledge. In: Gervasi, O., et al. (eds.) ICCSA 2015. LNCS, vol. 9155, pp. 408–417. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21404-7_30

    Chapter  Google Scholar 

  59. Perkins, J.: Python 3 Text Processing with NLTK 3.0 Cookbook (2014)

    Google Scholar 

  60. Alzubi, A., Amira, A., Ramzan, N.: Semantic content-based image retrieval: a comprehensive study. J. Vis. Commun. Image Represent. 32, 20–54 (2015)

    Article  Google Scholar 

  61. Riganelli, M., Franzoni, V., Gervasi, O., Tasso, S.: EmEx, a tool for automated emotive face recognition using convolutional neural networks. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 692–704. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_49

    Chapter  Google Scholar 

  62. Jia, Y., Shelhamer, E., Donahue, J., et al.: Caffe: Convolutional Architecture for Fast Feature Embedding. Arxiv (2014)

    Google Scholar 

  63. OpenCV: Open Source Computer Vision Library

    Google Scholar 

  64. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: ImageNet Classification with Deep Convolutional Neural Networks (2012)

    Google Scholar 

  65. Saeed, U., Dugelay, J.-L.: Combining edge detection and region segmentation for lip contour extraction. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2010. LNCS, vol. 6169, pp. 11–20. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14061-7_2

    Chapter  Google Scholar 

Download references

Acknowledgments

The authors thank all the researchers who participated to the 2019 edition of the EMORE and ACER workshops, to the previous editions and the special issue Emotional Machines, the Next Revolution (iOS Press, 2019): https://content.iospress.com/articles/web-intelligence/web190395. Thanks are due also to all the researchers who spend their time researching for application to make the life of the weakest easier.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Valentina Franzoni .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Franzoni, V., Milani, A. (2019). Emotion Recognition for Self-aid in Addiction Treatment, Psychotherapy, and Nonviolent Communication. In: Misra, S., et al. Computational Science and Its Applications – ICCSA 2019. ICCSA 2019. Lecture Notes in Computer Science(), vol 11620. Springer, Cham. https://doi.org/10.1007/978-3-030-24296-1_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-24296-1_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-24295-4

  • Online ISBN: 978-3-030-24296-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics