Abstract
This position paper aims to highlight possible future directions of applications for Affective Computing (AC) and Emotion Recognition (ER) for self-aid applications, as they emerge from the experience of the ACER-EMORE Workshops Series. ER in Artificial Intelligence offers a growing number of problem-solving multidisciplinary opportunities. Most current AC and ER applications are focused on a somewhat controversial enterprise-centered approach, i.e., recognizing user emotions to enable a third-party to achieve its own goals, in areas such as e-commerce, cybersecurity, behavior profiling, user experience. In this work we propose to explore a human-centered research direction, aiming at using AC/ER to enhance user consciousness of emotional states, ultimately supporting the development of self-aid applications. The use of facial ER and text ER to help forms of assistive technologies in the fields of Psychotherapy and Communication is an example of such a human-centered approach.
A general framework for ER in Self-aid is depicted, and some relevant application domains are suggested and discussed: dependencies treatment (DT) (e.g., workaholism, sexaholism); non-violent communication (NVC) for people in leading roles using e-mail or chat communication; empathy learning for parents and teachers in the circle-of-security (COS) caring environment.
Far from being complete and comprehensive, the purpose of this work is to trigger discussions and ideas for feasible studies and applications of ER in self-aid, which we hope to see published in the future editions of our workshops, believing that it may be one of the drops needed in the ocean of a better world.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Gervasi, O., Franzoni, V., Riganelli, M., Tasso, S.: Automating facial emotion recognition. Web Intell. 17, 17–27 (2019)
Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)
Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)
Alm, C.O., Roth, D., Sproat, R.: Emotions from text: machine learning for text-based emotion prediction. In: Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing (HLT/EMNLP) (2005)
Liu, H., Lieberman, H., Selker, T.: A model of textual affect sensing using real-world knowledge. In: Proceedings of the International Conference on Intelligent User Interfaces, pp. 125–132 (2003)
Franzoni, V., Li, Y., Mengoni, P.: A path-based model for emotion abstraction on facebook using sentiment analysis and taxonomy knowledge. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)
Milani, A., Rajdeep, N., Mangal, N., Mudgal, R.K., Franzoni, V.: Sentiment extraction and classification for the analysis of users’ interest in tweets. Int. J. Web Inf. Syst. 14, 29–40 (2018)
Mudgal, R.K., Niyogi, R., Milani, A., Franzoni, V.: Analysis of tweets to find the basis of popularity based on events semantic similarity. Int. J. Web Inf. Syst. 14(4), 438–452 (2018)
Pennebaker, J.W., Mehl, M.R., Niederhoffer, K.G.: Psychological aspects of natural language use: our words. Our Selves. Annu. Rev. Psychol. 54(1), 547–577 (2002)
Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A.: Sentiment in short strength detection informal text. J. Am. Soc. Inf. Sci. Technol. 61(12), 2544–2558 (2010)
Biondi, G., Franzoni, V., Poggioni, V.: A deep learning semantic approach to emotion recognition using the IBM watson bluemix alchemy language. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 718–729. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_51
Franzoni, V., Milani, A., Vallverdú, J.: Emotional affordances in human-machine interactive planning and negotiation. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)
Klein, J., Moon, Y., Picard, R.W.: This computer responds to user frustration: theory, design, and results. Interact. Comput. 14(2), 119–140 (2002)
Franzoni, V., Milani, A., Nardi, D., Vallverdú, J.: Emotional machines: the next revolution. Web Intell. 17, 1–7 (2019)
Milani, A., Franzoni, V.: Soft behaviour modelling of user communities. J. Theor. Appl. Inf. Technol. 96, 217–226 (2018)
Dodds, P.S., Harris, K.D., Kloumann, I.M., Bliss, C.A., Danforth, C.M.: Temporal patterns of happiness and information in a global social network: Hedonometrics and Twitter. PLoS ONE 6(12), e26752 (2011)
Dodds, P.S., Danforth, C.M.: Measuring the happiness of large-scale written expression: songs, blogs, and presidents. J. Happiness Stud. 11(4), 441–456 (2010)
Hatch, M.J.: Irony and the social construction of contradiction in the humor of a management team. Organ. Sci. 8(3), 275–288 (2008)
Berlyne, D.E.: Toward a theory of exploratory behavior: II. Arousal potential, perceptual curiosity, and learning. In: Conflict, Arousal, and Curiosity (2006)
Bohanek, J.G., Fivush, R., Walker, E.: Memories of positive and negative emotional events. Appl. Cogn. Psychol. 19(1), 51–66 (2005)
Huang, A.H., Yen, D.C., Zhang, X.: Exploring the potential effects of emoticons. Inf. Manag. 45(7), 466–473 (2008)
Lin, K.H.-Y., Yang, C., Chen, H.-H.: What emotions do news articles trigger in their readers? In: WISA 2018: Web Information Systems and Applications, pp. 170–181 (2018)
Cheshin, A., Rafaeli, A., Bos, N.: Anger and happiness in virtual teams: Emotional influences of text and behavior on others’ affect in the absence of non-verbal cues. Organ. Behav. Hum. Decis. Process. 116(1), 2–16 (2011)
Ringberg, T., Reihlen, M.: Towards a socio-cognitive approach to knowledge transfer. J. Manag. Stud. 45(5), 912–935 (2008)
Rogers, S.N., Gwanne, S., Lowe, D., Humphris, G., Yueh, B., Weymuller, E.A.: The addition of mood and anxiety domains to the University of Washington quality of life scale. Head Neck 24(6), 521–529 (2002)
Needham, I., Abderhalden, C., Halfens, R.J.G., Fischer, J.E., Dassen, T.: Non-somatic effects of patient aggression on nurses: a systematic review. J. Adv. Nurs. 49(3), 283–296 (2005)
Pilgrim, D., Bentall, R.: The medicalisation of misery: a critical realist analysis of the concept of depression (1999)
Whitney, J., Murray, J., Gavan, K., Todd, G., Whitaker, W., Treasure, J.: Experience of caring for someone with anorexia nervosa: qualitative study. Br. J. Psychiatry 187(5), 444–449 (2005)
Lieberman, M.A., Goldstein, B.A.: Not all negative emotions are equal: the role of emotional expression in online support groups for women with breast cancer. Psychooncology 15(2), 160–168 (2006)
Looije, R., Neerincx, M.A., Cnossen, F.: Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int. J. Hum Comput Stud. 68(6), 386–397 (2010)
Eriksson, M., Svedlund, M.: “The intruder”: spouses’ narratives about life with a chronically ill partner. J. Clin. Nurs. 15(3), 324–333 (2006)
Arora, S., Ashrafian, H., Davis, R., Athanasiou, T., Darzi, A., Sevdalis, N.: Emotional intelligence in medicine: a systematic review through the context of the ACGME competencies (2010)
Ryan, R.M., Connell, J.P., Plant, R.W.: Emotions in nondirected text learning. Learn. Individ, Differ (1990)
Brackett, M.A.: The Emotion Revolution: Enhancing Social and Emotional Learning in School: Enhancing Social and Emotional Learning in School (2016)
Beaucousin, V., Lacheret, A., Turbelin, M.R., Morel, M., Mazoyer, B., Tzourio-Mazoyer, N.: FMRI study of emotional speech comprehension. Cereb. Cortex 17(2), 339–352 (2007)
Munezero, M., Montero, C.S., Sutinen, E., Pajunen, J.: Are they different? affect, feeling, emotion, sentiment, and opinion detection in text. IEEE Trans. Affect. Comput. 5(2), 101–111 (2014)
Franzoni, V., Poggioni, V.: Emotional book classification from book blurbs. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)
Franzoni, V., Milani, A., Biondi, G.: SEMO: a semantic model for emotion recognition in web objects. In: Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (2017)
Efrati, Y., Gola, M.: Compulsive sexual behavior: a twelve-step therapeutic approach. J. Behav. Addict. 7(2), 445–453 (2018)
Volenik, A.: The twelve-step program as a response to contemporary addictive behaviors | Program 12 koraka kao odgovor na moderna ovisnička ponašanja. Obnovljeni Ziv (2014)
Bakker, A.B., Schaufeli, W.B., Leiter, M.P., Taris, T.W.: Work engagement: an emerging concept in occupational health psychology. Work Stress 22(3), 187–200 (2008)
Schaufeli, W.B., Taris, T.W., Van Rhenen, W.: Workaholism, burnout, and work engagement: three of a kind or three different kinds of employee well-being? Appl. Psychol. 57(2), 173–203 (2008)
Bakker, A.B., Demerouti, E., Burke, R.: Workaholism and relationship quality: a spillover-crossover perspective. J. Occup. Health Psychol. 14(1), 23 (2009)
McMillan, L.H.W., O’Driscoll, M.P., Marsh, N.V., Brady, E.C.: Understanding workaholism: data synthesis, theoretical critique, and future design strategies. Int. J. Stress Manag. 8(2), 69–91 (2001)
Powell, B., Cooper, G., Hoffman, K., Marvin, B.M.: The Circle of Security Intervention: Enhancing Attachment in Early Parent-Child Relationships (2014)
Gateway, Child Welfare Information, C.B.: Parent Education to Strengthen Families and Reduce the Risk of Maltreatment ISSUE., Washington, DC (2010)
Cassidy, J., et al.: Enhancing maternal sensitivity and attachment security in the infants of women in a jail-diversion program. Attach. Hum. Dev. 12(4), 333–353 (2010). Incarcer. Individ. their Child. viewed from Perspect. Attach. theory. Spec. issue
Vazhappilly, J.J., Reyes, M.E.S.: Non-violent communication and marital relationship: efficacy of ‘emotion-focused couples’ communication program among filipino couples. Psychol. Stud. (Mysore) 62(3), 275–283 (2017)
Zimmermann, W.: On promoting non violent communication in Syria. In: Proceedings of the 5th International Disaster and Risk Conference: Integrative Risk Management - The Role of Science, Technology and Practice, IDRC Davos 2014 (2014)
Marshall Rosenberg: Words are Windows (or They’re Walls) (1998)
Marvin, R., Cooper, G., Hoffman, K., Powell, B.: The circle of security project: attachment-based intervention with caregiver–pre-school child dyads. Attach. Hum. Dev. 4(1), 107–124 (2002)
Franzoni, V., Biondi, G., Milani, A.: A web-based system for emotion vector extraction. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 653–668. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_46
Biondi, G., Franzoni, V., Li, Y., Milani, A.: Web-based similarity for emotion recognition in web objects. In: Proceedings - 9th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2016 (2016)
Franzoni, V., Milani, A.: Structural and semantic proximity in information networks (2017)
Cilibrasi, R.L., Vitanyi, P.M.B.: The google similarity distance. IEEE Trans. Knowl. Data Eng. 19, 370–383 (2007)
Franzoni, V., Milani, A., Pallottelli, S., Leung, C.H.C., Li, Y.: Context-based image semantic similarity. In: 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015 (2016)
Franzoni, V., Milani, A.: PMING distance: a collaborative semantic proximity measure. In: Proceedings - 2012 IEEE/WIC/ACM International Conference on Intelligent Agent Technology, IAT 2012 (2012)
Franzoni, V., Leung, C.H.C., Li, Y., Mengoni, P., Milani, A.: Set similarity measures for images based on collective knowledge. In: Gervasi, O., et al. (eds.) ICCSA 2015. LNCS, vol. 9155, pp. 408–417. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-21404-7_30
Perkins, J.: Python 3 Text Processing with NLTK 3.0 Cookbook (2014)
Alzubi, A., Amira, A., Ramzan, N.: Semantic content-based image retrieval: a comprehensive study. J. Vis. Commun. Image Represent. 32, 20–54 (2015)
Riganelli, M., Franzoni, V., Gervasi, O., Tasso, S.: EmEx, a tool for automated emotive face recognition using convolutional neural networks. In: Gervasi, O., et al. (eds.) ICCSA 2017. LNCS, vol. 10406, pp. 692–704. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-62398-6_49
Jia, Y., Shelhamer, E., Donahue, J., et al.: Caffe: Convolutional Architecture for Fast Feature Embedding. Arxiv (2014)
OpenCV: Open Source Computer Vision Library
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: ImageNet Classification with Deep Convolutional Neural Networks (2012)
Saeed, U., Dugelay, J.-L.: Combining edge detection and region segmentation for lip contour extraction. In: Perales, F.J., Fisher, R.B. (eds.) AMDO 2010. LNCS, vol. 6169, pp. 11–20. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-14061-7_2
Acknowledgments
The authors thank all the researchers who participated to the 2019 edition of the EMORE and ACER workshops, to the previous editions and the special issue Emotional Machines, the Next Revolution (iOS Press, 2019): https://content.iospress.com/articles/web-intelligence/web190395. Thanks are due also to all the researchers who spend their time researching for application to make the life of the weakest easier.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Franzoni, V., Milani, A. (2019). Emotion Recognition for Self-aid in Addiction Treatment, Psychotherapy, and Nonviolent Communication. In: Misra, S., et al. Computational Science and Its Applications – ICCSA 2019. ICCSA 2019. Lecture Notes in Computer Science(), vol 11620. Springer, Cham. https://doi.org/10.1007/978-3-030-24296-1_32
Download citation
DOI: https://doi.org/10.1007/978-3-030-24296-1_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-24295-4
Online ISBN: 978-3-030-24296-1
eBook Packages: Computer ScienceComputer Science (R0)