A Smartphone Application to Promote Affective Interaction and Mental Health

  • Maurizio Caon
  • Leonardo AngeliniEmail author
  • Stefano Carrino
  • Omar Abou Khaled
  • Elena Mugellini
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9169)


In this paper, we describe a smartphone application that aims at motivating users to use facial expressions. This has a twofold goal: to reintroduce the use of facial expressions as nonverbal means in the computer-mediated communication of emotions and to provide the opportunity for self-reflection about the personal emotional states while fostering smiles in order to improve mental wellbeing. This paper provides a description of the developed prototype and reports the results of a first observation study conducted during an interactive event.


Positive technology Affective interaction Computer mediated communication Mental wellbeing Facial expressions 



We want to thank Alexandre Nussbaumer and Hoang-Linh Nguyen for their fundamental contribution to this work, which has been supported by Hasler Foundation in the framework of “Living in Smart Environments” project.


  1. 1.
    Bradski, G.: The opencv library. Doctor Dobbs J. 25(11), 120–126 (2000)Google Scholar
  2. 2.
    Brave S, Nass C.: Emotion in human–computer interaction. In: The Human–Computer Interaction Handbook, pp. 81–93 (2003)Google Scholar
  3. 3.
    Caon, M., Angelini, L., Khaled, O.A., Lalanne, D., Yue, Y., Mugellini, E.: Affective interaction in smart environments. Procedia Comput. Sci. 32, 1016–1021 (2014)CrossRefGoogle Scholar
  4. 4.
    Caon, M., Angelini, L., Yue, Y., Khaled, O.A., Mugellini, E.: Context-aware multimodal sharing of emotions. In: Kurosu, Masaaki (ed.) HCII/HCI 2013, Part V. LNCS, vol. 8008, pp. 19–28. Springer, Heidelberg (2013)Google Scholar
  5. 5.
    Caon, M., Khaled, O.A., Mugellini, E., Lalanne, D., Angelini, L.: Ubiquitous interaction for computer mediated communication of emotions. In: Proceedings of ACII 2013, pp. 717–718 (2013)Google Scholar
  6. 6.
    Dey, A.: Persuasive technology or explorative technology? In: Berkovsky, S., Freyne, J. (eds.) PERSUASIVE 2013. LNCS, vol. 7822, p. 1. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  7. 7.
    El Kaliouby, R., Robinson, P.: FAIM: integrating automated facial affect analysis in instant messaging. In: Proceedings of IUI 2004, pp. 244–246. ACM (2004)Google Scholar
  8. 8.
    Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol. Sci. Pract. 2(2), 151–164 (1995)CrossRefGoogle Scholar
  9. 9.
    Hernandez, J., Hoque, M.E., Drevo, W., Picard, R.W.: Mood meter: counting smiles in the wild. In: Proceedings of UbiComp 2012, pp. 301–310. ACM (2012)Google Scholar
  10. 10.
    Hori, Y., Tokuda, Y., Miura, T., Hiyama, A., Hirose, M.: Communication pedometer: a discussion of gamified communication focused on frequency of smiles. In: Proceedings of AH 2013, pp. 206–212. ACM (2013)Google Scholar
  11. 11.
    James, W.: The Principles of Psychology, vol. 2. Dover Publications, New York (1950)Google Scholar
  12. 12.
    Karren, K.J., Smith, L., Gordon, K.J.: Mind/body health: The effects of attitudes, emotions, and relationships. Pearson Higher Ed (2013)Google Scholar
  13. 13.
    Kleinke, C.L., Peterson, T.R., Rutledge, T.R.: Effects of self-generated facial expressions on mood. J. Pers. Soc. Psychol. 74, 272–279 (1998)CrossRefGoogle Scholar
  14. 14.
    Kuber, R., Wright, F.P.: Augmenting the instant messaging experience through the use of brain-computer interface and gestural technologies. Int. J. Hum. Comput. Interact. 29(3), 178–191 (2013)CrossRefGoogle Scholar
  15. 15.
    Lane, R.D.: Neural correlates of conscious emotional experience. In: Cognitive neuroscience of emotion, pp. 345–370 (2000)Google Scholar
  16. 16.
    Riva, G., Banos, R.M., Botella, C., Wiederhold, B.K., Gaggioli, A.: Positive technology: using interactive technologies to promote positive functioning. Cyberpsychol. Behav. Soc. Netw. 15(2), 69–77 (2012)CrossRefGoogle Scholar
  17. 17.
    Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: an efficient alternative to SIFT or SURF. In: Proceedings of ICCV 2011, pp. 2564–2571. IEEE (2011)Google Scholar
  18. 18.
    Seaward, B.: Managing Stress: Principles and Strategies for Health and Well-Being. Jones & Bartlett Publishers, Boston (2008)Google Scholar
  19. 19.
    Tsujita, H., Rekimoto, J.: Smiling makes us happier: enhancing positive mood and communication with smile-encouraging digital appliances. In: Proceedings of UbiComp 2011, pp. 1–10. ACM (2011)Google Scholar
  20. 20.
    Tsujita, H., Rekimoto, J.: Smile-encouraging digital appliances. IEEE Pervasive Comput. 12(4), 5–7 (2013)CrossRefGoogle Scholar
  21. 21.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of CVPR 2001, vol. 1, pp. I-511–I-518. IEEE (2001)Google Scholar
  22. 22.
    Yoshida, S., Tanikawa, T., Sakurai, S., Hirose, M., Narumi, T.: Manipulation of an emotional experience by real-time deformed facial feedback. In: Proceedings of AH 2013, pp. 35–42. ACM (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Maurizio Caon
    • 1
    • 2
  • Leonardo Angelini
    • 1
    • 2
    Email author
  • Stefano Carrino
    • 1
    • 2
  • Omar Abou Khaled
    • 1
    • 2
  • Elena Mugellini
    • 1
    • 2
  1. 1.HumanTech InstituteFribourgSwitzerland
  2. 2.University of Applied Sciences and Arts Western SwitzerlandDelémontSwitzerland

Personalised recommendations