Skip to main content
SpringerLink
Log in

Evaluation of a Self-report System for Assessing Mood Using Facial Expressions

  • Conference paper
  • First Online:
Pervasive Computing Paradigms for Mental Health (MindCare 2019)

Abstract

Effective and frequent sampling of mood through self-reports could enable a better understanding of the interplay between mood and events influencing it. To accomplish this, we built a mobile application featuring a sadness-happiness visual analogue scale and a facial expression-based scale. The goal is to evaluate, whether a facial expression based scale could adequately capture mood. The method and mobile application were evaluated with 11 participants. They rated the mood of characters presented in a series of vignettes, using both scales. Participants also completed a user experience survey rating the two assessment methods and the mobile interface. Findings reveal a Pearson’s correlation coefficient of 0.97 between the two assessment scales and a stronger preference for the face scale. We conclude with a discussion of the implications of our findings for mood self-assessment and an outline future research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barrows, P.D., Thomas, S.A.: Assessment of mood in aphasia following stroke: validation of the Dynamic Visual Analogue Mood Scales (D-VAMS). Clin. Rehabil. 32(1), 94–102 (2018). https://doi.org/10.1177/0269215517714590

    Article  Google Scholar 

  2. Broekens, J., Brinkman, W.P.: AffectButton: a method for reliable and valid affective self-report. Int. J. Hum. Comput. Stud. 71(6), 641–667 (2013). https://doi.org/10.1016/j.ijhcs.2013.02.003

    Article  Google Scholar 

  3. Price, D.D., McGrath, P.A., Rafii, A., Buckingham, B.: The validation of visual analogue scales as ratio scale measures for chronic and experimental pain. Pain 17(1), 45–56 (1983)

    Article  Google Scholar 

  4. Duque, A., Vázquez, C.: Mental Health; researchers at Complutense University have reported new data on depression (Double attention bias for positive and negative emotional faces in clinical depression: evidence from an eye-tracking study). Mental Health Weekly Digest 46, 124 (2015). http://search.proquest.com/docview/1647129310?accountid=136549

    Article  Google Scholar 

  5. Ekman, P.: Universal-Facial-Expressions-of-Emotion (1970)

    Google Scholar 

  6. Ekman, P.: Facial expression and emotion. Am. Psychol. 48(4), 384–392 (1993). https://doi.org/10.1037/0003-066X.48.4.384. http://doi.apa.org/getdoi.cfm?doi=10.1037/0003-066X.48.4.384

    Article  Google Scholar 

  7. Huang, S.T.Y., Kwan, C.M.Y., Sano, A.: The moment. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing Adjunct Publication - UbiComp 2014 Adjunct, pp. 235–238 (2014). https://doi.org/10.1145/2638728.2638784. http://dl.acm.org/citation.cfm?doid=2638728.2638784

  8. Joormann, J., Gotlib, I.H.: Is this happiness i see? Biases in the identification of emotional facial expressions in depression and social phobia. J. Abnorm. Psychol. 115(4), 705–714 (2006). https://doi.org/10.1037/0021-843X.115.4.705

    Article  Google Scholar 

  9. Kamashita, Y., Sonoda, T., Kamada, Y., Nishi, Y., Nagaoka, E.: Reliability, validity, and preference of an original faces scale for assessing the mood of patients with dentures. Prosthodontic Res. Pract. 6, 93–98 (2007)

    Article  Google Scholar 

  10. Lagotte, A.: Eliciting discrete positive emotions with vignettes and films: a validation study (2014). http://etd.library.vanderbilt.edu/available/etd-07172014-202956/unrestricted/LagotteAE_MastersThesis.pdf

  11. Lorish, C.D., Maisiak, R.: The face scale: a brief, nonverbal method for assessing patient mood. Arthritis Rheum. 29(7), 906–909 (1986). https://doi.org/10.1002/art.1780290714

    Article  Google Scholar 

  12. McKinley, S., Coote, K., Stein-Parbury, J.: Development and testing of a faces scale for the assessment of anxiety in critical ill patients. J. Adv. Nurs. 41(1), 73–79 (2003)

    Article  Google Scholar 

  13. Pollak, J., Adams, P., Gay, G.: PAM: a photographic affect meter for frequent, in situ measurement of affect. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 725–734 (2011). https://doi.org/10.1145/1978942.1979047

  14. Rodriguez, I., Herskovic, V., Fuentes, C., Campos, M.: B-ePain: a wearable interface to self-report pain and emotions. In: UbiComp Adjunct, pp. 1120–1125 (2016). https://doi.org/10.1145/2968219.2972719. http://dblp.uni-trier.de/db/conf/huc/ubicomp2016ap.html#RodriguezHFC16

  15. Sanches, P., Hook, K., Sas, C., Stahl, A.: Ambiguity as a resource to inform proto-practices: the case of skin conductance. TOCHI 26(1) (2019). http://eprints.lancs.ac.uk/131794/1/TOCHI_Ambiguity.pdf

    Article  Google Scholar 

  16. Sanches, P., et al.: HCI and affective health taking stock of a decade of studies and charting future research directions, pp. 123–4567 (2019)

    Google Scholar 

  17. Sas, C., Rees, M.: AffectCam: arousal – augmented SenseCam for RicherRecall of episodic memories. In: CHI 2013, pp. 1041–1046 (2013). https://doi.org/10.1145/2468356.2468542. http://dl.acm.org/citation.cfm?doid=2468356.2468542

  18. Stone, A.A., Shiffman, S.: Ecological momentary assessment (EMA) in behavioral medicine. Ann. Behav. Med. 16(3), 199–202 (2018). https://doi.org/10.1093/abm/16.3.199. https://dx.doi.org/10.1093/abm/16.3.199

    Article  Google Scholar 

  19. Umair, M., Latif, M.H., Sas, C.: Dynamic displays at wrist for real time visualization of affective data, pp. 201–205 (2018). https://doi.org/10.1145/3197391.3205436

  20. Watson, D., Clark, L.A.: PANAS-X manual, pp. 1–27 (1999). https://doi.org/10.1111/j.1742-4658.2010.07754.x

    Article  Google Scholar 

  21. Watson, D., Clark, L.A.: JPSP Watson Clark Tellegen 1988 54(6), 1–8 (2004). https://doi.org/10.1051/epjconf/201714006017. papers3://publication/uuid/CA1FC7DA-0BA7-4563-8673-5E3942A0983F

    Article  Google Scholar 

  22. Westie, F.R.: A technique for the measurement of race attitudes. Am. Sociol. Rev. 18(1), 73 (2006). https://doi.org/10.2307/2087852

    Article  Google Scholar 

Download references

Acknowledgment

This work has been supported by AffecTech: Personal Technologies for Affective Health, Innovative Training Network funded by the H2020 People Programme under Marie Skłodowska-Curie grant agreement No. 722022.

Author information

Authors and Affiliations

  1. Philips Research, High Tech Campus 34, 5656 AE, Eindhoven, The Netherlands

    Hristo Valev, Tim Leufkens, Joyce Westerink & Ron Dotsch

  2. Lancaster University, Bailrigg, Lancaster, LA1 4YW, UK

    Hristo Valev & Corina Sas

  3. Eindhoven University of Technology Tu/e, 5600 MB, Eindhoven, The Netherlands

    Tim Leufkens & Joyce Westerink

Authors
  1. Hristo Valev
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tim Leufkens
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Corina Sas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joyce Westerink
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ron Dotsch
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hristo Valev .

Editor information

Editors and Affiliations

  1. IRCCS Istituto Auxologico Italiano, Milan, Italy

    Pietro Cipresso

  2. Department of Clinical Neurosciences, University of Lausanne, Lausanne, Switzerland

    Silvia Serino

  3. Catholic University of the Sacred Heart, Milan, Italy

    Daniela Villani

A Appendix A

A Appendix A

figure a

Rights and permissions

Reprints and permissions

Copyright information

© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Valev, H., Leufkens, T., Sas, C., Westerink, J., Dotsch, R. (2019). Evaluation of a Self-report System for Assessing Mood Using Facial Expressions. In: Cipresso, P., Serino, S., Villani, D. (eds) Pervasive Computing Paradigms for Mental Health. MindCare 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 288. Springer, Cham. https://doi.org/10.1007/978-3-030-25872-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25872-6_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25871-9

  • Online ISBN: 978-3-030-25872-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation