Skip to main content
SpringerLink
Log in

Effectiveness of a short audiovisual emotion recognition training program in adults

  • Original Paper
  • Published:
Motivation and Emotion Aims and scope Submit manuscript

Abstract

The ability to recognize emotions from others’ nonverbal behavior (emotion recognition ability, ERA) is crucial to successful social functioning. However, currently no self-administered ERA training for non-clinical adults covering multiple sensory channels exists. We conducted four studies in a lifespan sample of participants in the laboratory and online (total N = 531) to examine the effectiveness of a short computer-based training for 14 different emotions using audiovisual clips of emotional expressions. Results showed that overall, young and middle-aged participants that had received the training scored significantly higher on facial, vocal, and audiovisual emotion recognition than the control groups. The training effect for audiovisual ERA persisted over 4 weeks. In older adults (59–90 years), however, the training had no effect. The new, brief training could be useful in applied settings such as professional training, at least for younger and middle-aged adults. In older adults, improving ERA might require a longer and more interactive intervention.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Bänziger, T., Grandjean, D., & Scherer, K. R. (2009). Emotion recognition from expressions in face, voice, and body: The multimodal emotion recognition test (MERT). Emotion, 9(5), 691–704.

    Article  PubMed  Google Scholar 

  • Bänziger, T., Mortillaro, M., & Scherer, K. R. (2012). Introducing the Geneva multimodal expression corpus for experimental research on emotion perception. Emotion, 12(5), 1161–1179.

    Article  PubMed  Google Scholar 

  • Blanch-Hartigan, D. (2011). Measuring providers’ verbal and nonverbal emotion recognition ability: Reliability and validity of the patient emotion cue test (PECT). Patient Education and Counseling, 82(3), 370–376.

    Article  PubMed  Google Scholar 

  • Blanch-Hartigan, D. (2012). An effective training to increase accurate recognition of patient emotion cues. Patient Education and Counseling, 89(2), 274–280.

    Article  PubMed  Google Scholar 

  • Blanch-Hartigan, D., Andrzejewski, S. A., & Hill, K. M. (2012). The Effectiveness of training to improve person perception accuracy: A meta-analysis. Basic and Applied Social Psychology, 34(6), 483–498.

    Article  Google Scholar 

  • Blanch-Hartigan, D., Andrzejewski, S. A., & Hill, K. M. (2016). Training people to be interpersonally accurate. In J. A. Hall, M. Schmid Mast, & T. V. West (Eds.), The social psychology of perceiving others accurately (pp. 253–269). Cambridge: Cambridge University Press.

    Chapter  Google Scholar 

  • Buhlmann, U., Gleiß, M. J. L., Rupf, L., Zschenderlein, K., & Kathmann, N. (2011). Modifying emotion recognition deficits in body dysmorphic disorder: An experimental investigation. Depression and Anxiety, 28(10), 924–931.

    Article  PubMed  Google Scholar 

  • Cattell, R. B., & Cattell, A. K. S. (1957). Test of “g”: Culture Fair (Scale 2, Form A). Champaign, IL: Institute for Personality and Ability Testing.

    Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd edn.). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Derntl, B., Seidel, E.-M., Kryspin-Exner, I., Hasmann, A., & Dobmeier, M. (2009). Facial emotion recognition in patients with bipolar I and bipolar II disorder. British Journal of Clinical Psychology, 48(4), 363–375.

    Article  PubMed  Google Scholar 

  • Domes, G., Grabe, H. J., Czieschnek, D., Heinrichs, M., & Herpertz, S. C. (2011). Alexithymic traits and facial emotion recognition in borderline personality disorder. Psychotherapy and Psychosomatics, 80(6), 383–385.

    Article  PubMed  Google Scholar 

  • Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.

    Google Scholar 

  • Elfenbein, H. A., Foo, M. D., White, J., Tan, H. H., & Aik, V. C. (2007). Reading your counterpart: The benefit of emotion recognition accuracy for effectiveness in negotiation. Journal of Nonverbal Behavior, 31(4), 205–223.

    Article  Google Scholar 

  • Freund, A. M., & Isaacowitz, D. M. (2014). Aging and social perception: So far, more similarities than differences. Psychology and aging, 29(3), 451–453.

    Article  PubMed  Google Scholar 

  • Goh, J. X., Hall, J. A.., & Rosenthal, R. (2016). Mini meta-analysis of your own studies: Some arguments on why and a primer on how. Social and Personality Psychology Compass, 10, 535–549.

    Article  Google Scholar 

  • Golan, O., Ashwin, E., Granader, Y., McClintock, S., Day, K., Leggett, V., & Baron-Cohen, S. (2010). Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces. Journal of Autism and Developmental Disorders, 40(3), 269–279.

    Article  PubMed  Google Scholar 

  • Hall, J. A. (2011). Clinicians’ accuracy in perceiving patients: Its relevance for clinical practice and a narrative review of methods and correlates. Patient Education and Counseling, 84(3), 319–324.

    Article  PubMed  Google Scholar 

  • Hall, J. A., Andrzejewski, S. A., & Yopchick, J. E. (2009). Psychosocial correlates of interpersonal sensitivity: A meta-analysis. Journal of Nonverbal Behavior, 33(3), 149–180.

    Article  Google Scholar 

  • Hall, J. A., Mast, M. S., & West, T. V. (2016). The Social Psychology of Perceiving Others Accurately. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Herpertz, S., Schütz, A., & Nezlek, J. (2016). Enhancing emotion perception, a fundamental component of emotional intelligence: Using multiple-group SEM to evaluate a training program. Personality and Individual Differences, 95, 11–19.

    Article  Google Scholar 

  • Hurley, C. M. (2012). Do you see what I see? Learning to detect micro expressions of emotion. Motivation and Emotion, 36(3), 371–381.

    Article  Google Scholar 

  • Hurley, C. M., Anker, A. E., Frank, M. G., Matsumoto, D., & Hwang, H. C. (2014). Background factors predicting accuracy and improvement in micro expression recognition. Motivation and Emotion, 38(5), 700–714.

    Article  Google Scholar 

  • Joseph, D. L., Jin, J., Newman, D. A., & O’Boyle, E. H. (2015). Why does self-reported emotional intelligence predict job performance? A meta-analytic investigation of mixed EI. Journal of Applied Psychology, 100(2), 298–342.

    Article  PubMed  Google Scholar 

  • Kelly, M. E., Loughrey, D., Lawlor, B. A., Robertson, I. H., Walsh, C., & Brennan, S. (2014). The impact of cognitive training and mental stimulation on cognitive and everyday functioning of healthy older adults: a systematic review and meta-analysis. Ageing Research Reviews, 15, 28-43.

    Article  PubMed  Google Scholar 

  • Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., & Moberg, P. J. (2010). Facial emotion perception in schizophrenia: A meta-analytic review. Schizophrenia Bulletin, 36(5), 1009–1019.

    Article  PubMed  Google Scholar 

  • Kraemer, H. C., Taylor, J. L., Tinklenberg, J. R., & Yesavage, J. A. (1998). The stages of Alzheimer’s disease: A reappraisal. Dementia and Geriatric Cognitive Disorders, 9(6), 299–308.

    Article  PubMed  Google Scholar 

  • Krendl, A. C., & Ambady, N. (2010). Older adults’ decoding of emotions: Role of dynamic versus static cues and age-related cognitive decline. Psychology and Aging, 25(4), 788–793.

    Article  PubMed  Google Scholar 

  • Lansford, J. E., Sherman, A. M., & Antonucci, T. C. (1998). Satisfaction with social networks: An examination of socioemotional selectivity theory across cohorts. Psychology and Aging, 13(4), 544–552.

    Article  PubMed  Google Scholar 

  • Matsumoto, D., & Hwang, H. S. (2011). Evidence for training the ability to read microexpressions of emotion. Motivation and Emotion, 35(2), 181–191.

    Article  Google Scholar 

  • Mayer, J. D., & Salovey, P. (1997). What is emotional intelligence? In P. Salovey & D. Sluyter (Eds.), Emotional development and emotional intelligence: Educational implications (pp. 3–31). New York: Basic Books.

    Google Scholar 

  • McArthur, L. Z., & Baron, R. M. (1983). Toward an ecological theory of social perception. Psychological Review, 90(3), 215–238.

    Article  Google Scholar 

  • Mosteller, F. M., & Bush, R. R. (1954). Selected quantitative techniques. In G. Lindzey (Ed.), Handbook of social psychology:. Theory and method. Vol. 1 Cambridge, MA: Addison-Wesley.

    Google Scholar 

  • Murphy, N. A., & Isaacowitz, D. M. (2010). Age effects and gaze patterns in recognising emotional expressions: An in-depth look at gaze measures and covariates. Cognition and Emotion, 24, 436–452.

    Article  Google Scholar 

  • Newkirk, L. A., Kim, J. M., Thompson, J. M., Tinklenberg, J. R., Yesavage, J. A., & Taylor, J. L. (2004). Validation of a 26-point telephone version of the mini-mental state examination. Journal of Geriatric Psychiatry and Neurology, 17(2), 81–87.

    Article  PubMed  Google Scholar 

  • Nowicki, S. (2006). A manual and reference list for the diagnostic analysis of nonverbal accuracy (DANVA2). Atlanta, GA: Emory University.

    Google Scholar 

  • Nowicki, S. Jr., & Duke, M. (1994). Individual differences in the nonverbal communication of affect: The Diagnostic Analysis of Nonverbal Accuracy Scale. Journal of Nonverbal Behavior, 18, 9–35.

    Article  Google Scholar 

  • Pelli, D. G., Robson, J. G., & Wilkins, A. J. (1988). The design of a new letter chart for measuring contrast sensitivity. Clinical Vision Science, 2, 187–199.

    Google Scholar 

  • Petrides, K. V. (2009). Psychometric properties of the Trait Emotional Intelligence Questionnaire. In C. Stough, D. H. Saklofske & J. D. Parker (Eds.), Advances in the assessment of emotional intelligence (pp. 85–101). New York: Springer.

    Chapter  Google Scholar 

  • Richter, D., & Kunzmann, U. (2011). Age differences in three facets of empathy: performance-based evidence. Psychology and Aging, 26(1), 60–70.

    Article  PubMed  Google Scholar 

  • Riggio, R. E. (1986). Assessment of basic social skills. Journal of Personality and Social Psychology, 51, 649–660.

    Article  Google Scholar 

  • Rivers, S. E., Brackett, M. A., Reyes, M. R., Elbertson, N. A., & Salovey, P. (2013). Improving the social and emotional climate of classrooms: A clustered randomized controlled trial testing the ruler approach. Prevention Science, 14(1), 77–87.

    Article  PubMed  Google Scholar 

  • Ruben, M. A., Hall, J. A., Curtin, E. M., Blanch-Hartigan, D., & Ship, A. N. (2015). Discussion increases efficacy when training accurate perception of patients’ affect. Journal of Applied Social Psychology, 45(6), 355–362.

    Article  Google Scholar 

  • Rubin, R. S., Munz, D. C., & Bommer, W. H. (2005). Leading from within: The effects of emotion recognition and personality on transformational leadership behavior. Academy of Management Journal, 48(5), 845–858.

    Article  Google Scholar 

  • Ruffman, T., Henry, J. D., Livingstone, V., & Phillips, L. H. (2008). A meta-analytic review of emotion recognition and aging: Implications for neuropsychological models of aging. Neuroscience & Biobehavioral Reviews, 32(4), 863–881.

    Article  Google Scholar 

  • Scherer, K. R. (2007). Component models of emotion can inform the quest for emotional competence. In G. Matthews, M. Zeidner & R. D. Roberts (Eds.), The science of emotional intelligence: Knowns and unknowns (pp. 101–126). New York: Oxford University Press.

    Google Scholar 

  • Scherer, K. R., & Scherer, U. (2011). Assessing the ability to recognize facial and vocal expressions of emotion: Construction and validation of the emotion recognition index. Journal of Nonverbal Behavior, 35(4), 305–326.

    Article  Google Scholar 

  • Schlegel, K., Grandjean, D., & Scherer, K. R. (2013). Constructs of social and emotional effectiveness: Different labels, same content? Journal of Research in Personality, 47(4), 249–253.

    Article  Google Scholar 

  • Schlegel, K., Grandjean, D., & Scherer, K. R. (2014). Introducing the Geneva emotion recognition test: An example of Rasch-based test development. Psychological Assessment, 26(2), 666–672.

    Article  PubMed  Google Scholar 

  • Schlegel, K., & Scherer, K. R. (2016). Introducing a short version of the Geneva emotion recognition test (GERT-S): Psychometric properties and construct validation. Behavior Research Methods, 48, 1383–1392.

    Article  PubMed  Google Scholar 

  • Schlegel, K. (manuscript in preparation). How emotion recognition training affects negotiation behavior and outcomes.

  • Schlegel, K., Boone, R. T., & Hall, J. A. (2017a). Individual differences in interpersonal accuracy: A multi-level meta-analysis to assess whether judging other people is one skill or many. Journal of Nonverbal Behavior, 41(2), 103–137.

    Article  Google Scholar 

  • Schlegel, K., Fontaine, J. R., & Scherer, K. R. (2017b). The nomological network of emotion recognition ability: Evidence from the Geneva emotion recognition test. European Journal of Psychological Assessment. http://doi.org/10.1027/1015-5759/a000396.

  • Sheldon, O. J., Dunning, D., & Ames, D. R. (2014). Emotionally unskilled, unaware, and uninterested in learning more: Reactions to feedback about deficits in emotional intelligence. Journal of Applied Psychology, 99(1), 125–137.

    Article  PubMed  Google Scholar 

  • Silver, H., Goodman, C., Knoll, G., & Isakov, V. (2004). Brief emotion training improves recognition of facial emotions in chronic schizophrenia. A pilot study. Psychiatry Research, 128(2), 147–154.

    Article  PubMed  Google Scholar 

  • Snellen, H. (1862). Probebuchstaben zur Bestimmung der Sehschärfe, Utrecht: Peters Edition.

    Google Scholar 

  • Sullivan, S., Campbell, A., Hutton, S. B., & Ruffman, T. (2017). What’s good for the goose is not good for the gander: Age and gender differences in scanning emotion faces. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 72(3), 441–443.

    Article  Google Scholar 

  • Thompson, E. R. (2007). Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242.

    Article  Google Scholar 

  • Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015). The WHO-5 well-being index: A systematic review of the literature. Psychotherapy and Psychosomatics, 84(3), 167–176.

    Article  PubMed  Google Scholar 

  • Van Kleef, G. A. (2010). The emerging view of emotion as social information. Social and Personality Psychology Compass, 4(5), 331–343.

    Article  Google Scholar 

  • Wagner, H. L. (1993). On measuring performance in category judgment studies of nonverbal behavior. Journal of Nonverbal Behavior, 17(1), 3–28.

    Article  Google Scholar 

  • Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54(6), 1063–1070.

    Article  PubMed  Google Scholar 

  • Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale–Revised. New York: Psychological Corporation.

    Google Scholar 

  • Weiss, R. H. (2006). Grundintelligenztest Skala 2 (CFT 20-R) mit Wortschatztest (WS) und Zahlenfolgentest (ZF)—Revision. Göttingen: Hogrefe.

    Google Scholar 

  • Zachary, R. (1986). Shipley Institute of Living Scale, revised manual. Los Angeles: Western Psychological Services.

    Google Scholar 

Download references

Funding

This research was funded by an Early Postdoc.Mobility fellowship awarded to K. Schlegel by the Swiss National Science Foundation, grant number P2GEP1_155698.

Author information

Authors and Affiliations

  1. Institute of Psychology, University of Bern, Fabrikstrasse 8, 3012, Bern, Switzerland

    Katja Schlegel

  2. Northeastern University, Boston, MA, USA

    Ishabel M. Vicaria, Derek M. Isaacowitz & Judith A. Hall

Authors
  1. Katja Schlegel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ishabel M. Vicaria
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Derek M. Isaacowitz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Judith A. Hall
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katja Schlegel.

Ethics declarations

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 97 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schlegel, K., Vicaria, I.M., Isaacowitz, D.M. et al. Effectiveness of a short audiovisual emotion recognition training program in adults. Motiv Emot 41, 646–660 (2017). https://doi.org/10.1007/s11031-017-9631-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11031-017-9631-9

Keywords

Search

Navigation