Skip to main content
SpringerLink
Log in

The State of Emotional Prosody Research—A Meta-Analysis

  • Chapter
  • First Online:
Emotional Prosody Processing for Non-Native English Speakers

Part of the book series: The Bilingual Mind and Brain Book Series ((BMBBS,volume 3))

Abstract

Emotional prosody research is a loosely organized field of research with a body of evidence consisting of major contributions from psychological, neuropsychological, and clinical studies. Research on emotional prosody has long been slowed down by a combination of technical, procedural, and ethical issues connected to the development of stimuli, which remains a major issue in the field to this day. Considered as a whole, the field is also a bed of contradictions as it is theoretically devoted to universal basic emotions framework (Ekman 1992), but methodologically it is overwhelmingly English-centric. The grand majority of research is conducted in English, about English emotional prosody with monolingual English speakers. The few studies which venture outside the English-speaking world still investigate monolingual native populations. In other words, the field is committed theoretically to substantiating the universal basic emotions theory, but is methodologically unfit to do so. This chapter is a detailed meta-analysis and critique of the existing empirical literature on the emotional prosody processing with a focus on the potential practical solutions to the weaknesses of the existing methodologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alba-Ferrara, L., Hausmann, M., Mitchell, R. L., & Weis, S. (2011). The neural correlates of emotional prosody comprehension: Disentangling simple from complex emotion. PLoS ONE, 6(12), 1–10.

    Article  Google Scholar 

  • Bach, D. R., Grandjean, D., Sander, D., Herdener, M., Strik, W. K., & Seifritz, E. (2008). The effect of appraisal level on processing of emotional prosody in meaningless speech. NeuroImage, 42, 919–927.

    Article  Google Scholar 

  • Bagby, R. M., Parker, J. D. A., & Taylor, G. J. (1994). The twenty-item Toronto Alexithymia Scale—I. Item selection and cross-validation of the factor structure. Journal of Psychosomatic Research, 38(1), 23–32.

    Article  PubMed  Google Scholar 

  • Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636.

    Article  PubMed  Google Scholar 

  • Bostanov, V., & Kotchoubey, B. (2003). Recognition of affective prosody: Continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology, 41, 259–268.

    Article  Google Scholar 

  • Busso, C., Lee, S., & Narayanan, S. (2009). Analysis of emotionally salient aspects of fundamental frequency for emotion detection. IEEE Transactions on Audio, Speech and Language Processing, 17(4), 582–596.

    Article  Google Scholar 

  • Castro, S. L., & Lima, C. F. (2010). Recognizing emotions in spoken language: A validated set of Portuguese sentences and pseudosentences for research on emotional prosody. Behavior Research Methods, 42(1), 74–81.

    Article  PubMed  Google Scholar 

  • Cornew, L., Carver, L., & Love, T. (2009). There’s more to emotion than meets the eye: A processing bias for neutral content in the domain of emotional prosody. Cognition and Emotion, 24(7), 1133–1152.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dimoska, A., McDonald, S., Pell, M. D., Tate, R. L., & James, C. M. (2010). Recognizing vocal expressions of emotion in patients with social skills deficits following traumatic brain injury. Journal of the International Neuropsychological Society, 16, 369–382.

    Article  PubMed  Google Scholar 

  • Drolet, M., Schubotz, R. I., & Fischer, J. (2012). Authenticity affects the recognition of emotions in speech: Behavioral and fMRI evidence. Cognitive, Affective and Behavioral Neuroscience, 12, 140–150.

    Article  PubMed  Google Scholar 

  • Ekman, P. (1992). An argument for basic emotions. Cognition and Emotion, 6(3/4), 169–200.

    Article  Google Scholar 

  • Ekman, P. (2003). Sixteen enjoyable emotions. Emotion Researcher, 18, 6–7.

    Google Scholar 

  • Elfenbein, H. A., & Ambady, N. (2002a). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128(2), 203–235.

    Article  PubMed  Google Scholar 

  • Elfenbein, H. A., & Ambady, N. (2002b). Is there an in-group advantage in emotion recognition? Psychological Bulletin, 128(2), 243–249.

    Article  PubMed  Google Scholar 

  • Fujiki, M., Spackman, M. P., Brinton, B., & Illig, T. (2008). Ability of children with language impairment to understand emotion conveyed by prosody in a narrative passage. International Journal of Language and Communication Disorders, 43(3), 330–345.

    Article  PubMed  Google Scholar 

  • Fujisawa, T., & Shinohara, K. (2011). Sex differences in the recognition of emotional prosody in late childhood and adolescence. Journal of Physiological Science, 61, 429–435.

    Article  Google Scholar 

  • Goerlich, K. S., Witteman, J., Aleman, A., & Martens, S. (2011). Hearing feelings: Affective categorization of music and speech in alexithymia, an ERP study. PLoS ONE, 6(5), 1–11.

    Article  Google Scholar 

  • Graddol, D. (2003). The decline of the native speaker. In G. Anderman & M. Rogers (Eds.), Translation today. Trends and perspectives (pp. 152–167). Clevedon: Multilingual Matters Ltd.

    Google Scholar 

  • Hoekert, M., Kahn, R. S., Pijnenborg, M., & Aleman, A. (2007). Impaired recognition and expression of emotional prosody in schizophrenia: Review and meta-analysis. Schizophrenia Research, 96, 135–145.

    Article  PubMed  Google Scholar 

  • Hopyan-Misakyan, T. M., Gordon, K. A., Dennis, M., & Papsin, B. C. (2009). Recognition of affective speech prosody and facial affect in deaf children with unilateral right cochlear implants. Child Neuropsychology, 15, 136–146.

    Article  PubMed  Google Scholar 

  • HUMAINE (Human-Machine Interaction Network on Emotion) Project. (2013). http://emotion-research.net/projects/humaine/aboutHUMAINE. Accessed May 1, 2013.

  • Kan, Y., Kawamura, M., Hasegawa, Y., Mochizuki, S., & Nakamura, K. (2002). Recognition of emotion from facial, prosodic, and written verbal stimuli in Parkinson’s disease. Cortex, 38, 623–630.

    Article  PubMed  Google Scholar 

  • Kitayama, S., & Ishii, K. (2002). Word and voice: Spontaneous attention to emotional utterances in two languages. Cognition and Emotion, 16(1), 29–59.

    Article  Google Scholar 

  • Kopytko, R. (2002). The mental aspects of pragmatic theory: An integrative view. Poznań: Motivex.

    Google Scholar 

  • Kotz, S., & Paumlann, S. (2007). When emotional prosody and semantics dance cheek to cheek: ERP evidence. Research report. Brain Research, 1151, 107–118.

    Article  PubMed  Google Scholar 

  • Landis, C. (1924). Studies of emotional reactions. General behavior and facial expression. Comparative Psychology, 4(5), 447–501.

    Article  Google Scholar 

  • Li, P., Zhang, F., Tsai, E., & Puls, B. (2014). Language history questionnaire (LHQ 2.0): A new dynamic web-based research tool. Bilingualism: Language and Cognition, 17(3), 673–680.

    Google Scholar 

  • Lindner, J. L., & Rosen, L. A. (2006). Decoding of emotion through facial expression, prosody and verbal content in children and adolescents with Asperger’s syndrome. Journal of Autism and Developmental Disorder, 36, 769–777.

    Article  Google Scholar 

  • Mesquita, B., & Frijda, N. H. (1992). Cultural variations in emotions: A review. Psychological Bulletin, 112(2), 179–204.

    Article  PubMed  Google Scholar 

  • Mitchell, R. L. C. (2006a). How does the brain mediate interpretation of incongruent auditory emotions? The neural response to prosody in the presence of conflicting lexico-semantic cues. European Journal of Neuroscience, 24, 3611–3618.

    Article  PubMed  Google Scholar 

  • Mitchell, R. M. C. (2006b). Does incongruence of lexicosemantic and prosodic information cause discernible cognitive conflict? Cognitive, Affective and Behavioral Neuroscience, 6(4), 298–305.

    Article  PubMed  Google Scholar 

  • Mitchell, R. L. C., Elliott, R., Barry, M., Cruttenden, A., & Woodruf, P. W. R. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia, 41, 1410–1421.

    Article  Google Scholar 

  • Mitchell, R. L. C., Elliott, R., Barry, M., Cruttenden, A., & Woodruf, P. W. R. (2004). Neural response to emotional prosody in schizophrenia and in bipolar affective disorder. British Journal of Psychiatry, 184, 223–230.

    Article  PubMed  Google Scholar 

  • Paulmann, S., & Pell, M. D. (2011). Is there an advantage for recognizing multi-modal emotional stimuli? Motivation and Emotion, 35, 192–201.

    Article  Google Scholar 

  • Paulmann, S., Pell, M. D., & Kotz, S. A. (2008a). Functional contributions of the basal ganglia to emotional prosody: Evidence from ERPs. Brain Research, 1217, 171–178.

    Article  Google Scholar 

  • Paulmann, S., Pell, M. D., & Kotz, S. A. (2008b). How aging affects the recognition of emotional speech. Brain and Language, 104, 262–269.

    Article  Google Scholar 

  • Paulmann, S., Sebastian, S., & Kotz, S. A. (2010). Orbito-frontal lesions cause impairment during late but not early emotional prosodic processing. Social Neuroscience, 5(1), 59–75.

    Article  PubMed  Google Scholar 

  • Pell, M. D., Monetta, L., Paulmann, S., & Kotz, S. A. (2009a). Recognizing emotions in a foreign language. Journal of Nonverbal Behavior, 33, 107–120.

    Google Scholar 

  • Pell, M. D., Paulmann, S., Dara, C., Alasseri, A., & Kotz, S. A. (2009b). Factors in recognition in the recognition of vocally expressed emotions. A comparison of four languages. Journal of Phonetics, 37, 417–435.

    Google Scholar 

  • Rigoulot, S., Wassiliwizky, E., & Pell, M. D. (2013). Feeling backwards? How temporal order in speech affects the time course of vocal emotion recognition. Frontiers in Psychology, 4, 1–14.

    Article  Google Scholar 

  • Rota, G., Veit, R., Nardo, D., Weiskopf, N., Birbaumer, N., & Dogil, G. (2008). Processing of inconsistent emotional information: An fMRI study. Experimental Brain Research, 186, 401–407.

    Article  PubMed  Google Scholar 

  • Rottenberg, J., Ray, R. D., & Gross, J. J. (2007). Emotion elicitation using films. In J. A. Coan, & J. J. B. Allen (Eds.), Handbook of emotion elicitation and assessment (pp. 9-28). New York: Oxford University Press.

    Google Scholar 

  • Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115(1), 102–141.

    Article  PubMed  Google Scholar 

  • Russell, J. A., & Barrett, L. F. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76(5), 805–819.

    Article  PubMed  Google Scholar 

  • Russell, J. A., Bachorowski, J., & Fernandez-Dols, J. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329–349.

    Article  PubMed  Google Scholar 

  • Sauter, D. A., Eisner, F., Ekman, P., & Scott, S. K. (2009). Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations. PNAS, 107(6), 2408–2414.

    Article  Google Scholar 

  • Scherer, K. R., Johnstone, T., & Klasmeyer, G. (2003). Vocal expression of emotion. In R. J. Davidson, H. Goldsmith, & K. R. Scherer (Eds.), Handbook of the affective sciences (pp. 433–456). New York: Oxford University Press.

    Google Scholar 

  • Schirmer, A. (2010). Mark my words: Tone of voice changes affective word representations in memory. PLoS ONE, 5(2), e9080.

    Article  PubMed  PubMed Central  Google Scholar 

  • Schirmer, A., & Kotz, S. A. (2003). ERP Evidence for a sex-specific Stroop effect in emotional speech. Journal of Cognitive Neuroscience, 15(8), 1135–1148.

    Article  PubMed  Google Scholar 

  • Schirmer, A., Kotz, S. A., & Friederici, A. D. (2005). On the role of attention for the processing of emotions in speech: Sex differences revisited. Cognitive Brain Research, 24, 442–452.

    Article  PubMed  Google Scholar 

  • Schmidt, A. T., Hanten, G. R., Li, X., Orsten, K. D., & Levin, H. S. (2010). Emotion recognition following pediatric traumatic brain injury: Longitudinal analysis of emotional prosody and facial emotion recognition. Neuropsychologia, 48(10), 2869–2877.

    Article  PubMed  PubMed Central  Google Scholar 

  • Sneddon, I., McRorie, M., McKeown, G., & Hanratty, J. (2007). The Belfast induced natural emotion database. IEEE Transactions on Affective Computing, 3(1), 32–41.

    Article  Google Scholar 

  • Sorocco, K. H., Monnot, M., Vincent, A. S., Ross, E. D., & Lovallo, W. R. (2009). Deficits in affective prosody comprehension: Family history of alcoholism versus alcohol exposure. Alcohol and Alcoholism, 45(1), 25–29.

    Article  PubMed  PubMed Central  Google Scholar 

  • Speedie, L. J., Brake, N., Folstein, S. E., Bowers, D., & Heilman, K. M. (1990). Comprehension of prosody in Huntington’s disease. Journal of Neurology, Neurosurgery and Psychiatry, 53, 607–610.

    Article  PubMed  PubMed Central  Google Scholar 

  • Taler, V., Baum, S. R., Chertkow, H., & Saumier, D. (2008). Comprehension of grammatical and emotional prosody is impaired in Alzheimer’s disease. Neuropsychology, 22(2), 188–195.

    Article  PubMed  Google Scholar 

  • Thompson, W. F., & Balkwill, L. L. (2006). Decoding speech prosody in five languages. Semiotica, 158(1/4), 407–424.

    Google Scholar 

  • Uekerman, J., Kramer, M., Abdel-Hamid, M., Schimmelmann, B. G., Hebebrand, J., Daum, I., et al. (2010). Social cognition in attention-deficit hyperactivity disorder (ADHD). Neuroscience and Biobehavioral Reviews, 34, 734–743.

    Article  Google Scholar 

  • Velten, E. (1968). A laboratory task for induction of mood states. Behavioral Research and Therapy, 6, 473–482.

    Article  Google Scholar 

  • Ververidis, D., & Kotropoulos, C. (2003). A state of the art review on emotional speech databases. In Proceedings of 1st Richmedia Conference. doi:10.1.1.420.6988

    Google Scholar 

  • Ververidis, D., & Kotropoulos, C. (2006). Emotional speech recognition: Resources, features, and methods. Speech Communication, 48, 1162–1181.

    Article  Google Scholar 

  • Wallbott, H. G., & Scherer, K. R. (1986). Cues and channels in emotion recognition. Journal of Personality and Social Psychology, 51(4), 690–699.

    Article  Google Scholar 

  • Watson, J. B., & Rayner, R. (1920). Conditioned emotional reactions. Journal of Experimental Psychology, 3(1), 1–14.

    Article  Google Scholar 

  • Xu, Y. (2010). In defense of lab speech. Journal of Phonetics, 38, 329–336.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of English, Adam Mickiewicz University, Poznań, Poland

    Halszka Bąk

Authors
  1. Halszka Bąk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Halszka Bąk .

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Bąk, H. (2016). The State of Emotional Prosody Research—A Meta-Analysis. In: Emotional Prosody Processing for Non-Native English Speakers. The Bilingual Mind and Brain Book Series, vol 3. Springer, Cham. https://doi.org/10.1007/978-3-319-44042-2_5

Download citation

Publish with us

Policies and ethics

Search

Navigation