Abstract
This paper concerns the correlation between cognition test results from audio and audio-visual effects on nine English emotional words and the physio-acoustic distances. Two parameters were selected; F0 and intensity. The two types of distance were calculated: the average and pattern-distance for each emotion. 2 Japanese, 2 Finnish, and 1 English group participated in the cognition tests. Regarding cognition, the correct answer ratios were higher in audio-visual than audio for all three languages. The difference between audio and audio-visual was much smaller in Japanese than in the other languages. Finnish showed different correct answer patterns than the others. The correlation between cognition and distances confirmed that the pattern distance was more correlated with cognition than with average distance in both audio and audio-visual. Also, it seems that intensity was more correlated with cognition than F0.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Isei-Jaakkola, T., Neff, P.: Japanese L2 Learner’s Emotional Cognition of English Intonation. In: Proceedings of 7th Annual Congress of EPSJ (2002)
Isei-Jaakkola, T., Soga, S., Barat, R.: Audio and Audio-visual Effects on English Emotions by Japanese L2. In: A Handbook for the EPSJ Kanto Branch 6th Meeting, pp. 63–68 (2004)
Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of English Emotional Word on Japanese L2’s Cognition and the Acoustic Correlate. In: Proceedings of SPECOM 2005, pp. 455–458 (2005)
Isei-Jaakkola, T., Sun, Q., Hirose, K.: Audio and Audio-visual Effects of a Short English Emotional Sentence on Japanese L2’s and English L1’s Cognition, and Physio-acoustic Correlate. In: Proceedings of Int. Conf. of Speech Prosody Dresden (2006)
Scherer, K.R.: Cross-cultural Investigation of Emotion Inferences from Voice and Speech: Implications of Speech and Technology. In: Proceedings of ICSLP Beijing, vol. 2, pp. 379–382 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Isei-Jaakkola, T. (2006). Cognition and Physio-acoustic Correlates — Audio and Audio-visual Effects of a Short English Emotional Statement: On JL2, FL2 and EL1. In: Salakoski, T., Ginter, F., Pyysalo, S., Pahikkala, T. (eds) Advances in Natural Language Processing. FinTAL 2006. Lecture Notes in Computer Science(), vol 4139. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11816508_18
Download citation
DOI: https://doi.org/10.1007/11816508_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37334-6
Online ISBN: 978-3-540-37336-0
eBook Packages: Computer ScienceComputer Science (R0)