The Effects of ‘Face’ on Listening Comprehension: Evidence from Advanced Jordanian Speakers of English

  • Jihad M. Hamdan
  • Rose Fowler Al-Hawamdeh


This empirical study examines the extent to which ‘face’, i.e. (audio visual dialogues), affects the listening comprehension of advanced Jordanian EFL learners in a TOFEL-like test, as opposed to its absence (i.e. a purely audio test) which is the current norm in many English language proficiency tests, including but not limited to TOFEL iBT, TOEIC and academic IELTS. Through an online experiment, 60 Jordanian postgraduate linguistics and English literature students (advanced EFL learners) at the University of Jordan sit for two listening tests (simulating English proficiency tests); namely, one which is purely audio [i.e. without any face (including any visuals such as motion, as well as still pictures)], and one which is audiovisual/video. The results clearly show that the inclusion of visuals enhances subjects’ performance in listening tests. It is concluded that since the aim of English proficiency tests such as TOEFL iBT is to qualify or disqualify subjects to work and study in western English-speaking countries, the exclusion of visuals is unfounded. In actuality, most natural interaction includes visibility of the interlocutors involved, and hence test takers who sit purely audio proficiency tests in English or any other language are placed at a disadvantage.


Audiovisual Audio-only Face Listening test Listening comprehension proficiency tests TOFEL 


  1. Atkinson, A. P., & Adolphs, R. (2011). The neuropsychology of face perception: Beyond simple dissociations and functional selectivity. Philosophical Transactions of the Royal Society B, 366, 1726–1738.CrossRefGoogle Scholar
  2. Baltova, I. (1994). The impact of video on the comprehension skills of core French students. Canadian Modern Language Review, 50(3), 507–531.Google Scholar
  3. Başall, A., Gülözer, K., & Demir, I. (2015). Use of video and audio texts in EFL listening exams. Journal of Education and Training Studies, 3(6), 83–89.Google Scholar
  4. Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25(1), 39–53.CrossRefGoogle Scholar
  5. Buck, G. (2001). Assessing Listening. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  6. Çakır, İ. (2006). The use of video as an audiovisual material in foreign language teaching classroom. The Turkish Online Journal of Educational Technology, 5(4), 67–72.Google Scholar
  7. Canning-Wilson, C. (2000). Practical aspects of using video in the EFL and ESL classroom. The Internet TESL Journal, 6(11), 1–6.Google Scholar
  8. Chung, U. K. (1994). The effect of audio, a single picture, multiple pictures or video on second-language listening comprehension. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.Google Scholar
  9. Cross, J. (2011). Comprehending news videotexts: The influence of the visual content. Language Learning and Technology, 15(2), 44–68.Google Scholar
  10. Driver, J. (1996). Enhancement of selective listening of illusory mislocation of speech sounds due to lip reading. Nature, 381(6577), 66–68.CrossRefPubMedGoogle Scholar
  11. Erber, N. P. (1975). Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40(4), 481–492.CrossRefPubMedGoogle Scholar
  12. Feak, C. B., & Salehzadeh, J. (2001). Challenges and issues in developing an EAP video listening placement assessment: A view from one program. English for Specific Purposes, 20, 477–493.CrossRefGoogle Scholar
  13. Field, J. (2015). The effects of single and double play upon listening test outcomes and cognitive processing. Retrieved November 8, 2016, from
  14. Fowler, C. A., & Magnuson, J. S. (2012). Speech perception. In M. J. Spivey, K. McRae, & M. F. Joanisse (Eds.), The Cambridge handbook of psycholinguistics (pp. 3–25). New York: Cambridge University Press.CrossRefGoogle Scholar
  15. Gregersen, T. S. (2007). Language learning beyond words: Incorporating body language into classroom activities. Reflections on English Language Teaching, 6(1), 51–64.Google Scholar
  16. Hernandez, S. S. (2004). The effects of video and captioned text and the influence of verbal and spatial abilities on second language listening comprehension in a multimedia learning environment. Unpublished doctoral dissertation, New York University, New York.Google Scholar
  17. Kamachi, M. G., Hill, H., Lander, K., & Vatikiotis-Bateson, E. (2003). Putting the face to the voice: matching identity across modality. Current Biology, 13(19), 1709–1714.CrossRefPubMedGoogle Scholar
  18. Kellerman, S. (1992). I see what you mean: The role of kinesic behaviour in listening and the implications for foreign and second language learning. Applied Linguistics, 13(3), 239–258.CrossRefGoogle Scholar
  19. Lachs, L. (2002). Vocal tract kinematics and cross modal speech information. Unpublished doctoral thesis, Indiana University, Indiana, USA.Google Scholar
  20. Leeser, M. J. (2004). The effects of topic familiarity, mode and pausing on second language learners’ comprehension and focus on form. Studies in Second Language Acquisition, 26(4), 587–615.CrossRefGoogle Scholar
  21. Londe, Z. C. (2009). The effects of video media in English as a second language listening comprehension exams. Issues in Applied Linguistics, 17(1), 41–50.Google Scholar
  22. McGurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746–748.CrossRefPubMedGoogle Scholar
  23. Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility head movement improves auditory speech perception. Psychological Science, 15(2), 133–137.CrossRefPubMedGoogle Scholar
  24. Nicholas R., & Karakoc, S. (2016). The effect of explicit instruction on English language learner recognition of sarcasm. Retrieved November 12, 2016, from
  25. Ockey, G. (2007). Construct implication of including still image or video in computer-based listening exams. Language Testing, 24(4), 517–537.CrossRefGoogle Scholar
  26. Parry, T. S., & Meredith, R. A. (1984). Videotape vs. audiotape for listening comprehension tests: An experiment. OMLTA Journal, 47, 53. Retrieved December 19, 2016, from
  27. Progosh, D. (1996). Using video for listening assessment: Opinions of test takers. TESL Canada Journal, 14(1), 34–41.CrossRefGoogle Scholar
  28. Pusey, K., & Lenz, K. (2014). Investigating the interaction of visual input, working memory, and listening comprehension. Language Education in Asia, 5(1), 66–80.CrossRefGoogle Scholar
  29. Rilliard, A., Shochi, T., Martin, J. C., Erikson, D., & Aubergé, V. (2009). Multimodal indices to Japanese and French prosodically expressed social affects. Language and Speech, 52(2–3), 223–243.CrossRefPubMedGoogle Scholar
  30. Rosenblum, L. D., & Saldana, H. M. (1998). Time varying information for speech perception. In R. Campbell, B. Dod, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 61–81). East Sussex: Psychology Press Ltd.Google Scholar
  31. Rosenblum, L. D., Yakel, D. A., Baseer, N., Panchal, A., Nodarse, B. C., & Niehus, R. P. (2002). Visual speech information for face recognition. Perception and Psychophysics, 64(2), 220–229.CrossRefPubMedGoogle Scholar
  32. Schwartz, J., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audiovisual interactions in speech identification. Cognition, 93(2), 69–78.CrossRefGoogle Scholar
  33. Shin, D. (1998). Using videotaped lectures for testing academic listening proficiency. International Journal of Listening, 12(1), 57–80.CrossRefGoogle Scholar
  34. Sueyoshi, A., & Hardison, D. (2005). The role of gestures and facial cues in second language listening comprehension. Language Learning, 55(4), 661–699.CrossRefGoogle Scholar
  35. Sumby, W. H., & Pollack, I. (1954). Visual contributions to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212–215.CrossRefGoogle Scholar
  36. Suvorov, R. (2009). Context visuals in L2 listening exams: The effects of photographs and video vs. audio-only format. In C. A. Chapelle, G. Jun, & I. Katz (Eds.), Developing and evaluating language learning materials (pp. 53–68). Ames: Iowa State University.Google Scholar
  37. Vandergrift, L. (1999). Facilitating second language listening comprehension: Acquiring successful strategies. ELT Journal, 53(3), 168–176.CrossRefGoogle Scholar
  38. Voigt, R., Podesva, J. R., & Jurafsky, D. (2014). Speaker movement correlates with prosodic indicators of engagement. Retrieved November 8, 2016, from
  39. Wagner, E. (2010a). How does the use of video texts affect ESL listening test-taker performance? Language Testing, 27(4), 493–510.CrossRefGoogle Scholar
  40. Wagner, E. (2010b). Test-takers’ interaction with an L2 video listening test. System, 38(2), 280–291.CrossRefGoogle Scholar
  41. Wagner, E. (2013). An investigation of how the channel of input and access to test questions affect L2 listening test performance. Language Assessment Quarterly, 10(2), 178–195.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of English Language and LiteratureThe University of JordanAmmanJordan

Personalised recommendations