Skip to main content

Advertisement

SpringerLink
Log in

The Effects of ‘Face’ on Listening Comprehension: Evidence from Advanced Jordanian Speakers of English

  • Published:
Journal of Psycholinguistic Research Aims and scope Submit manuscript

Abstract

This empirical study examines the extent to which ‘face’, i.e. (audio visual dialogues), affects the listening comprehension of advanced Jordanian EFL learners in a TOFEL-like test, as opposed to its absence (i.e. a purely audio test) which is the current norm in many English language proficiency tests, including but not limited to TOFEL iBT, TOEIC and academic IELTS. Through an online experiment, 60 Jordanian postgraduate linguistics and English literature students (advanced EFL learners) at the University of Jordan sit for two listening tests (simulating English proficiency tests); namely, one which is purely audio [i.e. without any face (including any visuals such as motion, as well as still pictures)], and one which is audiovisual/video. The results clearly show that the inclusion of visuals enhances subjects’ performance in listening tests. It is concluded that since the aim of English proficiency tests such as TOEFL iBT is to qualify or disqualify subjects to work and study in western English-speaking countries, the exclusion of visuals is unfounded. In actuality, most natural interaction includes visibility of the interlocutors involved, and hence test takers who sit purely audio proficiency tests in English or any other language are placed at a disadvantage.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Atkinson, A. P., & Adolphs, R. (2011). The neuropsychology of face perception: Beyond simple dissociations and functional selectivity. Philosophical Transactions of the Royal Society B, 366, 1726–1738.

    Article  Google Scholar 

  • Baltova, I. (1994). The impact of video on the comprehension skills of core French students. Canadian Modern Language Review, 50(3), 507–531.

    Article  Google Scholar 

  • Başall, A., Gülözer, K., & Demir, I. (2015). Use of video and audio texts in EFL listening exams. Journal of Education and Training Studies, 3(6), 83–89.

    Google Scholar 

  • Brett, P. (1997). A comparative study of the effects of the use of multimedia on listening comprehension. System, 25(1), 39–53.

    Article  Google Scholar 

  • Buck, G. (2001). Assessing Listening. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Çakır, İ. (2006). The use of video as an audiovisual material in foreign language teaching classroom. The Turkish Online Journal of Educational Technology, 5(4), 67–72.

    Google Scholar 

  • Canning-Wilson, C. (2000). Practical aspects of using video in the EFL and ESL classroom. The Internet TESL Journal, 6(11), 1–6.

    Google Scholar 

  • Chung, U. K. (1994). The effect of audio, a single picture, multiple pictures or video on second-language listening comprehension. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.

  • Cross, J. (2011). Comprehending news videotexts: The influence of the visual content. Language Learning and Technology, 15(2), 44–68.

    Google Scholar 

  • Driver, J. (1996). Enhancement of selective listening of illusory mislocation of speech sounds due to lip reading. Nature, 381(6577), 66–68.

    Article  Google Scholar 

  • Erber, N. P. (1975). Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40(4), 481–492.

    Article  Google Scholar 

  • Feak, C. B., & Salehzadeh, J. (2001). Challenges and issues in developing an EAP video listening placement assessment: A view from one program. English for Specific Purposes, 20, 477–493.

    Article  Google Scholar 

  • Field, J. (2015). The effects of single and double play upon listening test outcomes and cognitive processing. Retrieved November 8, 2016, from https://www.britishcouncil.org/exam/aptis/reserach.

  • Fowler, C. A., & Magnuson, J. S. (2012). Speech perception. In M. J. Spivey, K. McRae, & M. F. Joanisse (Eds.), The Cambridge handbook of psycholinguistics (pp. 3–25). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Gregersen, T. S. (2007). Language learning beyond words: Incorporating body language into classroom activities. Reflections on English Language Teaching, 6(1), 51–64.

    Google Scholar 

  • Hernandez, S. S. (2004). The effects of video and captioned text and the influence of verbal and spatial abilities on second language listening comprehension in a multimedia learning environment. Unpublished doctoral dissertation, New York University, New York.

  • Kamachi, M. G., Hill, H., Lander, K., & Vatikiotis-Bateson, E. (2003). Putting the face to the voice: matching identity across modality. Current Biology, 13(19), 1709–1714.

    Article  Google Scholar 

  • Kellerman, S. (1992). I see what you mean: The role of kinesic behaviour in listening and the implications for foreign and second language learning. Applied Linguistics, 13(3), 239–258.

    Article  Google Scholar 

  • Lachs, L. (2002). Vocal tract kinematics and cross modal speech information. Unpublished doctoral thesis, Indiana University, Indiana, USA.

  • Leeser, M. J. (2004). The effects of topic familiarity, mode and pausing on second language learners’ comprehension and focus on form. Studies in Second Language Acquisition, 26(4), 587–615.

    Article  Google Scholar 

  • Londe, Z. C. (2009). The effects of video media in English as a second language listening comprehension exams. Issues in Applied Linguistics, 17(1), 41–50.

    Google Scholar 

  • McGurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264(5588), 746–748.

    Article  Google Scholar 

  • Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility head movement improves auditory speech perception. Psychological Science, 15(2), 133–137.

    Article  Google Scholar 

  • Nicholas R., & Karakoc, S. (2016). The effect of explicit instruction on English language learner recognition of sarcasm. Retrieved November 12, 2016, from https://www.nau.edu/CAL/PIE.

  • Ockey, G. (2007). Construct implication of including still image or video in computer-based listening exams. Language Testing, 24(4), 517–537.

    Article  Google Scholar 

  • Parry, T. S., & Meredith, R. A. (1984). Videotape vs. audiotape for listening comprehension tests: An experiment. OMLTA Journal, 47, 53. Retrieved December 19, 2016, from http://www.eric.ed.gov.

  • Progosh, D. (1996). Using video for listening assessment: Opinions of test takers. TESL Canada Journal, 14(1), 34–41.

    Article  Google Scholar 

  • Pusey, K., & Lenz, K. (2014). Investigating the interaction of visual input, working memory, and listening comprehension. Language Education in Asia, 5(1), 66–80.

    Article  Google Scholar 

  • Rilliard, A., Shochi, T., Martin, J. C., Erikson, D., & Aubergé, V. (2009). Multimodal indices to Japanese and French prosodically expressed social affects. Language and Speech, 52(2–3), 223–243.

    Article  Google Scholar 

  • Rosenblum, L. D., & Saldana, H. M. (1998). Time varying information for speech perception. In R. Campbell, B. Dod, & D. Burnham (Eds.), Hearing by eye II: Advances in the psychology of speechreading and auditory-visual speech (pp. 61–81). East Sussex: Psychology Press Ltd.

    Google Scholar 

  • Rosenblum, L. D., Yakel, D. A., Baseer, N., Panchal, A., Nodarse, B. C., & Niehus, R. P. (2002). Visual speech information for face recognition. Perception and Psychophysics, 64(2), 220–229.

    Article  Google Scholar 

  • Schwartz, J., Berthommier, F., & Savariaux, C. (2004). Seeing to hear better: Evidence for early audiovisual interactions in speech identification. Cognition, 93(2), 69–78.

    Article  Google Scholar 

  • Shin, D. (1998). Using videotaped lectures for testing academic listening proficiency. International Journal of Listening, 12(1), 57–80.

    Article  Google Scholar 

  • Sueyoshi, A., & Hardison, D. (2005). The role of gestures and facial cues in second language listening comprehension. Language Learning, 55(4), 661–699.

    Article  Google Scholar 

  • Sumby, W. H., & Pollack, I. (1954). Visual contributions to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212–215.

    Article  Google Scholar 

  • Suvorov, R. (2009). Context visuals in L2 listening exams: The effects of photographs and video vs. audio-only format. In C. A. Chapelle, G. Jun, & I. Katz (Eds.), Developing and evaluating language learning materials (pp. 53–68). Ames: Iowa State University.

    Google Scholar 

  • Vandergrift, L. (1999). Facilitating second language listening comprehension: Acquiring successful strategies. ELT Journal, 53(3), 168–176.

    Article  Google Scholar 

  • Voigt, R., Podesva, J. R., & Jurafsky, D. (2014). Speaker movement correlates with prosodic indicators of engagement. Retrieved November 8, 2016, from https://www.nip.stanford.edu/robvoigt.

  • Wagner, E. (2010a). How does the use of video texts affect ESL listening test-taker performance? Language Testing, 27(4), 493–510.

    Article  Google Scholar 

  • Wagner, E. (2010b). Test-takers’ interaction with an L2 video listening test. System, 38(2), 280–291.

    Article  Google Scholar 

  • Wagner, E. (2013). An investigation of how the channel of input and access to test questions affect L2 listening test performance. Language Assessment Quarterly, 10(2), 178–195.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of English Language and Literature, The University of Jordan, Amman, Jordan

    Jihad M. Hamdan & Rose Fowler Al-Hawamdeh

Authors
  1. Jihad M. Hamdan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rose Fowler Al-Hawamdeh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jihad M. Hamdan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamdan, J.M., Al-Hawamdeh, R.F. The Effects of ‘Face’ on Listening Comprehension: Evidence from Advanced Jordanian Speakers of English. J Psycholinguist Res 47, 1121–1131 (2018). https://doi.org/10.1007/s10936-018-9582-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10936-018-9582-7

Keywords

Search

Navigation