Advertisement

The Power of an Image: Images, Not Glosses, Enhance Learning of Concrete L2 Words in Beginning Learners

  • Laura M. Morett
Article
  • 35 Downloads

Abstract

Prior research suggests that viewing still images and iconic gestures depicting concepts facilitates the learning of concrete words in the initial stages of second language (L2) acquisition. To date, however, the effect of viewing iconic gestures and images hasn’t been systematically compared to the effect of glosses in the learning and retrieval of concrete words in early stage L2 acquisition. Therefore, it is unclear whether dual coding theory of embodied theories of cognition provide the most accurate account of these effects. This study demonstrates that concrete L2 words learned via viewing still images are recalled better than L2 words learned via viewing iconic gesture and that L1 glosses fail to facilitate L2 word learning in beginning learners. Together, these findings indicate that images facilitate the learning of concrete L2 words above and beyond glosses in learners unfamiliar with the target language, and that glosses are not always necessary for effective L2 word learning.

Keywords

L2 word learning Gesture Images Embodied cognition Dual coding 

Notes

Acknowledgements

Portions of this research were presented at the 22nd annual Second Language Research Forum (October 2013). I thank Brian MacWhinney for inspiring the idea for this project and the faculty of the Language and Reading Group at the Learning Research and Development Center at the University of Pittsburgh for providing the space and resources necessary to complete it.

References

  1. Allen, L. Q. (1995). The effects of emblematic gestures on the development and access of mental representations of French expressions. The Modern Language Journal, 79, 521–529.  https://doi.org/10.1111/j.1540-4781.1995.tb05454.x.CrossRefGoogle Scholar
  2. Altarriba, J., & Mathis, K. M. (1997). Conceptual and lexical development in second language acquisition. Journal of Memory and Language, 36, 550–568.  https://doi.org/10.1006/jmla.1997.2493.CrossRefGoogle Scholar
  3. Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68, 255–278.  https://doi.org/10.1016/j.jml.2012.11.001.CrossRefGoogle Scholar
  4. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577–660.  https://doi.org/10.1017/S0140525X99002149.CrossRefPubMedGoogle Scholar
  5. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.  https://doi.org/10.1146/annurev.psych.59.103006.093639.CrossRefPubMedGoogle Scholar
  6. Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1–48.  https://doi.org/10.18637/jss.v067.i01.CrossRefGoogle Scholar
  7. Bergmann, K., & Macedonia, M. (2013). A virtual agent as vocabulary trainer: Iconic gestures help to improve learners’ memory performance. In International Workshop on Intelligent Virtual Agents (Vol. 8108, pp. 139–148). Berlin: Springer.CrossRefGoogle Scholar
  8. Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 46, 904–911.  https://doi.org/10.3758/s13428-013-0403-5.CrossRefPubMedGoogle Scholar
  9. Carpenter, S. K., & Olson, K. M. (2011). Are pictures good for learning new vocabulary in a foreign language? Only if you think they are not. Journal of Experimental Psychology. Learning, Memory, and Cognition, 38, 92–101.  https://doi.org/10.1037/a0024828.CrossRefPubMedGoogle Scholar
  10. Chen, H.-C. (1990). Lexical processing in a non-native language: Effects of language proficiency and learning strategy. Memory & Cognition, 18, 279–288.  https://doi.org/10.3758/BF03213881.CrossRefGoogle Scholar
  11. Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary acquisition. Modern Language Journal, 80, 183–198.  https://doi.org/10.1111/j.1540-4781.1996.tb01159.x.CrossRefGoogle Scholar
  12. Finkbeiner, M., & Nicol, J. (2003). Semantic category effects in second language word learning. Applied Psycholinguistics, 24, 369–383.  https://doi.org/10.1017/S0142716403000195.CrossRefGoogle Scholar
  13. Gibbs, R. W. (2006). Embodiment and cognitive science. Cambridge: Cambridge University Press.Google Scholar
  14. Gogate, L. J., Bahrick, L. E., & Watson, J. D. (2000). A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures. Child Development, 71, 878–894.  https://doi.org/10.1111/1467-8624.00197.CrossRefPubMedGoogle Scholar
  15. Iverson, J. M., Capirci, O., Longobardi, E., & Caselli, M. C. (1999). Gesturing in mother-child interactions. Cognitive Development, 14, 57–75.  https://doi.org/10.1016/S0885-2014(99)80018-5.CrossRefGoogle Scholar
  16. Kelly, S. D., McDevitt, T., & Esch, M. (2009). Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processes, 24, 313–334.  https://doi.org/10.1080/01690960802365567.CrossRefGoogle Scholar
  17. Krönke, K.-M., Mueller, K., Friederici, A. D., & Obrig, H. (2013). Learning by doing? The effect of gestures on implicit retrieval of newly acquired words. Cortex, 49, 2553–2568.  https://doi.org/10.1016/j.cortex.2012.11.016.CrossRefPubMedGoogle Scholar
  18. Lotto, L., & De Groot, A. (1998). Effects of learning method and word type on acquiring vocabulary in an unfamiliar language. Language Learning, 48, 31–69.  https://doi.org/10.1111/1467-9922.00032.CrossRefGoogle Scholar
  19. Macedonia, M., & Knösche, T. R. (2011). Body in mind: How gestures empower foreign language learning. Mind, Brain, and Education, 5, 196–211.  https://doi.org/10.1111/j.1751-228X.2011.01129.x.CrossRefGoogle Scholar
  20. Macedonia, M., Müller, K., & Friederici, A. D. (2010). The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Mapping, 32, 982–998.  https://doi.org/10.1002/hbm.21084.CrossRefPubMedGoogle Scholar
  21. Mayer, K. M., Yildiz, I. B., Macedonia, M., & von Kriegstein, K. (2015). Visual and motor cortices differentially support the translation of foreign language words. Current Biology, 25, 530–535.  https://doi.org/10.1016/j.cub.2014.11.068.CrossRefPubMedGoogle Scholar
  22. Mayer, R. E. (2002). Multimedia learning. In B. H. Ross (Ed.), Psychology of learning and motivation (Vol. 41, pp. 85–139). New York: Academic Press.Google Scholar
  23. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43–52.  https://doi.org/10.1207/S15326985EP3801_6.CrossRefGoogle Scholar
  24. Morett, L. M. (2014). When hands speak louder than words: The role of gesture in the communication, encoding, and recall of words in a novel second language. The Modern Language Journal, 98, 834–853.  https://doi.org/10.1111/modl.12125.CrossRefGoogle Scholar
  25. Morett, L. M. (2018). In hand and in mind: Effects of gesture production and viewing on second language word learning. Applied Psycholinguistics, 39, 355–381.  https://doi.org/10.1017/S0142716417000388.CrossRefGoogle Scholar
  26. Paivio, A. (1990). Mental representations: A dual coding approach. New York: Oxford University Press.CrossRefGoogle Scholar
  27. Poarch, G. J., Van Hell, J. G., & Kroll, J. F. (2015). Accessing word meaning in beginning second language learners: Lexical or conceptual mediation? Bilingualism Language and Cognition, 18, 357–371.  https://doi.org/10.1017/S1366728914000558.CrossRefGoogle Scholar
  28. R Core Team. (2015). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved July 24, 2016 from http://www.R-project.org/.
  29. Rowe, M. L., Silverman, R. D., & Mullan, B. E. (2013). The role of pictures and gestures as nonverbal aids in preschoolers’ word learning in a novel language. Contemporary Educational Psychology, 38, 109–117.  https://doi.org/10.1016/j.cedpsych.2012.12.001.CrossRefGoogle Scholar
  30. Sagarra, N., & Alba, M. (2006). The key is in the keyword: L2 vocabulary learning methods with beginning learners of Spanish. The Modern Language Journal, 90, 228–243.  https://doi.org/10.1111/j.1540-4781.2006.00394.x.CrossRefGoogle Scholar
  31. Tellier, M. (2008). The effect of gestures on second language memorisation by young children. Gesture, 8, 219–235.  https://doi.org/10.1075/gest.8.2.06tel.CrossRefGoogle Scholar
  32. Van Hell, J. G., & Mahn, A. C. (1997). Keyword mnemonics versus rote rehearsal: Learning concrete and abstract foreign words by experienced and inexperienced learners. Language Learning, 47, 507–546.  https://doi.org/10.1111/0023-8333.00018.CrossRefGoogle Scholar
  33. Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9, 625–636.  https://doi.org/10.3758/BF03196322.CrossRefGoogle Scholar
  34. Yu, C., & Smith, L. B. (2012). Embodied attention and word learning by toddlers. Cognition, 125, 244–262.  https://doi.org/10.1016/j.cognition.2012.06.016.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Educational Studies in Psychology, Research Methodology, and CounselingUniversity of AlabamaTuscaloosaUSA

Personalised recommendations