Abstract
An important and often laborious task in foreign language acquisition is vocabulary learning. Research has repeatedly demonstrated that performing iconic gestures together with novel words has a beneficial effect on learning performance. Can these findings be transferred onto virtual agents applied in gesture-supported vocabulary training? We present a study investigating whether iconic gestures performed by a virtual agent and imitated by learners have an impact on verbal memory for words in a foreign language. In a within-subject design we compared participants’ memory performance achieved with the help of a virtual agent and those achieved with the help of a human trainer regarding both short-term learning effects and long-term decay effects. The overall results demonstrate improved memory scores when participants learned with a virtual agent. Especially high performers could profit from gesture-supported training with a virtual agent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baylor, A.L., Kim, S.: Designing nonverbal communication for pedagogical agents: When less is more. Computers in Human Behavior 25, 450–457 (2009)
Beun, R.-J., de Vos, E., Witteman, C.L.M.: Embodied conversational agents: Effects on memory performance and anthropomorphisation. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 315–319. Springer, Heidelberg (2003)
Engelkamp, J., Krumnacker, H.: Imaginale und motorische Prozesse beim Behalten verbalen Materials. Zeitschrift für experimentelle und angewandte Psychologie pp. 511–533 (1980)
Kelly, S.D., McDevitt, T., Esch, M.: Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processes 24, 313–334 (2009)
Kopp, S., Wachsmuth, I.: Synthesizing multimodal utterances for conversational agents. Computer Animation and Virtual Worlds 15, 39–52 (2004)
Krämer, N., Bente, G.: Personalizing e-learning. The social effects of pedagogical agents. Educational Psycholoy Review 22, 71–87 (2010)
Kranstedt, A., Kopp, S., Wachsmuth, I.: MURML: A multimodal utterance representation markup language for conversational agents. In: AAMAS 2002 Workshop Embodied Conversational Agents-Let’s Specify and Evaluate Them! (2002)
Leutner, D., Wirth, J.: Commentary on: Personalizing e-learning. The Social Effects of Pedagogical Agents. Educational Psycholoy Review 22, 71–87 (2010)
Macedonia, M., Müller, K., Friederici, A.: Neural correlates of high performance in foreign language vocabulary learning. Mind, Brain and Education 4(3), 125–134 (2010)
Macedonia, M., von Kriegstein, K.: Gestures enhance foreign language learning. Biolinguistics 6(3-4), 393–416 (2012)
Macedonia, M.: Voice Movement Icons’ during encoding of foreign language. Ph.D. thesis, Salzburg University (2003)
Macedonia, M., Knösche, T.R.: Body in mind: How gestures empower foreign language learning. Mind, Brain, and Education 5, 196–211 (2011)
McNeill, D.: Hand and Mind—What Gestures Reveal about Thought. University of Chicago Press, Chicago (1992)
Miksatko, J., Kipp, K.H., Kipp, M.: The persona zero-effect: Evaluating virtual character benefits on a learning task with repeated interactions. In: Allbeck, J., Badler, N., Bickmore, T., Pelachaud, C., Safonova, A. (eds.) IVA 2010. LNCS, vol. 6356, pp. 475–481. Springer, Heidelberg (2010)
Moundridou, M., Virvou, M.: Evaluating the persona effect of an interface agent in a tutoring system. Journal of Computer Assisted Learning 18, 253–261 (2002)
Mulken, S., André, E., Müller, J.: The persona effect: How substantial is it? People and Computers pp. 53—66 (1998)
Quinn-Allen, L.: The effects of emblematic gestures on the development and access of mental representations of french expressions. The Modern Language Journal 79, 521–529 (1995)
Tellier, M.: The effect of gestures on second language memorisation by young children. Gesture 8, 219–235 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bergmann, K., Macedonia, M. (2013). A Virtual Agent as Vocabulary Trainer: Iconic Gestures Help to Improve Learners’ Memory Performance. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds) Intelligent Virtual Agents. IVA 2013. Lecture Notes in Computer Science(), vol 8108. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40415-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-40415-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40414-6
Online ISBN: 978-3-642-40415-3
eBook Packages: Computer ScienceComputer Science (R0)