Skip to main content

The Influence of Spatial Text Information on the Multimedia Effect

  • Conference paper
Beyond Knowledge: The Legacy of Competence

Abstract

Two experiments explored how spatial information within expository text influences the mental integration of verbal and visual information. Experiment 1 varied the degree of verbally represented spatial information and the presence or absence of an animation in an explanation of the formation of lightning. The learning outcomes assessed were retention, transfer, and the visual mental model. In Experiment 2, eye movements and learning outcomes in the multimedia conditions were recorded. Low spatial text information increased the value of animations and therefore led to a stronger multimedia effect, whereas high spatial text tended to interfere with the processing of the animation. Furthermore, as revealed by the eyetracking data, longer reading times were associated with better learning outcomes for low spatial text, whereas the reverse was true for high spatial text. The findings suggest that the processing of verbally presented spatial information and of animations compete for the same cognitive resources in visuo-spatial working memory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Ainsworth, S. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16, 183-198.

    Article  Google Scholar 

  • Goldstone, R. L., & Son, J. Y. (2005). The transfer of scientific principles using concrete and idealized simulations. The Journal of the Learning Sciences, 14, 69-110.

    Article  Google Scholar 

  • Hegarty, M. (1992). The mechanics of comprehension and comprehension of mechanics. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading. (pp. 428-443). New York, NY: Springer.

    Google Scholar 

  • Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65-99.

    Article  Google Scholar 

  • Logie, R. H. (1995). Visuo-spatial working memory. Hove, UK: Erlbaum.

    Google Scholar 

  • Mayer, R. E. (2001). Multimedia learning. Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Mayer, R. E., & Moreno, R. (1998). A Split-Attention Effect in Multimedia Learning: Evidence for Dual Processing Systems in Working Memory. Journal of Educational Psychology, 90 312-320.

    Article  Google Scholar 

  • Quinn, J. G., & McConnell, J. (1996). Irrelevant pictures in visual working memory. Quarterly Journal of Experimental Psychology, 49A, 200–215.

    Google Scholar 

  • Rummer, R., Schweppe, J., Scheiter, K., & Gerjets, P. (2008). Lernen mit Multimedia: Die kognitiven Grundlagen des Modalitätseffekts. Psychologische Rundschau, 59, 98-107.

    Google Scholar 

  • Scaife, M., & Rogers, Y. (1996). External cognition: How do graphical representations work? International Journal of Human-Computer Studies, 45, 185-213.

    Article  Google Scholar 

  • Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2007). Integrating Different Sources of Information in multimedia learning: an eye tracking study on split attention. (Manuscript submitted for publication).

    Google Scholar 

  • Schwartz, D. L. (1995). Reasoning about the referent of a picture versus reasoning about the picture as a referent: An effect of visual realism. Memory & Cognition, 23, 709-722.

    Google Scholar 

  • Tversky, B., Morrison, J. B., & Betrancourt, M. (2002). Animation: Does it facilitate? International Journal of Human-Computer Studies, 57, 247-262.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media B.V.

About this paper

Cite this paper

Schmidt-Weigand, F., Scheiter, K. (2008). The Influence of Spatial Text Information on the Multimedia Effect. In: Zumbach, J., Schwartz, N., Seufert, T., Kester, L. (eds) Beyond Knowledge: The Legacy of Competence. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-8827-8_30

Download citation

Publish with us

Policies and ethics