Skip to main content

Communicating Dynamic Behaviors: Are Interactive Multimedia Presentations Better than Static Mixed-Mode Presentations?

  • Conference paper
  • First Online:
Theory and Application of Diagrams (Diagrams 2000)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1889))

Included in the following conference series:

Abstract

Static mixed-mode presentations consisting of verbal explanations illustrated with diagrams have long been used to communicate information. With the advent of multimedia, such presentations have become dynamic, by migrating from paper to the computer and by adding interactivity and animation. The conventional wisdom is that computer-based multimedia presentations are better than printed presentations. However, does the communicative power of mixed-mode representations stem from their careful design to match cognitive processes involved in comprehension or from their interactive and animated nature? This is an important issue that has never been investigated. This paper first presents a cognitive model of comprehension of mixed-mode representations. We describe how this model generates design guidelines for mixed-mode representations that present expository material in two domains - the concrete domain of mechanical systems and the abstract domain of computer algorithms. We then report on a series of studies that compared computer-based interactive multimedia presentations and their paper-based counterparts. Both were designed in accordance with the comprehension model and were compared against each other and against competing representational forms such as books, CD-ROMs, and animations. These studies indicate that the effectiveness of mixed-mode presentations has more to do with their match with comprehension processes than the medium of presentation. In other words, benefits of interactivity and animation are likely being overstated in the current milieu of fascination with multimedia.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baggett, W. B., Graesser, A.C: Question Answering in the Context of Illustrated Expository Text. In: Proc. 17th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1995) 334–339

    Google Scholar 

  2. Ferguson, E. L., Hegarty, M.: Learning with Real Machines or Diagrams: Application of Knowledge to Real-World Problems. Cognition and Instruction 13 (1995) 129–160

    Article  Google Scholar 

  3. Hansen, S. R., Narayanan, N. H., Schrimpsher, D., Hegarty, M.: Empirical Studies of Animation-Embedded Hypermedia Algorithm Visualizations. Tech. Rep. CSE98-06. Computer Science and Software Engineering Dept. Auburn University (1998)

    Google Scholar 

  4. Hegarty, M.: Mental Animation: Inferring Motion from Static Diagrams of Mechanical Systems. JEP: Learning, Memory and Cognition 18(5) (1992) 1084–1102

    Article  Google Scholar 

  5. Hegarty, M., Just, M.A.: Constructing Mental Models of Machines from Text and Diagrams. J. Memory and Language 32 (1993) 717–742

    Article  Google Scholar 

  6. Hegarty, M., Narayanan, N. H., Freitas, P: Understanding Machines from Multimedia and Hypermedia Presentations. In: Otero, J., Leon, J. A., Graesser, A. (eds.): The Psychology of Science Text Comprehension. Lawrence Erlbaum Associates, Hillsdale (to appear)

    Google Scholar 

  7. Hegarty, M., Quilici, J., Narayanan, N. H., Holmquist, S., Moreno, R:. Multimedia Instruction: Lessons from Evaluation of a Theory Based Design. J. Edu. Multimedia and Hypermedia 8(2) (1999) 119–150

    Google Scholar 

  8. Hegarty, M., Sims, V.K.: Individual Differences in Mental Animation During Mechanical Reasoning. Memory and Cognition 22 (1994) 411–430

    Google Scholar 

  9. Just, M. A., Carpenter, P.A.: Eye Fixations and Cognitive Processes. Cog. Psy. 8 (1976) 441–480

    Google Scholar 

  10. Lowe, R.K.: Selectivity in Diagrams: Reading Beyond the Lines. Edu. Psy. 14(4) (1994) 467–491

    MathSciNet  Google Scholar 

  11. Lowe, R.K.: Extracting Information from an Animation during Complex Visual Learning. European J. Psychology of Education 14(2) (1999) 225–244

    Article  Google Scholar 

  12. Macaulay, D.: The Way Things Work. Houghton Mifflin Company, Boston (1988)

    Google Scholar 

  13. Macaulay, D.: The New Way Things Work. CD-ROM. DK Interactive Learning, New York (1998)

    Google Scholar 

  14. Mayer, R. E., Anderson, R.B.: The Instructive Animation: Helping Students Build Connections between Words and Pictures in Multimedia Learning. J. Edu. Psy. 84(4) (1992) 444–452

    Article  Google Scholar 

  15. Mayer, R. E., Gallini, J.: When is an Illustration worth Ten Thousand Words? J. Edu. Psych. 83 (1990) 715–726

    Article  Google Scholar 

  16. Mayer, R. E., Sims, V.K.: For whom is a Picture worth a Thousand Words? Extensions of a Dual-Coding Theory of Multimedia Learning. J. Edu. Psy. 86(3) (1994) 389–401

    Google Scholar 

  17. Morrison, J. B., Tversky, B., Betrancourt, M.: Animation: Does It Facilitate Learning? In: Smart Graphics: Papers from the AAAI Spring Symposium. Technical Report SS-00-04. AAAI Press, Menlo Park CA (2000) 53–60

    Google Scholar 

  18. Narayanan, N.H., Chandrasekaran, B.: Reasoning Visually about Spatial Interactions. In: Proc. 12th Int. Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers, Menlo Park CA (1991) 360–365

    Google Scholar 

  19. Narayanan, N. H., Hegarty, M.: On Designing Comprehensible Interactive Hypermedia Manuals. Int. J. Human-Computer Studies 48 (1998) 267–301

    Article  Google Scholar 

  20. Narayanan, N. H., Suwa, M., Motoda, H.: A Study of Diagrammatic Reasoning from Verbal and Gestural Data. In: Proc. 16th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1994) 652–657

    Google Scholar 

  21. Narayanan, N. H., Suwa, M., Motoda, H.: Diagram-Based Problem Solving: The Case of an Impossible Problem. In: Proc. 17th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1995) 206–211

    Google Scholar 

  22. Palmiter, S., Elkerton, J.: Animated Demonstrations for Learning Procedural Computer-Based Tasks. Human-Computer Interaction 8 (1993) 193–216

    Article  Google Scholar 

  23. Pane, J. F., Corbett, A. T., John, B.E.: Assessing Dynamics in Computer-Based Instruction. In: Proc. ACM Human Factors in Computing Systems Conference. ACM Press, New York (1996) 797–804

    Google Scholar 

  24. Rieber, L.P.: Using Computer Animated Graphics in Science Instruction with Children. J. Edu. Psy. 82(1) (1990) 135–140

    Article  Google Scholar 

  25. Rieber, L. P., Boyce, M. J., Assad, C: The Effects of Computer Animation on Adult Learning and Retrieval Tasks. J. Computer-Based Instruction 17(2) (1990) 46–52

    Google Scholar 

  26. Scaife, M., Rogers, Y.: External Cognition: How Do Graphical Representations Work? Int. J. Human-Computer Studies 45 (1996) 185–213

    Article  Google Scholar 

  27. Schwartz, D. L., Black, J.B.: Analog Imagery in Mental Model Reasoning: Depictive Models. Cognitive Psychology 30 (1996) 154–219

    Article  Google Scholar 

  28. Schwartz, D. L., Hegarty, M.: Coordinating Multiple Representations for Reasoning about Mechanical Devices. In: Cognitive and Computational Models of Spatial Representation: AAAI Spring Symposium Papers. Tech. Rep. SS-96-03. AAAI Press, Menlo Park (1996)

    Google Scholar 

  29. Sims, V. K., Hegarty, M.: Mental Animation in the Visual-Spatial Sketchpad: Evidence from Dual-Task Studies. Memory and Cognition 25(3) (1997) 321–332

    Google Scholar 

  30. Stasko, J.: TANGO: A Framework and System for Algorithm Animation. IEEE Computer 23(9) (1990) 27–39

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Narayanan, N.H., Hegarty, M. (2000). Communicating Dynamic Behaviors: Are Interactive Multimedia Presentations Better than Static Mixed-Mode Presentations?. In: Anderson, M., Cheng, P., Haarslev, V. (eds) Theory and Application of Diagrams. Diagrams 2000. Lecture Notes in Computer Science(), vol 1889. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44590-0_18

Download citation

  • DOI: https://doi.org/10.1007/3-540-44590-0_18

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-67915-8

  • Online ISBN: 978-3-540-44590-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics