Abstract
Static mixed-mode presentations consisting of verbal explanations illustrated with diagrams have long been used to communicate information. With the advent of multimedia, such presentations have become dynamic, by migrating from paper to the computer and by adding interactivity and animation. The conventional wisdom is that computer-based multimedia presentations are better than printed presentations. However, does the communicative power of mixed-mode representations stem from their careful design to match cognitive processes involved in comprehension or from their interactive and animated nature? This is an important issue that has never been investigated. This paper first presents a cognitive model of comprehension of mixed-mode representations. We describe how this model generates design guidelines for mixed-mode representations that present expository material in two domains - the concrete domain of mechanical systems and the abstract domain of computer algorithms. We then report on a series of studies that compared computer-based interactive multimedia presentations and their paper-based counterparts. Both were designed in accordance with the comprehension model and were compared against each other and against competing representational forms such as books, CD-ROMs, and animations. These studies indicate that the effectiveness of mixed-mode presentations has more to do with their match with comprehension processes than the medium of presentation. In other words, benefits of interactivity and animation are likely being overstated in the current milieu of fascination with multimedia.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baggett, W. B., Graesser, A.C: Question Answering in the Context of Illustrated Expository Text. In: Proc. 17th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1995) 334–339
Ferguson, E. L., Hegarty, M.: Learning with Real Machines or Diagrams: Application of Knowledge to Real-World Problems. Cognition and Instruction 13 (1995) 129–160
Hansen, S. R., Narayanan, N. H., Schrimpsher, D., Hegarty, M.: Empirical Studies of Animation-Embedded Hypermedia Algorithm Visualizations. Tech. Rep. CSE98-06. Computer Science and Software Engineering Dept. Auburn University (1998)
Hegarty, M.: Mental Animation: Inferring Motion from Static Diagrams of Mechanical Systems. JEP: Learning, Memory and Cognition 18(5) (1992) 1084–1102
Hegarty, M., Just, M.A.: Constructing Mental Models of Machines from Text and Diagrams. J. Memory and Language 32 (1993) 717–742
Hegarty, M., Narayanan, N. H., Freitas, P: Understanding Machines from Multimedia and Hypermedia Presentations. In: Otero, J., Leon, J. A., Graesser, A. (eds.): The Psychology of Science Text Comprehension. Lawrence Erlbaum Associates, Hillsdale (to appear)
Hegarty, M., Quilici, J., Narayanan, N. H., Holmquist, S., Moreno, R:. Multimedia Instruction: Lessons from Evaluation of a Theory Based Design. J. Edu. Multimedia and Hypermedia 8(2) (1999) 119–150
Hegarty, M., Sims, V.K.: Individual Differences in Mental Animation During Mechanical Reasoning. Memory and Cognition 22 (1994) 411–430
Just, M. A., Carpenter, P.A.: Eye Fixations and Cognitive Processes. Cog. Psy. 8 (1976) 441–480
Lowe, R.K.: Selectivity in Diagrams: Reading Beyond the Lines. Edu. Psy. 14(4) (1994) 467–491
Lowe, R.K.: Extracting Information from an Animation during Complex Visual Learning. European J. Psychology of Education 14(2) (1999) 225–244
Macaulay, D.: The Way Things Work. Houghton Mifflin Company, Boston (1988)
Macaulay, D.: The New Way Things Work. CD-ROM. DK Interactive Learning, New York (1998)
Mayer, R. E., Anderson, R.B.: The Instructive Animation: Helping Students Build Connections between Words and Pictures in Multimedia Learning. J. Edu. Psy. 84(4) (1992) 444–452
Mayer, R. E., Gallini, J.: When is an Illustration worth Ten Thousand Words? J. Edu. Psych. 83 (1990) 715–726
Mayer, R. E., Sims, V.K.: For whom is a Picture worth a Thousand Words? Extensions of a Dual-Coding Theory of Multimedia Learning. J. Edu. Psy. 86(3) (1994) 389–401
Morrison, J. B., Tversky, B., Betrancourt, M.: Animation: Does It Facilitate Learning? In: Smart Graphics: Papers from the AAAI Spring Symposium. Technical Report SS-00-04. AAAI Press, Menlo Park CA (2000) 53–60
Narayanan, N.H., Chandrasekaran, B.: Reasoning Visually about Spatial Interactions. In: Proc. 12th Int. Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers, Menlo Park CA (1991) 360–365
Narayanan, N. H., Hegarty, M.: On Designing Comprehensible Interactive Hypermedia Manuals. Int. J. Human-Computer Studies 48 (1998) 267–301
Narayanan, N. H., Suwa, M., Motoda, H.: A Study of Diagrammatic Reasoning from Verbal and Gestural Data. In: Proc. 16th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1994) 652–657
Narayanan, N. H., Suwa, M., Motoda, H.: Diagram-Based Problem Solving: The Case of an Impossible Problem. In: Proc. 17th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Hillsdale NJ (1995) 206–211
Palmiter, S., Elkerton, J.: Animated Demonstrations for Learning Procedural Computer-Based Tasks. Human-Computer Interaction 8 (1993) 193–216
Pane, J. F., Corbett, A. T., John, B.E.: Assessing Dynamics in Computer-Based Instruction. In: Proc. ACM Human Factors in Computing Systems Conference. ACM Press, New York (1996) 797–804
Rieber, L.P.: Using Computer Animated Graphics in Science Instruction with Children. J. Edu. Psy. 82(1) (1990) 135–140
Rieber, L. P., Boyce, M. J., Assad, C: The Effects of Computer Animation on Adult Learning and Retrieval Tasks. J. Computer-Based Instruction 17(2) (1990) 46–52
Scaife, M., Rogers, Y.: External Cognition: How Do Graphical Representations Work? Int. J. Human-Computer Studies 45 (1996) 185–213
Schwartz, D. L., Black, J.B.: Analog Imagery in Mental Model Reasoning: Depictive Models. Cognitive Psychology 30 (1996) 154–219
Schwartz, D. L., Hegarty, M.: Coordinating Multiple Representations for Reasoning about Mechanical Devices. In: Cognitive and Computational Models of Spatial Representation: AAAI Spring Symposium Papers. Tech. Rep. SS-96-03. AAAI Press, Menlo Park (1996)
Sims, V. K., Hegarty, M.: Mental Animation in the Visual-Spatial Sketchpad: Evidence from Dual-Task Studies. Memory and Cognition 25(3) (1997) 321–332
Stasko, J.: TANGO: A Framework and System for Algorithm Animation. IEEE Computer 23(9) (1990) 27–39
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Narayanan, N.H., Hegarty, M. (2000). Communicating Dynamic Behaviors: Are Interactive Multimedia Presentations Better than Static Mixed-Mode Presentations?. In: Anderson, M., Cheng, P., Haarslev, V. (eds) Theory and Application of Diagrams. Diagrams 2000. Lecture Notes in Computer Science(), vol 1889. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44590-0_18
Download citation
DOI: https://doi.org/10.1007/3-540-44590-0_18
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67915-8
Online ISBN: 978-3-540-44590-6
eBook Packages: Springer Book Archive