Audio Cues: Can Sound Be Worth a Hundred Words?

  • Jatin BajajEmail author
  • Akash HarlalkaEmail author
  • Ankit Kumar
  • Ravi Mokashi Punekar
  • Keyur Sorathia
  • Om Deshmukh
  • Kuldeep Yadav
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9192)


Multimedia content is increasingly being used in the context of e-learning. In the absence of classroom-like active interventions by instructors, multimedia-based learning leads to disengagement and shorter attention spans. In this paper, we present a framework for using audio cues interspersed with the content to improve student engagement and learning outcomes. The proposed framework is based on insights from cognitive theory of multimedia learning, modeling of working memory and successful use of audio in the film industry. On a set of 20 freshmen engineering students, we demonstrate that the systematic use of audio cues led to 37.6 % relative improvement in learning outcome and 44 % relative improvement in long-term retention. Post-study interviews establish that the associated students improved recall and engagement to the presence of audio cues.


Cognitive theory of multimedia learning Working memory Audio cues E-learning performance Student retention 



We gratefully acknowledge Safinah A. Ali for all her help and assistance in building our audio cue framework.


  1. 1.
    Tucker, B.: The flipped classroom. Educ. Next 12(1), 82–83 (2012)Google Scholar
  2. 2.
    Horn, M.B., Staker, H.: The rise of K-12 blended learning. Innosight Institute (2011)Google Scholar
  3. 3.
    Zhao, X., Okamoto, T.: Adaptive multimedia content delivery for context-aware u-learning. Int. J. Mob. Learn. Organ. 5(1), 46–63 (2011)CrossRefGoogle Scholar
  4. 4.
    Bishop, M.J., Sonnenschein, D.: Designing with sound to enhance learning: four recommendations from the film industry. J. Appl. Instr. Des. 2(1), 5–15 (2012)Google Scholar
  5. 5.
    Mayer, R.E., Moreno, R.: Aids to computer-based multimedia learning. Learn. Instr. 12(1), 107–119 (2002)CrossRefGoogle Scholar
  6. 6.
    Mann, B.L.: The evolution of multimedia sound. Comput. Educ. 50(4), 1157–1173 (2008)CrossRefGoogle Scholar
  7. 7.
    Baddeley, A.: Working memory. Science 255(5044), 556–559 (1992)CrossRefGoogle Scholar
  8. 8.
    Mayer, R.E.: Cognitive theory of multimedia learning. In: The Cambridge Handbook of Multimedia Learning, pp. 31–48 (2005)Google Scholar
  9. 9.
    Clark, R.C., Mayer, R.E.: E-learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. Wiley, San Francisco (2011)CrossRefGoogle Scholar
  10. 10.
    Bishop, M.J., Amankwatia, T.B., Cates, W.M.: Sound’s use in instructional software to enhance learning: a theory-to-practice content analysis. Educ. Tech. Res. Dev. 56(4), 467–486 (2008)CrossRefGoogle Scholar
  11. 11.
    Guo, P.J., Kim, J., Rubin, R.: How video production affects student engagement: an empirical study of mooc videos. In: Proceedings of the First ACM Conference on Learning@ scale Conference, pp. 41–50. ACM (2014)Google Scholar
  12. 12.
  13. 13.
    Sebe, N., et al.: Emotion recognition based on joint visual and audio cues. In: 18th International Conference on Pattern Recognition, ICPR 2006, Vol. 1. IEEE (2006)Google Scholar
  14. 14.
    Bergstrom, T., Karahalios, K.: Seeing more: visualizing audio cues. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4663, pp. 29–42. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  15. 15.
    Velasco-Álvarez, F., Ron-Angevin, R., da Silva-Sauer, L., Sancha-Ros, S., Blanca-Mena, M.J.: Audio-cued SMR brain-computer interface to drive a virtual wheelchair. In: Cabestany, J., Rojas, I., Joya, G. (eds.) IWANN 2011, Part I. LNCS, vol. 6691, pp. 337–344. Springer, Heidelberg (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Jatin Bajaj
    • 1
    Email author
  • Akash Harlalka
    • 1
    Email author
  • Ankit Kumar
    • 1
  • Ravi Mokashi Punekar
    • 1
  • Keyur Sorathia
    • 1
  • Om Deshmukh
    • 2
  • Kuldeep Yadav
    • 2
  1. 1.Indian Institute of Technology GuwahatiGuwahatiIndia
  2. 2.Xerox Research Center IndiaBengaluruIndia

Personalised recommendations