Advertisement

The Promise of Multimedia Enhancement in Children’s Digital Storybooks

  • Adriana G. Bus
  • Burcu Sarı
  • Zsofia K. Takacs
Chapter
Part of the Literacy Studies book series (LITS, volume 18)

Abstract

Apart from being vibrant, many children’s digital books offer a rich source for learning as is confirmed by meta-analytic findings. The present chapter pinpoints ways in which children’s books have been affected by digitization and which multimedia enhancements explain the boost these books provide particularly in groups of easily distractible children. There is increasing evidence for a positive impact of multimedia enhancements in digital books on children’s story comprehension, especially of building in camera movements and motion into static pictures to guide children’s visual attention. In contrast, common playful, interactive features reveal negative results although they might enhance children’s engagement. This article discusses new ways in which designers can use interactive features in a meaningful manner.

Keywords

Digital storybooks Multimedia enhancement Camera movements Interactivity Story comprehension Adult-child interaction 

References

  1. Anderson, S., Henke, J., McLaughlin, M., Ripp, M., & Tuffs, P. (2000). Using background music to enhance memory and improve learning. Google Scholar
  2. Barr, R., Shuck, L., Salerno, K., Atkinson, E., & Linebarger, D. L. (2010). Music interferes with learning from television during infancy. Infant and Child Development, 19, 313–331.  https://doi.org/10.1002/icd.666.CrossRefGoogle Scholar
  3. Ben-Shabat, A. (2017). Background music and content expansion support story comprehension in e-book reading of preschoolers. Unpublished dissertation, Bar-Ilan University, Israel.Google Scholar
  4. Bus, A. G., Takacs, Z. K., & Kegel, C. A. T. (2015). Affordances and limitations of electronic storybooks for young children’s emergent literacy. Developmental Review, 35, 79–97.  https://doi.org/10.1016/j.dr.2014.12.004.CrossRefGoogle Scholar
  5. de Jong, M. T., & Bus, A. G. (2004). The efficacy of electronic books in fostering kindergarten children’s emergent story understanding. Reading Research Quarterly, 39, 378–393.  https://doi.org/10.1598/RRQ.39.4.2.CrossRefGoogle Scholar
  6. Evans, M. A., & Saint-Aubin, J. (2005). What children are looking at during shared storybook reading. Psychological Science, 16, 913–920.CrossRefGoogle Scholar
  7. Evans, M. A., Reynolds, K., Shaw, D., & Pursoo, T. (2011). Parental explanations of vocabulary during shared book reading: A missed opportunity. First Language, 31, 195–213.CrossRefGoogle Scholar
  8. Kahneman, D. (1973). Attention and effort. Englewood Cliffs: Prentice-Hall.Google Scholar
  9. Kim, J. E., & Anderson, J. (2008). Mother–child shared reading with print and digital texts. Journal of Early Childhood Literacy, 8, 213–245.CrossRefGoogle Scholar
  10. Korat, O., & Shamir, A. (2004). Do Hebrew electronic books differ from Dutch electronic books? A replication of a Dutch content analysis. Journal of Computer Assisted Learning, 20, 257–268.  https://doi.org/10.1111/j.1365-2729.2004.00078.x.CrossRefGoogle Scholar
  11. Martinez, M., & Harmon, J. M. (2012). Picure/text relationships: An investigation of literary elements in picturebooks. Literacy Research Instruction, 51, 323–343.  https://doi.org/10.1080/19388071.2012.695856.CrossRefGoogle Scholar
  12. Mayer, R. E. (2001). Multimedia learning. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  13. Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.CrossRefGoogle Scholar
  14. Paivio, A. (1986). Mental representations: A dual coding approach. Oxford: Oxford University Press.Google Scholar
  15. Parish-Morris, J. N., Mahajan, K., Hirsh-Pasek, R., Golinkoff, M., & Collins, M. F. (2013). Once upon a time: Parent-child dialogue and storybook reading in the electronic era. Mind, Brain, and Education, 7, 200–211.CrossRefGoogle Scholar
  16. Plak, R. D., Kegel, C., & Bus, A. (2015). Genetic differential susceptibility in literacy-delayed children: A randomized controlled trial on emergent literacy in kindergarten. Development and Psychopathology, 27, 69–79.  https://doi.org/10.1017/S0954579414001308.CrossRefGoogle Scholar
  17. Plak, R. D., Merkelbach, I., Kegel, C. A. T., Van IJzendoorn, M. H., & Bus, A. G. (2016). Brief computer interventions enhance emergent academic skills in susceptible children: A gene-by-environment experiment. Learning and Instruction, 45, 1–8.  https://doi.org/10.1016/j.learninstruc.2016.06.002.CrossRefGoogle Scholar
  18. Revelle, G. L., Strouse, G. A., Troseth, G. L., Rvachew, S., & Thompson Forrester, D. (this volume). Technology support for adults and children reading together. In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
  19. Ricci, C. M., & Beal, C. R. (2002). The effect of interactive media on children’s story memory. Journal of Educational Psychology, 94, 138–144.  https://doi.org/10.1037//0022-0663.94.1.138.CrossRefGoogle Scholar
  20. Richter, A., & Courage, M. L. (2017). Comparing electronic and paper storybooks for preschoolers: Attention, engagement, and recall. Journal of Applied Developmental Psychology, 48, 92–102.CrossRefGoogle Scholar
  21. Sargeant, B. (2015). What is an ebook? What is a book app? And why should we care? An analysis of contemporary digital picture books. Children’s Literature in Education, 46, 454–466.CrossRefGoogle Scholar
  22. Sarı, B., Asûde Başal, H., Takacs, Z. K., & Bus, A. G. (2019). A randomized controlled trial to test efficacy of digital enhancements of storybooks in support of narrative comprehension and word learning. Journal of Experimental Child Psychology, 179, 212–226.  https://doi.org/10.1016/j.jecp.2018.11.006.CrossRefGoogle Scholar
  23. Smeets, D. J. H., Van Dijken, M. J., & Bus, A. G. (2014). Using electronic storybooks to support word learning in children with severe language impairments. Journal of Learning Disabilities, 47, 435–449.  https://doi.org/10.1177/00222.CrossRefGoogle Scholar
  24. Sorsby, A. J., & Martlew, M. (1991). Representational demands in mothers’ talk to preschool children in two contexts: Picture book reading and a modelling task. Journal of Child Language, 18, 373–395.CrossRefGoogle Scholar
  25. Takacs, Z. K., & Bus, A. G. (2016). Benefits of motion in animated storybooks for children’s visual attention and story comprehension. An eye-tracking study. Frontiers in Psychology, 7.  https://doi.org/10.3389/fpsyg.2016.01591.
  26. Takacs, Z. K., & Bus, A. G. (2018). How pictures in picture storybooks support young children’s story comprehension and retention: An eye-tracking experiment. Journal of Experimental Child Psychology, 174, 1–12.  https://doi.org/10.1016/j.jecp.2018.04.013.CrossRefGoogle Scholar
  27. Tanenhaus, M. K. (2007). Eye movements and spoken language processing. In R. P. G. Gompel (Ed.), Eye movements: A window on mind and brain. Amsterdam: Elsevier.Google Scholar
  28. Tønnessen, E. S., & Hoel, T. (this volume). Designing dialogs around picture book-apps. In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
  29. Van Daal, V. H. P., Sandvik, J. M., & Adèr, H. J. (this volume). A meta-analysis of multimedia applications: How effective are interventions with e-books, computer-assisted instruction and TV/video on literacy learning? In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
  30. Van Kol, N. (1903). Iets over illustraties in kinderboeken [Something about illustrations in children’s books]. Het Kind, 4, 4–7.Google Scholar
  31. Verhallen, M. J. A. J., & Bus, A. G. (2011). Young second language learners’ visual attention to illustrations in storybooks. Journal of Early Childhood Literacy, 11, 480–500.  https://doi.org/10.1177/1468798411416785.CrossRefGoogle Scholar
  32. Verhallen, M. J. A. J., Bus, A. G., & de Jong, M. T. (2006). The promise of multimedia stories for kindergarten children at risk. Journal of Educational Psychology, 98, 410–419.  https://doi.org/10.1037/0022-0663.98.2.410.CrossRefGoogle Scholar
  33. Yokota, J., & Teale, W. H. (2014). Picture books and the digital world. Educators make choices. The Reading Teacher, 67, 577–585.CrossRefGoogle Scholar

Digital Books Mentioned in This Chapter

  1. Callaway Digital Arts. (2010). The monster at the end of this book (Version 3.3) [Mobile application software]. Retrieved from http://itunes.apple.com.
  2. Coenraads, C., & de Wijs, L. (2017). Bliksem [Lightning]. Het Woeste Woud.Google Scholar
  3. Janosch. (1998a). Groot feest voor Tijger [Big party for tiger] [CD CDROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
  4. Janosch. (1998b). Ik maak je weer beter, zei Beer [I’ll make you well again, said the Bear] [CD-ROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
  5. Janosch. (1999). Tijger en Beer in het verkeer [Tiger and bear in traffic] [CD-ROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
  6. Thomas, V., & Gorky, P. (1996). Heksenspul met Hennie de Heks en de Kat Helmer [Winnie Witch] [CD-ROM]. Nieuwegein, The Netherlands: Bombilla.Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Adriana G. Bus
    • 1
    • 2
    • 3
  • Burcu Sarı
    • 4
  • Zsofia K. Takacs
    • 2
  1. 1.Language Literacy CommunicationVrije UniversiteitAmsterdamThe Netherlands
  2. 2.ELTE Eötvös Loránd UniversityBudapestHungary
  3. 3.University of StavangerStavangerNorway
  4. 4.Çanakkale Onsekiz Mart UniversityÇanakkaleTurkey

Personalised recommendations