The Promise of Multimedia Enhancement in Children’s Digital Storybooks
Apart from being vibrant, many children’s digital books offer a rich source for learning as is confirmed by meta-analytic findings. The present chapter pinpoints ways in which children’s books have been affected by digitization and which multimedia enhancements explain the boost these books provide particularly in groups of easily distractible children. There is increasing evidence for a positive impact of multimedia enhancements in digital books on children’s story comprehension, especially of building in camera movements and motion into static pictures to guide children’s visual attention. In contrast, common playful, interactive features reveal negative results although they might enhance children’s engagement. This article discusses new ways in which designers can use interactive features in a meaningful manner.
KeywordsDigital storybooks Multimedia enhancement Camera movements Interactivity Story comprehension Adult-child interaction
- Anderson, S., Henke, J., McLaughlin, M., Ripp, M., & Tuffs, P. (2000). Using background music to enhance memory and improve learning. Google Scholar
- Apple. (2017). App Store review guidelines. https://developer.apple.com/app-store/review/guidelines/#minimum-functionality Google Scholar
- Ben-Shabat, A. (2017). Background music and content expansion support story comprehension in e-book reading of preschoolers. Unpublished dissertation, Bar-Ilan University, Israel.Google Scholar
- Kahneman, D. (1973). Attention and effort. Englewood Cliffs: Prentice-Hall.Google Scholar
- Paivio, A. (1986). Mental representations: A dual coding approach. Oxford: Oxford University Press.Google Scholar
- Plak, R. D., Merkelbach, I., Kegel, C. A. T., Van IJzendoorn, M. H., & Bus, A. G. (2016). Brief computer interventions enhance emergent academic skills in susceptible children: A gene-by-environment experiment. Learning and Instruction, 45, 1–8. https://doi.org/10.1016/j.learninstruc.2016.06.002.CrossRefGoogle Scholar
- Revelle, G. L., Strouse, G. A., Troseth, G. L., Rvachew, S., & Thompson Forrester, D. (this volume). Technology support for adults and children reading together. In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
- Sarı, B., Asûde Başal, H., Takacs, Z. K., & Bus, A. G. (2019). A randomized controlled trial to test efficacy of digital enhancements of storybooks in support of narrative comprehension and word learning. Journal of Experimental Child Psychology, 179, 212–226. https://doi.org/10.1016/j.jecp.2018.11.006.CrossRefGoogle Scholar
- Takacs, Z. K., & Bus, A. G. (2016). Benefits of motion in animated storybooks for children’s visual attention and story comprehension. An eye-tracking study. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.01591.
- Tanenhaus, M. K. (2007). Eye movements and spoken language processing. In R. P. G. Gompel (Ed.), Eye movements: A window on mind and brain. Amsterdam: Elsevier.Google Scholar
- Tønnessen, E. S., & Hoel, T. (this volume). Designing dialogs around picture book-apps. In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
- Van Daal, V. H. P., Sandvik, J. M., & Adèr, H. J. (this volume). A meta-analysis of multimedia applications: How effective are interventions with e-books, computer-assisted instruction and TV/video on literacy learning? In J. Kim & B. Hassinger-Das (Eds.), Reading in the digital age: Young children’s experiences with e-books. Cham: Springer.Google Scholar
- Van Kol, N. (1903). Iets over illustraties in kinderboeken [Something about illustrations in children’s books]. Het Kind, 4, 4–7.Google Scholar
Digital Books Mentioned in This Chapter
- Callaway Digital Arts. (2010). The monster at the end of this book (Version 3.3) [Mobile application software]. Retrieved from http://itunes.apple.com.
- Coenraads, C., & de Wijs, L. (2017). Bliksem [Lightning]. Het Woeste Woud.Google Scholar
- Janosch. (1998a). Groot feest voor Tijger [Big party for tiger] [CD CDROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
- Janosch. (1998b). Ik maak je weer beter, zei Beer [I’ll make you well again, said the Bear] [CD-ROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
- Janosch. (1999). Tijger en Beer in het verkeer [Tiger and bear in traffic] [CD-ROM]. Baarn, The Netherlands: Het Spectrum Electronic Publishing.Google Scholar
- Thomas, V., & Gorky, P. (1996). Heksenspul met Hennie de Heks en de Kat Helmer [Winnie Witch] [CD-ROM]. Nieuwegein, The Netherlands: Bombilla.Google Scholar