Skip to main content

Turning High-Schools into Laboratories? Lessons Learnt from Studies of Instructional Effectiveness of Digital Games in the Curricular Schooling System

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7516))

Abstract

Digital games are believed by many to be instructionally effective in the context of the formal schooling system; however, studies investigating this idea empirically are limited and their outcomes are often inconclusive and/or difficult to interpret. Part of the problem is caused by the fact that when conducting a study in an authentic environment, i.e., in a school, as opposed to a laboratory, researchers encounter many common, yet unspoken, technical pitfalls. This paper verbalizes some of these pitfalls and organizes them into 6 Recommendations for “best practice” in field studies on the instructional effectiveness of digital game-based learning (DGBL). These recommendations are based on experience gained during five DGBL studies on more than 700 subjects in the context of secondary education and can be useful to other researchers willing to run similar studies.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   49.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Annetta, L.A., Minogue, J., Holmes, S.Y., Cheng, M.: Investigating the Impact of Video Games on High School Students’ Engagement and Learning about Genetics. Computers & Education 53(1), 74–85 (2009)

    Article  Google Scholar 

  2. Barab, S., Thomas, M., Dodge, T., Carteaux, R., Tuzun, H.: Making Learning Fun: Quest Atlantis, A Game Without Guns. Educational Technology Research & Development 53(1), 86–107 (2005)

    Article  Google Scholar 

  3. Babbie, E.R.: The Practice of Social Research, 13th edn. Wadsworth Publishing (2012)

    Google Scholar 

  4. Bída, M., Brom, C., Popelová, M., Kadlec, R.: StoryFactory – A Tool for Scripting Machinimas in Unreal Engine 2 and UDK. In: Si, M., Thue, D., André, E., Lester, J.C., Tanenbaum, J., Zammitto, V. (eds.) ICIDS 2011. LNCS, vol. 7069, pp. 334–337. Springer, Heidelberg (2011)

    Google Scholar 

  5. Brom, C., Preuss, M., Klement, D.: Are Educational Computer Micro-Games Engaging and Effective for Knowledge Acquisition at High-Schools? A Quasi-Experimental Study. Computers & Education 57, 1971–1988 (2011)

    Article  Google Scholar 

  6. Brom, C., Šisler, V., Slavík, R.: Implementing Digital Game-Based Learning in Schools: the Augmented Learning Environment of Europe 2045. Multimedia Systems 16(1), 23–41 (2010)

    Article  Google Scholar 

  7. Cuban, L.: Teachers and Machines: The Classroom Use of Technology Since 1920. Teachers College Press, New York (1986)

    Google Scholar 

  8. Egenfeldt-Nielsen, S.: Beyond Edutainment: Exploring the Educational Potential of Computer Games. PhD thesis. University of Copenhagen (2005)

    Google Scholar 

  9. Feinstein, A.H., Cannon, H.M.: Construct of Simulation Evaluation. Simulation & Gaming 33(4), 425–440 (2002)

    Article  Google Scholar 

  10. de Freitas, S.: Learning in Immersive Worlds. Joint Information Systems Committee (2006), http://www.jisc.ac.uk/eli_outcomes.html (accessed March 16, 2012)

  11. Gee, J.P.: What Video Games Have to Teach Us About Learning and Literacy. Palgrave/St. Martin’s, New York (2003)

    Google Scholar 

  12. Hays, R.T.: The Effectiveness of Instructional Games: A Literature Review and Discussion, Technical Report 2005-004, Naval Air Warfare Center Training Systems Division, Orlando (2005)

    Google Scholar 

  13. Hopfenberg, T.N.: Students’ Test Motivation in PISA. In: Proc. EARLI, pp. 498–499 (2011)

    Google Scholar 

  14. Huizenga, J., Admiraal, W., Akkerman, S., ten Dam, G.: Mobile Game-based Learning in Secondary Education: Engagement, Motivation and Learning in a Mobile-city Game. Journal of Computer Assisted Learning 25(4), 332–344 (2009)

    Article  Google Scholar 

  15. Klopfer, E.: Augmented Learning: Research and Design of Mobile Educational Games. MIT Press, Cambridge (2008)

    Google Scholar 

  16. Izard, J.: Trial Testing and Item Analysis in Test Construction. Module 7. In: Quantitative Research Methods in Educational Planning. UNESCO International Institute for Educational Planning (2009)

    Google Scholar 

  17. Ketelhut, D.J., Schifter, C.C.: Teachers and Game-based Learning: Improving Understanding of How to Increase Efficacy of Adoption. Computers & Education 56, 539–546 (2011)

    Article  Google Scholar 

  18. Malone, T.W.: Toward a Theory of Intrinsically Motivating Instruction. Cognitive Science 5(4), 333–369 (1981)

    Article  Google Scholar 

  19. Mayer, R.E.: Multimedia Learning. Cambridge University Press, New York (2001)

    Book  Google Scholar 

  20. Mayer, R.E., Clark, R.C.: Simulations and Games in e-Learning. In: E-Learning and the Science of Instruction, 3rd edn., ch. 16, pp. 369–400. John Wiley & Sons (2011)

    Google Scholar 

  21. Moreno, R.: Instructional technology: Promise and pitfalls. In: Technology-based Education: Bringing Researchers and Practitioners Together, pp. 1–19. Information Age Publishing, Greenwich (2005)

    Google Scholar 

  22. Novak, M., Wilensky, U.: NetLogo Bird Breeder Model. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL (2007), http://ccl.northwestern.edu/netlogo/models/BirdBreeder

    Google Scholar 

  23. Papastergiou, M.: Digital Game-Based Learning in High School Computer Science Education: Impact on Educational Effectiveness and Student Motivation. Computers & Education 52, 1–12 (2009)

    Article  Google Scholar 

  24. Sitzmann, T.: A Meta-analytic Examination of the Instructional Effectiveness of Computer-based Simulation Games. Personnel Psychology 64, 489–528 (2011)

    Article  Google Scholar 

  25. Šisler, V., Brom, C.: Designing an Educational Game: Case Study of ’Europe 2045’. In: Pan, Z., Cheok, D.A.D., Müller, W., El Rhalibi, A. (eds.) Transactions on Edutainment I. LNCS, vol. 5080, pp. 1–16. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  26. Šisler, V., Buchtová, M., Brom, C., Hlávka, Z.: Towards an Empirical–Theoretical Framework for Investigating the Learning Effects of Serious Games: A Pilot Study of Europe 2045. In: Applied Playfulness. Proceedings of the Vienna Games Conference 2011: Future and Reality of Gaming, pp. 16–36. Braumüller Verlag, Vienna (2012)

    Google Scholar 

  27. Wastiau, P., et al.: How are digital games used in schools? Complete Results of the Study. European Schoolnet (2009), http://games.eun.org/upload/gis-synthesis_report_en.pdf (accessed: March 16, 2012)

  28. Wise, S.L.: Strategies for Managing the Problem of Unmotivated Examinees in Low-Stakes Testing Programs. The Journal of General Education 58(3), 152–166 (2009)

    Article  Google Scholar 

  29. Wolfe, J., Crookall, D.: Developing a Scientific Knowledge of Simulation/Gaming. Simulation & Gaming 29(1), 7–19 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brom, C., Šisler, V., Buchtová, M., Klement, D., Levčík, D. (2012). Turning High-Schools into Laboratories? Lessons Learnt from Studies of Instructional Effectiveness of Digital Games in the Curricular Schooling System. In: Göbel, S., Müller, W., Urban, B., Wiemeyer, J. (eds) E-Learning and Games for Training, Education, Health and Sports. Edutainment GameDays 2012 2012. Lecture Notes in Computer Science, vol 7516. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33466-5_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33466-5_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33465-8

  • Online ISBN: 978-3-642-33466-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics