Advertisement

Game-Based Assessment: The Past Ten Years and Moving Forward

  • Yoon Jeon Kim
  • Dirk IfenthalerEmail author
Chapter
Part of the Advances in Game-Based Learning book series (AGBL)

Abstract

The implementation of assessment features into game-based learning environments is only in its early stages because it adds a very time-consuming step to the design process. The impact on learning and questions toward reliability and validity of technology-based assessment systems are still being questioned. To answer the question of what people are learning from playing games, researchers have been using a variety of methods including external measures, log data capturing in-game actions, and game-related actions beyond the game context. This chapter seeks to identify why research on game-based assessment is still in its infancy, what advances have been achieved over the past 10 years, and which challenges lie ahead for advancing assessment in game-based learning.

Keywords

Assessment Game-based learning Serious games analytics Learning analytics 

References

  1. Almond, R. G., Steinberg, L. S., & Mislevy, R. J. (2002). Enhancing the design and delivery of assessment systems: A four process architecture. Journal of Technology, Learning, and Assessment, 1(5), 3–63.Google Scholar
  2. Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I., & Fernández-Manjón, B. (2019). Applications of data science to game learning analytics data: A systematic literature review. Computers & Education, 141, 103612.  https://doi.org/10.1016/j.compedu.2019.103612CrossRefGoogle Scholar
  3. Baptista, G., & Oliveira, T. (2019). Gamification and serious games: A literature meta-analysis and integrative model. Computers in Human Behavior, 92, 306–315.CrossRefGoogle Scholar
  4. Behrens, J., Mislevy, R., Dicerbo, K., & Levy, R. (2012). Evidence centered design for learning and assessment in the digital world. In M. Mayrath, J. Clarke-Midura, D. Robinson, & G. Schraw (Eds.), Technology-based assessments for 21st century skills (pp. 13–54). Charlotte, NC: Information Age Publishers.Google Scholar
  5. Bertling, M., Jackson, G. T., Oranje, A., & Owen, V. E. (2015). Measuring argumentation skills with game-based assessments: Evidence for incremental validity and learning. In C. Conati, N. Heffernan, A. Mitrovic, & M. Verdejo (Eds.), Artificial intelligence in education. AIED 2015 (Vol. 9112, pp. 545–549). Cham, Switzerland: Springer.Google Scholar
  6. Black, P. J. (1998). Testing: Friend or foe? The theory and practice of assessment and testing. London, UK: Falmer Press.Google Scholar
  7. Boyle, E. A., Hainey, T., Connolly, T. M., Grant, G., Earp, J., Ott, M., … Pereira, J. (2016). An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Computers & Education, 94, 178–192.  https://doi.org/10.1016/j.compedu.2015.11.003CrossRefGoogle Scholar
  8. Bressler, D. M., & Bodzin, A. M. (2016). A mixed methods assessment of students’ flow experiences during a mobile augmented reality science game. Journal of Computer Assisted Learning, 29, 505–517.  https://doi.org/10.1111/jcal.12008CrossRefGoogle Scholar
  9. Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122.  https://doi.org/10.3102/0034654315582065CrossRefGoogle Scholar
  10. Dicerbo, K., Bertling, M., Stephenson, S., Jia, Y., Mislevy, R. J., Bauer, M., & Jackson, G. T. (2015). An application of exploratory data analysis in the development of game-based assessments. In C. S. Loh, Y. Sheng, & D. Ifenthaler (Eds.), Serious games analytics. Methodologies for performance measurement, assessment, and improvement (pp. 319–342). New York, NY: Springer.CrossRefGoogle Scholar
  11. Divjak, B., & Tomić, D. (2011). The impact of game-based learning on the achievement of learning goals and motivation for learning mathematics - Literature review. Journal of Information and Organizational Sciences, 35(1), 15–30.Google Scholar
  12. Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.CrossRefGoogle Scholar
  13. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.Google Scholar
  14. Eseryel, D., Ge, X., Ifenthaler, D., & Law, V. (2011). Dynamic modeling as cognitive regulation scaffold for complex problem solving skill acquisition in an educational massively multiplayer online game environment. Journal of Educational Computing Research, 45(3), 265–287.CrossRefGoogle Scholar
  15. Eseryel, D., Ifenthaler, D., & Ge, X. (2011). Alternative assessment strategies for complex problem solving in game-based learning environments. In D. Ifenthaler, P. I. Kinshuk, D. G. Sampson, & J. M. Spector (Eds.), Multiple perspectives on problem solving and learning in the digital age (pp. 159–178). New York, NY: Springer.CrossRefGoogle Scholar
  16. Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61(3), 443–463.  https://doi.org/10.1007/s11423-013-9297-2CrossRefGoogle Scholar
  17. Eseryel, D., Law, V., Ifenthaler, D., Ge, X., & Miller, R. B. (2014). An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning. Journal of Educational Technology & Society, 17(1), 42–53.Google Scholar
  18. Federation of American Scientists. (2005). Summit of educational games: Harnessing the power of video games for learning. Washington, DC: Author.Google Scholar
  19. Ge, X., & Ifenthaler, D. (2017). Designing engaging educational games and assessing engagement in game-based learning. In R. Zheng & M. K. Gardner (Eds.), Handbook of research on serious games for educational applications (pp. 255–272). Hershey, PA: IGI Global.Google Scholar
  20. Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York, NY: Palgrave Macmillan.CrossRefGoogle Scholar
  21. Gee, J. P. (2008). Learning and games. The ecology of games: Connecting youth, games, and learning. In K. Salen (Ed.), The John D. and Catherine T. MacArthur Foundation series on digital media and learning (pp. 21–40). Cambridge, MA: MIT.Google Scholar
  22. Gibson, D. C., & Ifenthaler, D. (2017). Preparing the next generation of education researchers for big data in higher education. In B. K. Daniel (Ed.), Big data and learning analytics: Current theory and practice in higher education (pp. 29–42). New York, NY: Springer.CrossRefGoogle Scholar
  23. Gibson, D. C., Ifenthaler, D., & Orlic, D. (2016). Open assessment resources for deeper learning. In P. Blessinger & T. J. Bliss (Eds.), Open education: International perspectives in higher education (pp. 257–279). Cambridge, UK: Open Book Publishers.Google Scholar
  24. Gibson, D. C., & Jackl, P. (2015). Theoretical considerations for game-based e-learning analytics. In T. Reiners & L. Wood (Eds.), Gamification in education and business (pp. 403–416). New York, NY: Springer.Google Scholar
  25. Ifenthaler, D. (2014). AKOVIA: Automated knowledge visualization and assessment. Technology, Knowledge and Learning, 19(1–2), 241–248.  https://doi.org/10.1007/s10758-014-9224-6CrossRefGoogle Scholar
  26. Ifenthaler, D. (2015). Learning analytics. In J. M. Spector (Ed.), The SAGE encyclopedia of educational technology (Vol. 2, pp. 447–451). Thousand Oaks, CA: Sage.Google Scholar
  27. Ifenthaler, D., Eseryel, D., & Ge, X. (2012). Assessment for game-based learning. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning. Foundations, innovations, and perspectives (pp. 3–10). New York, NY: Springer.CrossRefGoogle Scholar
  28. Ifenthaler, D., & Gibson, D. C. (2019). Opportunities of analytics in challenge-based learning. In A. Tlili & M. Chang (Eds.), Data analytics approaches in educational games and gamification systems. Cham, Switzerland: Springer.Google Scholar
  29. Ifenthaler, D., Greiff, S., & Gibson, D. C. (2018). Making use of data for assessments: Harnessing analytics and data science. In J. Voogt, G. Knezek, R. Christensen, & K.-W. Lai (Eds.), International handbook of IT in primary and secondary education (2nd ed., pp. 649–663). New York, NY: Springer.Google Scholar
  30. Ke, F. (2016). Designing and integrating purposeful learning in game play: A systematic review. Educational Technology Research and Development, 64(2), 219–244.  https://doi.org/10.1007/s11423-015-9418-1CrossRefGoogle Scholar
  31. Ke, F., Shute, V. J., Clark, K. M., & Erlebacher, G. (2019). Interdisciplinary design of game-based learning platforms. Cham, Switzerland: Springer.CrossRefGoogle Scholar
  32. Kim, Y. J., & Rosenheck, L. (2018). A playful assessment approach to research instrument development. Paper presented at the Thirteenth International Conference of the Learning Sciences, London, UK.Google Scholar
  33. Lenhart, A. (2015). Teen, social media and technology overview 2015. Washington, DC: Pew Research Center.Google Scholar
  34. Loh, C. S., Sheng, Y., & Ifenthaler, D. (2015). Serious games analytics: Theoretical framework. In C. S. Loh, Y. Sheng, & D. Ifenthaler (Eds.), Serious games analytics. Methodologies for performance measurement, assessment, and improvement (pp. 3–29). New York, NY: Springer.CrossRefGoogle Scholar
  35. Newton, P. E. (2007). Clarifying the purposes of educational assessment. Assessment in Education: Principles, Policy & Practice, 14(2), 149–170.  https://doi.org/10.1080/09695940701478321CrossRefGoogle Scholar
  36. Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students knwo: The science and design of educational assessment. Washington, DC: National Academy Press.Google Scholar
  37. Pirnay-Dummer, P., Ifenthaler, D., & Spector, J. M. (2010). Highly integrated model assessment technology and tools. Educational Technology Research and Development, 58(1), 3–18.  https://doi.org/10.1007/s11423-009-9119-8CrossRefGoogle Scholar
  38. Prensky, M. (2001). Digital game-based learning. New York, NY: McGraw-Hill.Google Scholar
  39. Ravyse, W. S., Seugnet Blignaut, A., Leendertz, V., & Woolner, A. (2017). Success factors for serious games to enhance learning: A systematic review. Virtual Reality, 21(1), 31–58.CrossRefGoogle Scholar
  40. Rowe, E., Asbell-Clarke, J., Baker, R. S., Eagle, M., Hicks, A., Barnes, T., … Edwards, T. (2017). Assessing implicit science learning in digital games. Computers in Human Behavior, 76, 617–630.  https://doi.org/10.1016/j.chb.2017.03.043CrossRefGoogle Scholar
  41. Sadler, D. R. (2010). Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), 535–550.CrossRefGoogle Scholar
  42. Shaffer, D. W. (2006). How computer games help children learn? New York, NY: Palgrave Macmillan.CrossRefGoogle Scholar
  43. Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189.CrossRefGoogle Scholar
  44. Shute, V. J., Ventura, M. I., Bauer, M., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). New York, NY: Routledge.Google Scholar
  45. Steinkuehler, C., & Duncan, S. (2008). Scientific habits of mind in virtual worlds. Journal of Science Education and Technology, 17(6), 530–543.CrossRefGoogle Scholar
  46. Stiggins, R. J. (1995). Assessment literacy for the 21st century. Phi Delta Kappan, 77(3), 238–245.Google Scholar
  47. Walsh, D. (2002). Video game violence and public policy. Retrieved from http://www.soc.iastate.edu/sapp/videogames2.pdf

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Teaching Systems LabMassachusetts Institute of TechnologyCambridgeUSA
  2. 2.Learning, Design and TechnologyUniversity of MannheimMannheimGermany
  3. 3.Curtin UniversityPerthAustralia

Personalised recommendations