Assessing Problem-Solving Skills in Game-Based Immersive Environments
According to Pearson’s Law: “That which is measured improves.” But some important constructs, like problem-solving skill, are generally viewed as very difficult to measure for a variety of reasons (e.g., lack of a clear and agreed-upon definition, psychological and/or statistical multidimensionality of the construct, subjectivity of scoring, and so on). Adding to the challenge of validly measuring problem-solving skill is that formal education settings tend to focus only on well-structured problems – those that have correct and incorrect answers. However, these problems tend to have little transfer to the real world. In short, there is a gap in the kinds of problems being assessed and taught in schools and those desired in workplace environments. In this chapter, we focus on how game-based immersive environments, such as well-designed video games, can be used to both measure and promote the development of problem-solving skills in formal education settings. In this chapter, we discuss the theoretical foundations of problem-solving and provide a worked example of assessing it from gameplay using a well-designed video game. We conclude the chapter with a discussion on future implications for using game-based environments to measure and promote problem-solving skills in education.
KeywordsAssessment Game-based learning Problem-solving skill Stealth assessment Video games
- Anderson, J. R. (1980). Cognitive psychology and its implications. New York: Freeman.Google Scholar
- Baniqued, P. L., Kranz, M. B., Voss, M. W., Lee, H., Cosman, J. D., Severson, J., & Kramer, A. F. (2013). Cognitive training with casual video games: Points to consider. Frontiers in Psychology, 4, 1010.Google Scholar
- Bransford, J. D., & Stein, B. S. (1984). The IDEAL problem solver. A guide for improving thinking, learning, and creativity. New York: Freeman.Google Scholar
- Chuang, T.-Y., & Chen, W.-F. (2009). Effect of computer-based video games on children: An experimental study. Educational Technology & Society, 12(2), 1–10.Google Scholar
- Cukier, K. N., & Mayer-Schoenberger, V. (2013). The rise of Big Data: How it’s changing the way we think about the world. Foreign Affairs, 92(3). Retrieved 19 Aug 2017 from http://www.foreignaffairs.com/articles/139104/kenneth-neil-cukier-and-viktor-mayerschoenberger/the-rise-of-big-data.
- Dede, C. (2005). Planning for neomillennial learning styles. EDUCAUSE Quarterly, 28(1), 7–12.Google Scholar
- DiCerbo, K. E., & Behrens, J. T. (2012). Implications of the digital ocean on current and future assessment. In R. Lissitz & H. Jiao (Eds.), Computers and their impact on state assessment: Recent history and predictions for the future (pp. 273–306). Charlotte: Information Age Publishing.Google Scholar
- Entertainment Software Association. (2016). 2016 Essential facts about the computer and video game industry. The Entertainment Software Association. Retrieved from http://www.theesa.com/wp-content/uploads/2016/04/Essential-Facts-2016.pdf.
- Gagné, R. M., Wager, W. W., Golas, K. C., & Keller, J. M. (2005). Principles of instructional design (5th ed.). Belmont: Wadsworth/Thomson Learning.Google Scholar
- Gee, J. P. (2008). Learning and games. In K. Salen (Ed.), The ecology of games: Connecting youth, games, and learning (pp. 21–40). Cambridge, MA: MIT Press.Google Scholar
- Gee, J. P., & Hayes, E. (2011). Nurturing affinity spaces and game-based learning. In C. Steinkuehler, K. Squire, & S. Barab (Eds.), Games, learning, and society: Learning and meaning in the digital age (pp. 129–153). New York: Cambridge University Press.Google Scholar
- Hart Research Associates. (2015). Falling short? College learning and career success. Washington, DC: Association of American Colleges and Universities.Google Scholar
- Jonassen, D. H. (2002). Engaging and supporting problem solving in online learning. Quarterly Review of Distance Education, 3(1), 1–13.Google Scholar
- Krulak, C. (1997). Military thinking and decision-making exercises (No. 1500.55). Washington, DC. Retrieved 19 Aug 2017 from http://www.marines.mil/Portals/59/Publications/MCO1500.55.pdf.
- Lanyon, R. I., & Goodstein, L. D. (1997). Personality assessment (3rd ed.). New York: Wiley.Google Scholar
- Mayer, R. E. (1992). Thinking, problem solving, cognition (2nd ed.). New York: Freeman.Google Scholar
- Mayer, R., & Wittrock, M. (2006). Problem solving. In P. Alexander & P. Winne (Eds.), Handbook of educational psychology (2nd ed., pp. 287–303). Mahwah: Erlbaum.Google Scholar
- Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessment. Measurement: Interdisciplinary Research and Perspective, 1(1), 3–62.Google Scholar
- Pagliery, J. (2014). Why I put World of Warcraft on my resume. Retrieved 26 Nov 2016 from http://money.cnn.com/2014/06/19/technology/world-of-warcraft-resume/.
- Partnership for 21st Century Learning. (2016). Retrieved 21 Nov 2016 from http://www.p21.org/storage/documents/docs/P21_framework_0116.pdf.
- Polya, G. (1945). How to solve it: A new aspect of mathematical method. Princeton: Princeton University Press.Google Scholar
- Rowe, J. P., Shores, L. R., Mott, B. W., & Lester, J. C. (2011). Integrating learning, problem solving, and engagement in narrative-centered learning environments. International Journal of Artificial Intelligence in Education, 21(1), 115–133.Google Scholar
- Schrader, P., Zheng, D., & Young, M. (2006). Teachers’ perceptions of video games: MMOGs and the future of preservice teacher education. Innovate, 2(3). Retrieved April 17, 2018 from https://nsuworks.nova.edu/innovate/vol2/iss3/5/
- Selfe, C. L., & Hawisher, G. E. (2004). Literate lives in the information age: Narratives on literacy from the United States. Mahwah: Erlbaum.Google Scholar
- Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias & J. D. Fletcher (Eds.), Computer games and instruction (pp. 503–524). Charlotte: Information Age Publishers.Google Scholar
- Shute, V. J., & Ventura, M. (2013). Measuring and supporting learning in games: Stealth assessment. Cambridge, MA: MIT Press.Google Scholar
- Thorndike, E. L. (1898). Animal intelligence: An experimental study of the associative processes in animals. Psychological Review, Monograph Supplement, 2(4), 1–8.Google Scholar
- Van Eck, R. (2006). Digital game-based learning: It’s not just the digital natives who are restless. EDUCAUSE review, 41(2), 1–16.Google Scholar
- Van Eck, R., Hung, W., Bowman, R., & Love, S. (2009). 21st century game design: A model and prototype for promoting scientific problem solving. In Proceedings of the twelfth IASTED international conference on computers and advanced technology in education: Globalization of education through advanced technology. Calgary: ACTA Press.Google Scholar
- Van Eck, R. N., Shute, V. J., & Rieber, L. P. (2017). Leveling up: Game design research and practice for instructional designers. In R. Reiser & J. Dempsey (Eds.), Trends and issues in instructional design and technology (4rd ed., pp. 227–285). Upper Saddle River: Pearson Education.Google Scholar