Skip to main content
SpringerLink
Log in

Rich Representations for Analyzing Learning Trajectories: Systematic Review on Sequential Data Analytics in Game-Based Learning Research

  • Chapter
  • First Online:
Data Analytics Approaches in Educational Games and Gamification Systems

Part of the book series: Smart Computing and Intelligence ((SMCOMINT))

Abstract

This chapter focuses on sequential data analytics (SDA), which is one of the prominent behavior analysis frameworks in game-based learning (GBL) research. Although researchers have used a variety of SDA approaches in GBL, they have provided limited information that demonstrates the way they have employed those SDA approaches in different learning contexts. This study used a systematic literature review to demonstrate findings that synthesize SDA’s empirical uses in various GBL contexts. In this chapter, we recapitulate the characteristics of several SDA techniques that salient GBL studies have used first. Then, we address the underlying theoretical foundations that explain the proper uses of SDA in GBL research. Lastly, the chapter concludes with brief guidelines that illustrate the way to use SDA, as well as reveal major issues in implementing SDA.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. Computer Games and Instruction, 55(2), 503–524.

    Google Scholar 

  2. Chen, Z.-H. (2014). Exploring students’ behaviors in a competition-driven educational game. Computers in Human Behavior, 35, 68–74.

    Article  Google Scholar 

  3. Ke, F., & Shute, V. (2015). Design of game-based stealth assessment and learning support. In Serious games analytics (pp. 301–318). New York: Springer.

    Google Scholar 

  4. Taub, M., Azevedo, R., Bradbury, A. E., Millar, G. C., & Lester, J. (2018). Using sequence mining to reveal the efficiency in scientific reasoning during STEM learning with a game-based learning environment. Learning and Instruction, 54, 93–103.

    Article  Google Scholar 

  5. Martínez, H. P., & Yannakakis, G. N. (2011). Mining multimodal sequential patterns: A case study on affect detection. In 13th International Conference on Multimodal Interfaces (pp. 3–10).

    Google Scholar 

  6. Kang, J., Liu, M., & Qu, W. (2017). Using gameplay data to examine learning behavior patterns in a serious game. Computers in Human Behavior, 72, 757–770.

    Article  Google Scholar 

  7. Loh, C. S., Sheng, Y., & Ifenthaler, D. (2015). Serious games analytics: Theoretical framework. In Serious games analytics (pp. 3–29). New York: Springer.

    Google Scholar 

  8. Kinnebrew, J. S., & Biswas, G. (2012). Identifying learning behaviors by contextualizing differential sequence mining with action features and performance evolution. In International Educational Data Mining Society.

    Google Scholar 

  9. Sun, R., & Giles, C. L. (2001). Sequence learning: From recognition and prediction to sequential decision making. IEEE Intelligent Systems, 16(4), 67–70.

    Article  Google Scholar 

  10. Sun, J. C.-Y., Kuo, C.-Y., Hou, H.-T., & Lin, Y.-Y. (2017). Exploring learners’ sequential behavioral patterns, flow experience, and learning performance in an anti-phishing educational game. Journal of Educational Technology & Society, 20(1).

    Google Scholar 

  11. Biswas, G., Kinnebrew, J. S., & Segedy, J. R. (2014). Using a cognitive/metacognitive task model to analyze students learning behaviors. In International Conference on Augmented Cognition (pp. 190–201).

    Google Scholar 

  12. Liao, C. C., Chen, Z.-H., Cheng, H. N., & Chang, T.-W. (2012). Unfolding learning behaviors: A sequential analysis approach in a game-based learning environment. Research & Practice in Technology Enhanced Learning, 7(1).

    Google Scholar 

  13. Hsieh, Y.-H., Lin, Y.-C., & Hou, H.-T. (2016). Exploring the role of flow experience, learning performance and potential behavior clusters in elementary students’ game-based learning. Interactive Learning Environments, 24(1), 178–193.

    Article  Google Scholar 

  14. Hung, Y. H., Chang, R. I., & Lin, C. F. (2016). Hybrid learning style identification and developing adaptive problem-solving learning activities. Computers in Human Behavior, 55, 552–561.

    Article  Google Scholar 

  15. Drachen, A., Thurau, C., Togelius, J., Yannakakis, G. N., & Bauckhage, C. (2013). Game data mining. In Game analytics (pp. 205–253). New York: Springer.

    Google Scholar 

  16. Yang, T.-C., Chen, S. Y., & Hwang, G.-J. (2015). The influences of a two-tier test strategy on student learning: A lag sequential analysis approach. Computers & Education, 82, 366–377.

    Article  Google Scholar 

  17. Kolb, S. M. (2012). Grounded theory and the constant comparative method: Valid research strategies for educators. Journal of Emerging Trends in Educational Research and Policy Studies, 3(1), 83.

    Google Scholar 

  18. Baker, R. S., & Inventado, P. S. (2014). Educational data mining and learning analytics. In Learning analytics (pp. 61–75). New York: Springer.

    Google Scholar 

  19. Zaki, M. J. (2000). Sequence mining in categorical domains: Incorporating constraints. In 9th International Conference on Information and Knowledge Management (pp. 422–429).

    Google Scholar 

  20. Gottman, J., Gottman, J. M., & Roy, A. K. (1990). Sequential analysis: A guide for behavioral researchers. Cambridge University Press.

    Google Scholar 

  21. Wallner, G., & Kriglstein, S. (2015). Comparative visualization of player behavior for serious game analytics. In Serious games analytics (pp. 159–179). New York: Springer.

    Google Scholar 

  22. Loh, C. S., Li, I.-H., & Sheng, Y. (2016). Comparison of similarity measures to differentiate players’ actions and decision-making profiles in serious games analytics. Computers in Human Behavior, 64, 562–574.

    Article  Google Scholar 

  23. Srikant, R., & Agrawal, R. (1996). Mining sequential patterns: Generalizations and performance improvements. In International Conference on Extending Database Technology (pp. 1–17). New York: Springer.

    Google Scholar 

  24. Bakeman, R., & Brownlee, J. R. (1980). The strategic use of parallel play: A sequential analysis. In Child development (pp. 873–878).

    Google Scholar 

  25. Hou, H.-T. (2012). Exploring the behavioral patterns of learners in an educational massively multiple online role-playing game (MMORPG). Computers & Education, 58(4), 1225–1233.

    Article  Google Scholar 

  26. Sabourin, J. L., Shores, L. R., Mott, B. W., & Lester, J. C. (2013). Understanding and predicting student self-regulated learning strategies in game-based learning environments. International Journal of Artificial Intelligence in Education, 23(1–4), 94–114.

    Article  Google Scholar 

  27. Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122.

    Article  Google Scholar 

  28. Bogdan, R., & Biklen, S. K. (1997). Qualitative research for education. MA: Allyn & Bacon Boston.

    Google Scholar 

  29. Connelly, F. M., & Clandinin, D. J. (1990). Stories of experience and narrative inquiry. Educational Researcher, 19(5), 2–14.

    Article  Google Scholar 

  30. Cortazzi, M. (2014). Narrative analysis. Routledge.

    Google Scholar 

  31. Hwang, G.-J., Chiu, L.-Y., & Chen, C.-H. (2015). A contextual game-based learning approach to improving students’ inquiry-based learning performance in social studies courses. Computers & Education, 81, 13–25.

    Article  Google Scholar 

  32. Lester, J. C., Ha, E. Y., Lee, S. Y., Mott, B. W., Rowe, J. P., & Sabourin, J. L. (2013). Serious games get smart: Intelligent game-based learning environments. AI Magazine, 34(4), 31–45.

    Article  Google Scholar 

  33. Woo, Y., & Reeves, T. C. (2007). Meaningful interaction in web-based learning: A social constructivist interpretation. The Internet and Higher Education, 10(1), 15–25.

    Article  Google Scholar 

  34. Hsieh, Y.-H., Lin, Y.-C., & Hou, H.-T. (2015). Exploring elementary-school students’ engagement patterns in a game-based learning environment. Journal of Educational Technology & Society, 18(2), 336.

    Google Scholar 

  35. Vandercruysse, S., & Elen, J. (2017). Towards a game-based learning instructional design model focusing on integration. In Instructional techniques to facilitate learning and motivation of serious games (pp. 17–35). New York: Springer.

    Google Scholar 

  36. Taub, M., Mudrick, N. V., Azevedo, R., Millar, G. C., Rowe, J., & Lester, J. (2017). Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island. Computers in Human Behavior, 76, 641–655.

    Article  Google Scholar 

  37. Kinnebrew, J. S., Killingsworth, S. S., Clark, D. B., Biswas, G., Sengupta, P., Minstrell, J., et al. (2017). Contextual markup and mining in digital games for science learning: Connecting player behaviors to learning goals. IEEE Transactions on Learning Technologies, 10(1), 93–103.

    Article  Google Scholar 

  38. Sabourin, J., Mott, B., & Lester, J. (2013). Discovering behavior patterns of self-regulated learners in an inquiry-based learning environment. In: Lane H.C., Yacef K., Mostow J., Pavlik P. (Eds), Artificial Intelligence in Education AIED. Lecture Notes in Computer Science (Vol. 7926). Springer, Berlin, Heidelberg.

    Google Scholar 

  39. Lin, C. F., Yeh, Y.-C., Hung, Y. H., & Chang, R. I. (2013). Data mining for providing a personalized learning path in creativity: An application of decision trees. Computers & Education, 68, 199–210.

    Article  Google Scholar 

  40. Hwang, G.-J., Hsu, T.-C., Lai, C.-L., & Hsueh, C.-J. (2017). Interaction of problem-based gaming and learning anxiety in language students’ English listening performance and progressive behavioral patterns. Computers & Education, 106, 26–42.

    Article  Google Scholar 

  41. Andres, J. M. L., Rodrigo, M. M. T., Baker, R. S., Paquette, L., Shute, V. J., & Ventura, M. (2015). Analyzing student action sequences and affect while playing physics playground. In International Conference on Educational Data Mining.

    Google Scholar 

  42. Serrano-Laguna, Á., Martínez-Ortiz, I., Haag, J., Regan, D., Johnson, A., & Fernández-Manjón, B. (2017). Applying standards to systematize learning analytics in serious games. Computer Standards & Interfaces, 50, 116–123.

    Article  Google Scholar 

  43. Shih, W.-C. (2017). Mining learners’ behavioral sequential patterns in a Blockly visual programming educational game. In International Conference on Industrial Engineering, Management Science and Application (ICIMSA) (pp. 1–2).

    Google Scholar 

  44. Chang, C. J., Chang, M. H., Liu, C. C., Chiu, B. C., Fan Chiang, S. H., Wen, C. T., et al. (2017). An analysis of collaborative problem‐solving activities mediated by individual‐based and collaborative computer simulations. Journal of Computer Assisted Learning, 33(6), 649–662.

    Article  Google Scholar 

  45. Heyman, R. E., Lorber, M. F., Eddy, J. M., & West, T. V. (2014). Behavioral observation and coding.

    Google Scholar 

  46. Bakeman, R., & Quera, V. (2011). Sequential analysis and observational methods for the behavioral sciences. Cambridge University Press.

    Google Scholar 

  47. Ocumpaugh, J., Baker, R. S., & Rodrigo, M. M. T. (2015). Baker Rodrigo Ocumpaugh monitoring protocol (BROMP) 2.0 technical and training manual. New York, NY and Manila, Philippines: Teachers College, Columbia University and Ateneo Laboratory for the Learning Sciences.

    Google Scholar 

  48. Ocumpaugh, J., Baker, R. S. d., Gaudino, S., Labrum, M. J., & Dezendorf, T. (2013). Field observations of engagement in reasoning mind (pp. 624–627).

    Google Scholar 

  49. Gobert, J. D., Sao Pedro, M. A., Baker, R. S., Toto, E., & Montalvo, O. (2012). Leveraging educational data mining for real-time performance assessment of scientific inquiry skills within microworlds. Journal of Educational Data Mining, 4(1), 104–143.

    Google Scholar 

  50. Hou, H.-T. (2015). Integrating cluster and sequential analysis to explore learners’ flow and behavioral patterns in a simulation game with situated-learning context for science courses: A video-based process exploration. Computers in Human Behavior, 48, 424–435.

    Article  Google Scholar 

  51. Li, C.-H., & Liu, Z.-Y. (2017). Collaborative problem-solving behavior of 15-year-old Taiwanese students in science education. Eurasia Journal of Mathematics, Science and Technology Education, 13(10), 6677–6695.

    Article  Google Scholar 

  52. Wen, C.-T., Chang, C.-J., Chang, M.-H., Chiang, S.-H. F., Liu, C.-C., Hwang, F.-K., et al. (2018). The learning analytics of model-based learning facilitated by a problem-solving simulation game. Instructional Science, 46(6), 847–867.

    Article  Google Scholar 

  53. Snow, E. L., Jackson, G. T., & McNamara, D. S. (2014). Emergent behaviors in computer-based learning environments: Computational signals of catching up. Computers in Human Behavior, 41, 62–70.

    Article  Google Scholar 

  54. Codocedo, V., Bosc, G., Kaytoue, M., Boulicaut, J.-F., & Napoli, A. (2017). A proposition for sequence mining using pattern structures. In: Bertet K., Borchmann D., Cellier P., Ferré S. (Eds) Formal concept analysis. ICFCA 2017. Lecture Notes in Computer Science (Vol. 10308, pp. 106–121).

    Google Scholar 

  55. Lin, T.-J., Duh, H. B.-L., Li, N., Wang, H.-Y., & Tsai, C.-C. (2013). An investigation of learners’ collaborative knowledge construction performances and behavior patterns in an augmented reality simulation system. Computers & Education, 68, 314–321.

    Article  Google Scholar 

  56. Han, J., Pei, J., Mortazavi-Asl, B., Chen, Q., Dayal, U., & Hsu, M.-C. (2000). FreeSpan: Frequent pattern-projected sequential pattern mining. In ACM SIGKDD (pp. 355–359).

    Google Scholar 

  57. Agarwal, R., & Srikant, R. (1994). Fast algorithms for mining association rules. In 20th International Conference on Very Large Data Bases (VLDB) (pp. 487–499).

    Google Scholar 

  58. Tsai, M.-J., Huang, L.-J., Hou, H.-T., Hsu, C.-Y., & Chiou, G.-L. (2016). Visual behavior, flow and achievement in game-based learning. Computers & Education, 98, 115–129.

    Article  Google Scholar 

  59. Neuman, Y., Leibowitz, L., & Schwarz, B. (2000). Patterns of verbal mediation during problem solving: A sequential analysis of self-explanation. The Journal of Experimental Education, 68(3), 197–213.

    Google Scholar 

  60. Biswas, G., Jeong, H., Kinnebrew, J. S., Sulcer, B., & Roscoe, R. (2010). Measuring self-regulated learning skills through social interactions in a teachable agent environment. Research and Practice in Technology Enhanced Learning, 5(02), 123–152.

    Article  Google Scholar 

  61. Jeong, A. C. (2010). Assessing change in learners’ causal understanding using sequential analysis and causal maps. Innovative assessment for the 21st century (pp. 187–205). Boston, MA: Springer.

    Google Scholar 

  62. Vialardi, C., Bravo, J., Shafti, L., & Ortigosa, A. (2009). Recommendation in higher education using data mining techniques. In International Working Group on Educational Data Mining.

    Google Scholar 

  63. Rowe, J. P., McQuiggan, S. W., Robison, J. L., & Lester, J. C. (2009). Off-task behavior in narrative-centered learning environments. In AIED (pp. 99–106).

    Google Scholar 

  64. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.

    Google Scholar 

  65. Mann, C. (2003). Observational research methods. Research design II: Cohort, cross sectional, and case-control studies. Emergency Medicine Journal, 20(1), 54–60.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Educational Psychology and Learning Systems, Florida State University, Tallahassee, USA

    Jewoong Moon & Zhichun Liu

Authors
  1. Jewoong Moon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhichun Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jewoong Moon .

Editor information

Editors and Affiliations

  1. Smart Learning Institute, Beijing Normal University, Beijing, China

    Ahmed Tlili

  2. School of Computing and Information Systems, Athabasca University, Edmonton, AB, Canada

    Maiga Chang

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Moon, J., Liu, Z. (2019). Rich Representations for Analyzing Learning Trajectories: Systematic Review on Sequential Data Analytics in Game-Based Learning Research. In: Tlili, A., Chang, M. (eds) Data Analytics Approaches in Educational Games and Gamification Systems. Smart Computing and Intelligence. Springer, Singapore. https://doi.org/10.1007/978-981-32-9335-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-32-9335-9_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-32-9334-2

  • Online ISBN: 978-981-32-9335-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation