Skip to main content

Opportunities for Analytics in Challenge-Based Learning

  • Chapter
  • First Online:

Part of the book series: Smart Computing and Intelligence ((SMCOMINT))

Abstract

This study is part of a research programme investigating the dynamics and impacts of learning engagement in a challenge-based digital learning environment. Learning engagement is a multidimensional concept which includes an individual’s ability to behaviourally, cognitively, emotionally, and motivationally engage in an on-going learning process. Challenge-based learning gives significant freedom to the learner to decide what and when to engage and interact with digital learning materials. In light of previous empirical findings, we expect that learning engagement is positively related to learning performance in a challenge-based online learning environment. This study was based on data from the Challenge platform, including transaction data from 8951 students. Findings indicate that learning engagement in challenge-based digital learning environments is, as expected, positively related to learning performance. Implications point toward the need for personalised and adaptive learning environments to be developed in order to cater for the individual needs of learners in challenge-based online learning environments.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research and Development, 45, 65–94.

    Article  Google Scholar 

  2. Funke, J. (2012). Complex problem solving. In N. M. Seel (Ed.), The encyclopedia of the sciences of learning (Vol. 3, pp. 682–685). New York, NY: Springer.

    Chapter  Google Scholar 

  3. Jonassen, D. H. (2011). Learning to solve problems. A handbook for designing problem-solving learning environments. New York: Routledge.

    Google Scholar 

  4. Funke, J. (1991). Solving complex problems: Exploration and control of complex problems. In R. J. Sternberg & P. A. Frensch (Eds.), Complex problem solving: Principles and mechanisms (pp. 185–222). Hillsdale, NJ: Lawrence Erlbaum.

    Google Scholar 

  5. Seel, N. M., Ifenthaler, D., & Pirnay-Dummer, P. (2009). Mental models and problem solving: Technological solutions for measurement and assessment of the development of expertise. In P. Blumschein, W. Hung, D. H. Jonassen, & J. Strobel (Eds.), Model-based approaches to learning: Using systems models and simulations to improve understanding and problem solving in complex domains (pp. 17–40). Rotterdam: Sense Publishers.

    Chapter  Google Scholar 

  6. Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61, 443–463.

    Article  Google Scholar 

  7. Gee, J. P. (2003). What video games have to teach us about learning and literacy. New York: Palgrave-Macmillan.

    Book  Google Scholar 

  8. Eseryel, D., Ge, X., Ifenthaler, D., & Law, V. (2011). Dynamic modeling as cognitive regulation scaffold for complex problem solving skill acquisition in an educational massively multiplayer online game environment. Journal of Educational Computing Research, 45, 265–287.

    Article  Google Scholar 

  9. Ifenthaler, D., Bellin-Mularski, N., & Mah, D.-K. (Eds.). (2016). Foundations of digital badges and micro-credentials. New York, NY: Springer.

    Google Scholar 

  10. Gibson, D. C., Ostashewski, N., Flintoff, K., Grant, S., & Knight, E. (2013). Digital badges in education. Education and Information Technologies, 20, 403–410.

    Article  Google Scholar 

  11. Ifenthaler, D. (2011). Intelligent model-based feedback. Helping students to monitor their individual learning progress. In S. Graf, F. Lin, Kinshuk, & R. McGreal (Eds.), Intelligent and adaptive systems: Technology enhanced support for learners and teachers (pp. 88–100). Hershey, PA: IGI Global.

    Google Scholar 

  12. Boud, D., & Molloy, E. (2013). Rethinking models of feedback for learning: The challenge of design. Assessment & Evaluation in Higher Education, 38, 698–712.

    Article  Google Scholar 

  13. Ge, X., & Ifenthaler, D. (2017). Designing engaging educational games and assessing engagement in game-based learning. In R. Zheng & M. K. Gardner (Eds.), Handbook of research on serious games for educational applications (pp. 255–272). Hershey, PA: IGI Global.

    Google Scholar 

  14. Prensky, M. (2001). Digital game-based learning. New York, NY: McGraw-Hill.

    Google Scholar 

  15. Harris, D., & Nolte, P. (2007). Global challenge award: External evaluation year 1 2006–2007. Montpelier, VT: Vermont Institutes Evaluation Center.

    Google Scholar 

  16. Roselli, R., & Brophy, S. (2006). Effectiveness of challenge-based instruction in biomechanics. Journal of Engineering Education, 95, 311–324.

    Article  Google Scholar 

  17. Ifenthaler, D. (2017). Are higher education institutions prepared for learning analytics? TechTrends, 61, 366–371.

    Article  Google Scholar 

  18. Ifenthaler, D., & Widanapathirana, C. (2014). Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning, 19, 221–240.

    Article  Google Scholar 

  19. Seif El-Nasr, M., Drachen, A., & Canossa, A. (Eds.). (2013). Game analytics. Maximizing the value of player data. London: Springer.

    Google Scholar 

  20. Loh, C. S., Sheng, Y., & Ifenthaler, D. (2015). Serious games analytics: Theoretical framework. In C. S. Loh, Y. Sheng, & D. Ifenthaler (Eds.), Serious games analytics: Methodologies for performance measurement, assessment, and improvement (pp. 3–29). New York, NY: Springer.

    Google Scholar 

  21. Berland, M., Baker, R. S., & Bilkstein, P. (2014). Educational data mining and learning analytics: Applications to constructionist research. Technology, Knowledge and Learning, 19, 205–220.

    Article  Google Scholar 

  22. Gibson, D. C., & Clarke-Midura, J. (2015). Some psychometric and design implications of game-based learning analytics. In P. Isaias, J. M. Spector, D. Ifenthaler, & D. G. Sampson (Eds.), E-Learning systems, environments and approaches: Theory and implementation (pp. 247–261). New York, NY: Springer.

    Google Scholar 

  23. Gibson, D. C., & Jackl, P. (2015). Theoretical considerations for game-based e-learning analytics. In T. Reiners & L. Wood (Eds.), Gamification in education and business (pp. 403–416). New York, NY: Springer.

    Google Scholar 

  24. Griffin, P., & Care, E. (Eds.). (2015). Assessment and teaching of 21st Century skills: Methods and approach. Dordrecht: Springer.

    Google Scholar 

  25. Baradwaj, B. K., & Pal, S. (2011). Mining educational data to analyze students’ performance. International Journal of Advanced Computer Science and Applications, 2, 63–69.

    Google Scholar 

  26. Kuh, G. D. (2009). What student affairs professionals need to know about student engagement. Journal of College Student Development, 50, 683–706.

    Article  Google Scholar 

  27. Wolters, C. A., & Taylor, D. J. (2012). A self-regulated learning perspective on student engagement. In S. Christenson, A. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 635–651). Boston, MA: Springer.

    Chapter  Google Scholar 

  28. Carini, R. M., Kuh, G. D., & Klein, S. P. (2006). Student engagement and student learning: testing the linkages. Research in Higher Education, 47, 1–32.

    Article  Google Scholar 

  29. Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41, 64–70.

    Article  Google Scholar 

  30. Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S. I. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 763–781). New York, NY: Springer.

    Google Scholar 

  31. Klein, S. P., Kuh, G. D., Chun, M., Hamilton, L., & Shavelson, R. (2005). An approach to measuring cognitive outcomes across higher education institutions. Research in Higher Education, 46, 251–276.

    Article  Google Scholar 

  32. Carini, R. M. (2012). Engagement in learning. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 1153–1156). Boston, MA: Springer.

    Chapter  Google Scholar 

  33. Kirschner, F., Kester, L., & Corbalan, G. (2011). Cognitive load theory and multimedia learning, task characteristics and learning engagement: The current state of the art. Computers in Human Behavior, 27, 1–4.

    Article  Google Scholar 

  34. Chen, I.-S. (2017). Computer self-efficacy, learning performance, and the mediating role of learning engagement. Computers in Human Behavior, 72, 362–370.

    Article  Google Scholar 

  35. Miller, B. W. (2015). Using reading times and eye-movements to measure cognitive engagement. Educational Psychologist, 50, 31–42.

    Article  Google Scholar 

  36. Miller, B. W., Anderson, R. C., Morris, J., Lin, T. J., Jadallah, M., & Sun, J. (2014). The effects of reading to prepare for argumentative discussion on cognitive engagement and conceptual growth. Learning and Instruction, 33, 67–80.

    Google Scholar 

  37. Flowerday, T., & Shell, D. F. (2015). Disentangling the effects of interest and choice on learning, engagement, and attitude. Learning and Individual Differences, 40, 134–140.

    Article  Google Scholar 

  38. Lin, W., Wang, L., Bamberger, P. A., Zhang, Q., Wang, H., Guo, W., et al. (2016). Leading future orientations for current effectiveness: The role of engagement and supervisor coaching in linking future work self salience to job performance. Journal of Vocational Behavior, 92, 145–156.

    Article  Google Scholar 

  39. Pourbarkhordari, A., Zhou, E. H. I., & Pourkarimi, J. (2016). How individual-focused transformational leadership enhances its influence on job performance through employee work engagement. International Journal of Business and Management, 11, 249–261.

    Article  Google Scholar 

  40. Ifenthaler, D., & Seel, N. M. (2005). The measurement of change: Learning-dependent progression of mental models. Technology, Instruction, Cognition and Learning, 2, 317–336.

    Google Scholar 

  41. Graesser, A. C., Millis, K. K., & Zwaan, R. A. (1997). Discourse comprehension. Annual Review of Psychology, 48, 163–189.

    Article  Google Scholar 

  42. Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57, 1439–1459.

    Article  Google Scholar 

  43. Agrawal, R., Golshan, B., & Papalexakis, E. (2016). Toward data-driven design of educational courses: A feasibility study. Journal of Educational Data Mining, 8, 1–21.

    Google Scholar 

  44. Ifenthaler, D., Gibson, D. C., & Dobozy, E. (2018). Informing learning design through analytics: Applying network graph analysis. Australasian Journal of Educational Technology, 34, 117–132.

    Article  Google Scholar 

  45. Crossley, S. A. (2013). Advancing research in second language writing through computational tools and machine learning techniques. Language Teaching, 46, 256–271.

    Article  Google Scholar 

  46. Ifenthaler, D. (2014). AKOVIA: Automated knowledge visualization and assessment. Technology, Knowledge and Learning, 19, 241–248.

    Article  Google Scholar 

  47. Eseryel, D., Law, V., Ifenthaler, D., Ge, X., & Miller, R. B. (2014). An investigation of the interrelationships between motivation, engagement, and complex problem solving in game-based learning. Journal of Educational Technology & Society, 17, 42–53.

    Google Scholar 

  48. Gibson, D. C., & Ifenthaler, D. (2018). Analysing performance in authentic digital scenarios. In T.-W. Chang, R. Huang, & Kinshuk (Eds.), Authentic learning through advances in technologies (pp. 17–27). New York, NY: Springer.

    Google Scholar 

  49. Gibson, D. C. (2018). Unobtrusive observation of team learning attributes in digital learning. Frontiers in Psychology, 9, 1–5.

    Article  Google Scholar 

  50. Ifenthaler, D. (2017). Learning analytics design. In L. Lin & J. M. Spector (Eds.), The sciences of learning and instructional design. Constructive articulation between communities (pp. 202–211). New York, NY: Routledge.

    Google Scholar 

Download references

Acknowledgements

This research is supported by Curtin University’s UNESCO Chair of Data Science in Higher Education Learning and Teaching (https://research.curtin.edu.au/unesco/).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dirk Ifenthaler .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ifenthaler, D., Gibson, D. (2019). Opportunities for Analytics in Challenge-Based Learning. In: Tlili, A., Chang, M. (eds) Data Analytics Approaches in Educational Games and Gamification Systems. Smart Computing and Intelligence. Springer, Singapore. https://doi.org/10.1007/978-981-32-9335-9_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-32-9335-9_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-32-9334-2

  • Online ISBN: 978-981-32-9335-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics