A Pedagogical Perspective on Big Data and Learning Analytics: A Conceptual Model for Digital Learning Support
- 336 Downloads
The increasing prevalence of learner-centred forms of learning as well as an increase in the number of learners actively participating on a wide range of digital platforms and devices give rise to an ever-increasing stream of learning data. Learning analytics (LA) can enable learners, teachers, and their institutions to better understand and predict learning and performance. However, the pedagogical perspective and matters of learning design have been underrepresented in research thus far. In our paper, we propose a general design framework that includes critical dimensions of LA and assists in creating LA services that support educational practice. On the basis of a two-dimensional framework (individual vs. social, reflection vs. prediction), we then identify four generic approaches to LA aimed at improving learning process and learning outcomes. To demonstrate the application, four use cases are outlined that are based on four previously elaborated generic approaches to LA. Finally, we discuss the validation of the model and close with an outlook on relevant future research.
KeywordsLearning analytics Social learning analytics Digital learning support Learning analytics taxonomy
Funding was provided by Research Grant of the University of St. Gallen.
- Abdous, M., He, W., & Yen, C.-J. (2012). Using data mining for predicting relationships between online question theme and final grade. Educational Technology & Society, 15(3), 77–88.Google Scholar
- Ackermann, F., Eden, C., & Cropper, S. (2004). Getting started with cognitive mapping. Retrieved from http://www.banxia.com/pdf/de/GettingStartedWithCogMapping.pdf.
- Ali, L., Hatala, M., Gašević, D., & Jovanović, J. (2012). A qualitative evaluation of evolution of a learning analytics tool. Computers & Education, 58(1), 470–489.Google Scholar
- Bakharia, A., Corrin, L., de Barba, P., Kennedy, G., Gašević, D., Mulder, R., et al. (2016). A conceptual framework linking learning design with learning analytics. In Proceedings of the sixth international conference on learning analytics & knowledge (pp. 329–338). New York: ACM Press.Google Scholar
- Barber, R., & Sharkey, M. (2012). Course correction: Using analytics to predict course success. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 259–262). New York: ACM Press.Google Scholar
- Berking, P., Foreman, S., Haag, J., & Wiggins, C. (2014). The experience API—Liberating learning design. Report, eLearning Guild.Google Scholar
- Berkling, K., & Thomas, C. (2013). Gamification of a software engineering course and a detailed analysis of the factors that led to its failure. In M. E. Auer & D. Guralnick (Eds.), Proceedings of international conference on interactive collaborative learning (pp. 525–530). https://doi.org/10.1109/icl.2013.6644642.
- Bloom, B. S. (1984). The 2 Sigma Problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13(6), 4–16.Google Scholar
- Buckingham Shum, S., & Deakin Crick, R. (2012). Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics. In Proceedings 2nd international conference on learning analytics & knowledge (pp. 324–335). New York: ACM Press.Google Scholar
- Buckingham Shum, S., & Ferguson, R. (2012). Social learning analytics. Educational Technology & Society, 15(3), 3–26.Google Scholar
- Butz, M. V., Sigaud, O., & Gerard, P. (2003). Internal models and anticipations in adaptive learning systems. In M. V. Butz, O. Sigaud, & P. Gerard (Eds.), Anticipatory behavior in adaptive learning systems. Volume 2684 of the series lecture notes in computer science (pp. 86–109). Berlin: Springer.Google Scholar
- Chatti, M. A., Dyckhoff, A. L., Schroeder, U., & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5/6), 318–331.Google Scholar
- Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 134–138). New York: ACM Press.Google Scholar
- Cope, B., & Kalantzis, M. (2016). Big data comes to school: Implications for learning, assessment, and research. AERA Open, 2(2), 1–19.Google Scholar
- Dawson, S. (2008). A study of the relationship between student social networks and sense of community. Educational Technology & Society, 11(3), 224–238.Google Scholar
- Dawson, S., & Siemens, G. (2014). Analytics to literacies: The development of a learning analytics framework for multiliteracies assessment. The International Review of Research in Open and Distributed Learning, 15(4), 285. Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/1878/3006.
- Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness. In Academic MindTrek 2011, ACM Digital Library. ACM Special Interest Group on Computer-Human Interaction. & ACM Special Interest Group on Multimedia. (Eds.), Proceedings of the 15th international academic MindTrek conference envisioning future media environments. Defining „Gamification“ (pp. 9–15). New York: ACM Press.Google Scholar
- Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18(3), 75–88.Google Scholar
- Duval, E. (2011). Attention please! Learning analytics for visualization and recommendation. In Proceedings of the 1st international conference on learning analytics and knowledge (pp. 9–17). New York: ACM Press.Google Scholar
- Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and implementation of a learning analytics toolkit for teachers. Educational Technology & Society, 15(3), 58–76.Google Scholar
- Evans, C. (2013). Making sense of assessment feedback in higher education. Review of Educational Research, 83, 70–120.Google Scholar
- Ferguson, R., Clow, D., Macfadyen, L., Essa, A., Dawson, S., & Alexander, S. (2014). Setting learning analytics in context: Overcoming the barriers to large-scale adoption. Journal of Learning Analytics, 1(3), 120–144.Google Scholar
- Gibson, A., Kitto, K., & Willis, J. (2014). A cognitive processing framework for learning analytics. In Proceedings of the fourth international conference on learning analytics and knowledge (pp. 212–216). New York: ACM Press.Google Scholar
- Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Educational Technology & Society, 15(3), 42–57.Google Scholar
- Ifenthaler, D. (2015). Learning analytics. In J. M. Spector (Ed.), The SAGE encyclopedia of educational technology (Vol. 2, pp. 447–451). Thousand Oaks, CA: Sage.Google Scholar
- Ifenthaler, D., Adcock, A. B., Erlandson, B. E., Gosper, M., Greiff, S., & Pirnay-Dummer, P. (2014). Challenges for education in a connected world: Digital learning, data rich environments, and computerbased assessment—Introduction to the inaugural special issue of technology, knowledge and learning. Technology, Knowledge and Learning, 19(1), 121–126.Google Scholar
- Ifenthaler, D., & Widanapathirana, C. (2014). Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning, 19(1–2), 221–240.Google Scholar
- Kelly, N., Thompson, K., & Yeoman, P. (2015). Theory-led design of instruments and representations in learning analytics: Developing a novel tool for orchestration of online collaborative learning. Journal of Learning Analytics, 2(2), 14–43.Google Scholar
- Lin, C.-F., Yeh, Y., Hung, Y. H., & Chang, R. (2013). Data mining for providing a personalized learning path in creativity: An application of decision trees. Computers & Education, 68, 199–210.Google Scholar
- Loh, C. S., Sheng, Y., & Ifenthaler, D. (2015). Serious games analytics: Theoretical framework (pp. 3–29). Berlin: Springer.Google Scholar
- Mah, D.-K. (2016). Learning analytics and digital badges: Potential impact on student retention in higher education. Technology, Knowledge and Learning, 21(2), 285–305.Google Scholar
- Mak, H. W. (2013). The gamification of college lectures at the University of Michigan. Retrieved from http://www.gamification.co/2013/02/08/the-gamification-of-college-lectures-at-the-university-of-michigan/.
- Manouselis, N., Drachsler, H., Vuorikari, R., Hummel, H., & Koper, R. (2010). Recommender systems in technology enhanced learning. In P. B. Kantor, F. Ricci, L. Rokach, & B. Shapira (Eds.), Recommender systems handbook (pp. 387–415). Berlin: Springer.Google Scholar
- Nour, M., Abed, E., & Hegazi, N. (1995). A proposed student model algorithm for an intelligent tutoring system. In Proceedings of the 34th SICE annual conference. International session papers (pp. 1327–1333), Hokkaido.Google Scholar
- Papamitsiou, Z., & Economides, A. (2014). Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence. Journal of Educational Technology & Society, 17(4), 49–64.Google Scholar
- Pardo, A., & Kloos, C. D. (2011). Stepping out of the box: Towards analytics outside the learning management system. In Proceedings of the 1st international conference on learning analytics and knowledge (pp. 163–167). New York, NY: ACM Press.Google Scholar
- Roberts, L. D., Howell, J. A., & Seaman, K. (2017). Give me a customizable dashboard: Personalized learning analytics dashboards in higher education. Technology, Knowledge, and Learning, 22(3), 317–333.Google Scholar
- Romero, C., Ventura, S. Espejo, P. G., & Hervs, C. (2008). Data mining algorithms to classify students. In R. de Baker, T. Barnes, & J. Beck (Eds.), Proceedings of the 1st international conference on educational data mining (pp. 8–17). Retrieved from http://www.educationaldatamining.org/EDM2008/-uploads/proc/1_Romero_3.pdf.
- Romero-Zaldivar, V.-A., Pardo, A., Burgos, D., & Kloos, C. D. (2012). Monitoring student progress using virtual appliances: A case study. Computers & Education, 58(4), 1058–1067.Google Scholar
- Scheffel, M., Drachsler, H., Stoyanov, S., & Specht, M. (2014). Quality indicators for learning analytics. Journal of Educational Technology & Society, 17(4), 117–132.Google Scholar
- Schreurs, B., De Laat, M., Teplovs, C., & Voogd, S. (2014). Social learning analytics applied in a MOOC-environment. e-Learning Papers, 26, 45–48.Google Scholar
- Seufert, S., Preisig, L., Krapf, J., & Meier, C. (2017). Von Gamification zum systematischen Motivationsdesign mit kollaborativen und spielerischen Gestaltungselementen. Konzeption und Anwendungsbeispiele (scil Arbeitsberichte No. 27). St.Gallen: Institut für Wirtschaftspädagogik/scil.Google Scholar
- Siemens, G., Gasevic, D., Haythornthwaite, C., Dawson, S., Shum, S. B., Ferguson, R., et al. (2011, July 28). Open learning analytics: An integrated & modularized platform.Google Scholar
- Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning Analytics in a data-rich context. Computers in Human Behavior, 47, 157–167.Google Scholar
- Verbert, K., Manouselis, N., Drachsler, H., & Duval, E. (2012). Dataset-driven research to support learning and knowledge analytics. Educational Technology & Society, 15(3), 133–148.Google Scholar
- West, D., Heath, D., & Huijser, H. (2015). Let’s talk learning analytics: A framework for implementation in relation to student retention. Online Learning, 20(2), 12. Retrieved from https://olj.onlinelearningconsortium.org/index.php/olj/article/viewFile/792/202.
- Wise, A. F., Vytasek, J. M., Hausknecht, S., & Zhao, Y. (2016). Developing learning analytics design knowledge in the “middle space”: The student tuning model and align design framework for learning analytics use. Online Learning, 20(2), 3. Retrieved from https://olj.onlinelearningconsortium.org/index.php/olj/article/view/783.