Skip to main content
SpringerLink
Log in

Activity sequence modelling and dynamic clustering for personalized e-learning

  • Original Paper
  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Monitoring and interpreting sequential learner activities has the potential to improve adaptivity and personalization within educational environments. We present an approach based on the modeling of learners’ problem solving activity sequences, and on the use of the models in targeted, and ultimately automated clustering, resulting in the discovery of new, semantically meaningful information about the learners. The approach is applicable at different levels: to detect pre-defined, well-established problem solving styles, to identify problem solving styles by analyzing learner behaviour along known learning dimensions, and to semi-automatically discover learning dimensions and concrete problem solving patterns. This article describes the approach itself, demonstrates the feasibility of applying it on real-world data, and discusses aspects of the approach that can be adjusted for different learning contexts. Finally, we address the incorporation of the proposed approach in the adaptation cycle, from data acquisition to adaptive system interventions in the interaction process.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aleven V., Stahl E., Schworm S., Fischer F., Wallace R.: Help seeking and help design in interactive learning environments. Rev. Educ. Res. 73(3), 277–320 (2003)

    Article  Google Scholar 

  • Aleven V., McLaren B., Roll I., Koedinger K.: Toward meta-cognitive tutoring: a model of help seeking with a cognitive tutor. Int. J. Artif. Intell. Educ. 16(2), 101–128 (2006)

    Google Scholar 

  • Alfonseca E., Carro R.M., Martín E., Ortigosa A., Paredes P.: The impact of learning styles on student grouping for collaborative learning: a case Study. User Model. User-Adapt. Interact. 16(3–4), 377–401 (2006)

    Article  Google Scholar 

  • Amershi S., Conati C.: Automatic recognition of learner groups in exploratory learning environments. In: Ikeda, M., Ashley, K., Chan, T.-W. (eds) Intelligent Tutoring Systems, vol. 4053 of Lecture Notes in Computer Science, pp. 463–472. Springer, Berlin (2006)

    Google Scholar 

  • Amershi S., Conati C.: Combining Unsupervised and Supervised Classification to Build User Models for Exploratory Learning Environments. J. Educ. Data Min. 1(1), 18–71 (2009)

    Google Scholar 

  • Anaya, A.R., Boticario, J.G.: Clustering learners according to their collaboration. In: Proceedings of the 2009 13th International Conference on Computer Supported Cooperative Work in Design, pp. 540–545, (2009a)

  • Anaya, A.R., Boticario, J.G.: A data mining approach to reveal representative collaboration indicators in open collaboration frameworks. In: Proceedings of the 2nd International Conference on Educational Data Mining (EDM09), pp. 210–219, (2009b)

  • Anaya, A.R., Boticario, J.G.: Content-free collaborative learning modeling using data mining. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011)

  • Anderson S., Messick S.: Social competency in young children. Dev. Psychol. 10(2), 282–293 (1974)

    Article  Google Scholar 

  • Baker R.S.: Data mining for education. In: McGaw, B., Baker, E., Peterson, P. (eds) International Encyclopedia of Education, vol. 7, 3rd edn, pp. 112–118. Elsevier, Oxford (2010)

    Chapter  Google Scholar 

  • Baker R.S., Yacef K.: The state of educational data mining in 2009: a review and future visions. J. Educ. Data Min. 1(1), 3–17 (2009)

    Google Scholar 

  • Baker, R.S., Corbett, A.T., Koedinger, K.R., Evenson, S., Roll, I., Wagner, A.Z., Naim, M., Raspat, J., Baker, D.J., Beck, J.E.: Adapting to when students game an intelligent tutoring system. In: Intelligent Tutoring Systems, vol. 4953/2006 of Lecture Notes in Computer Science, pp. 392–401. Springer, Berlin (2006)

  • Baker R.S., Corbett A.T., Roll I., Koedinger K.R.: Developing a generalizable detector of when students game the system. User Model. User-Adapt. Interact. 18(3), 287–314 (2008)

    Article  Google Scholar 

  • Bakiri G., Dietterich T.G.: Constructing high-accuracy letter-to-phoneme rules with machine learning. In: Damper, R. (eds) Data-Driven Techniques in Speech Synthesis, pp. 27–44. Kluwer, Boston (2001)

    Google Scholar 

  • Ballone L.M., Czerniak C.M.: Teachers’ beliefs about accommodating students’ learning styles in science classes. Electron. J. Sci. Educ. 6(2), 1–40 (2001)

    Google Scholar 

  • Beal, C., Qu, L., Lee, H.: Classifying learner engagement through integration of multiple data sources. In: Proceedings of the 21st International Conference on Artificial Intelligence, pp. 151–156, (2006)

  • Beal, C., Mitra, S., Cohen, P.: Modeling learning patterns of students with a tutoring system using hidden Markov models. In: Proceedings of the 13th International Conference on Artificial Intelligence in Education (AIED), pp. 238–245, (2007)

  • Ben-Ari M.: Constructivism in computer science education. ACM SIGCSE Bull. 30(1), 257–261 (1998)

    Article  Google Scholar 

  • Bengio Y., Frasconi P.: Input–output HMMs for sequence processing. IEEE Trans. Neural Netw. 7(5), 1231–1249 (1996)

    Article  Google Scholar 

  • Black, P.E.: “Euclidean Distance” in Dictionary of Algorithms and Data Structures. U.S. National Institute of Standards and Technology (2004). http://www.itl.nist.gov/div897/sqg/dads/HTML/euclidndstnc.html . Accessed Feb 2010

  • Borek, A., McLaren, B.M., Karabinos, M., Yaron, D.: How much assistance is helpful to students in discovery learning?. In: Learning in the Synergy of Multiple Disciplines, vol. 5794/2009 of Lecture Notes in Computer Science, pp. 391–404, (2009)

  • Bottou, L., LeCun, Y.: Graph transformer networks for image recognition. In: Bulletin of the 55th Biennial Session of the International Statistical Institute (ISI), (2005). http://leon.bottou.org/papers/bottou-lecun-2005

  • Bottou, L., Bengio, Y., Le Cun, Y.: Global training of document processing systems using graph transformer networks. In: Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 489–494, (1997)

  • Brown, E., Fisher, T., Brailsford, T.: Real users, real results: examining the limitations of learning styles within AEH. In: Proceedings of the 18th Conference on Hypertext and Hypermedia, pp. 57–66, (2007)

  • Brusilovsky, P., Chavan, G., Farzan, R.: Social adaptive navigation support for open corpus electronic textbooks. In: Proceedings of the Third International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 24–33, (2004)

  • Butler T.J., Pinto-Zipp G.: Students’ learning styles and their preferences for online instructional methods. J. Educ. Technol. Syst. 34(2), 199–221 (2006)

    Article  Google Scholar 

  • Carro R., Ortigosa A., Schlichter J.: Adaptive collaborative web-based courses. In: Lovelle, J., Rodrguez, B., Gayo, J., del Puerto Paule Ruiz, M., Aguilar, L. (eds) Web Engineering, vol. 2722 of Lecture Notes in Computer Science, pp. 130–133. Springer, Berlin (2003a)

    Google Scholar 

  • Carro R.M., Ortigosa A., Martn E., Schlichter J.: Dynamic Generation of Adaptive Web-Based Collaborative Courses, vol. 2806 of Lecture Notes in Computer Science, pp. 191–198. Springer, Berlin (2003b)

    Google Scholar 

  • Cassidy S.: Learning styles: an overview of theories, models and measures. Educ. Psychol. 24(4), 419–444 (2004)

    Article  MathSciNet  Google Scholar 

  • Choi, H., Kang, M.: Analyzing learner behaviours, conflicting and facilitating factors of online collaborative learning using activity system. In: Proceedings of the 2008 International Conference on Learning Sciences, (2008). http://www.fi.uu.nl/en/icls2008/318/paper318.pdf

  • Dewar T., Whittington D.: Online learners and their learning strategies. J. Educ. Comput. Res. 23(4), 385–403 (2000)

    Google Scholar 

  • Dietterich, T.G.: Machine learning for sequential data: a review. In: Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Computer Science, pp. 227–246. Springer, Berlin (2009)

  • Dillenbourg P., Baker M., Blaye A., O’Malley C.: The evolution of research on collaborative learning. In: Spada, E., Reiman, P. (eds) Learning in Humans and Machine: Towards an Interdisciplinary Learning Science, pp. 189–211. Elsevier, Oxford (1996)

    Google Scholar 

  • Fawcett T., Provost F.: Adaptive Fraud detection. Data Min. Knowl. Discov. 1(3), 291–316 (1997)

    Article  Google Scholar 

  • Felder R.M., Brent R.: Understanding student differences. J. Eng. Educ. 94(1), 57–72 (2005)

    Google Scholar 

  • Felder R.M., Silverman L.K.: Learning and teaching styles in engineering education. J. Eng. Educ. 78(7), 674–681 (1988)

    Google Scholar 

  • Hall M., Eibe F., Holmes G., Pfahringer B., Reutemann P., Witten I.H.: The WEKA data mining software: an update. SIGKDD Explor. 11(1), 10–18 (2009)

    Article  Google Scholar 

  • Hämäläinen, W., Suhonen, J., Sutinen, E., Toivonen, H.: Data mining in personalizing distance education courses. In: Proceedings of the 21st ICDE World Conference on Open Learning and Distance Education, pp. 18–21, (2004)

  • Jain A., Murty M., Flynn P.: Data clustering: a review. ACM Comput. Surv. 31(3), 264–323 (1999)

    Article  Google Scholar 

  • Jarvis M.: The Psychology of Effective Learning and Teaching. Nelson Thornes, Cheltenham (2005)

    Google Scholar 

  • Jeong, H., Biswas, G.: Mining student behaviour models in learning-by-teaching environments. In: Proceedings of the 1st International Conference on Educational Data Mining, pp. 127–136, (2008)

  • Kanninen, E.: Learning styles and e-learning. Master’s thesis, Tampere University of Technology (2008)

  • Köck, M.: Towards intelligent adaptive e-learning systems—machine learning for learner activity classification. In: Proceedings of the 17th Workshop on Adaptivity and User Modeling in Interactive Systems (ABIS 09), pp. 26–31, (2009)

  • Koedinger K.R., Aleven V.: Exploring the assistance dilemma in experiments with cognitive tutors. Educ. Psychol. Rev. 19(3), 239–264 (2007)

    Article  Google Scholar 

  • Koedinger, K., Cunningham, K., Skogsholm, A., Leber, B.: An open repository and analysis tool for fine-grained, longitudinal learner data. In: Proceedings of Educational Data Mining 2008: 1st International Conference on Educational Data Mining, pp. 157–166, (2008)

  • Koedinger K., Baker R., Cunningham K., Skogsholm A., Leber B., Stamper J.: A data repository for the EDM community: the PSLC datashop. In: Romero, C., Ventura, S., Pechenizkiy, M., Baker, R.S. (eds) Handbook of Educational Data Mining, CRC Press, Boca Raton (2010)

  • Kolb D.A.: Experiential Learning. Prentice Hall, Englewood Cliffs (1984)

    Google Scholar 

  • Lafferty, J.D., McCallum, A., Pereira, F.C.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 282–289, (2001)

  • Lefrancois G.R.: Psychologie des Lernens, vol. 4. Springer, Heidelberg (2006)

    Google Scholar 

  • Li, C., Yoo, J.: Modeling student online learning using clustering. In: ACM-SE 44: Proceedings of the 44th Annual Southeast Regional Conference, pp. 186–191. ACM, Melbourne (2006)

  • Li J., Zaïane, O.R.: Combining usage, content, and structure data to improve web site recommendation. In: Proceedings of the 5th International Conference on Electronic Commerce and Web Technologies (EC-Web), pp. 305–315, (2004)

  • Lichtenwalter, R., Lichtenwalter, K., Chawla, N.V.: Applying learning algorithms to music generation. In: Proceedings of the 4th Indian International Conference on Artificial Intelligence (IICAI 2009), pp. 483–502, (2009)

  • Liu, Y., Dean, G.: Cognitive styles and distance education. J. Distance Learn. Admin. 2(3), (1999). http://www.westga.edu/~distance/liu23.html

  • Liu, S., Joy, M., Griffiths, N.: Incorporating learning styles in a computer-supported collaborative learning model. In: Proceedings of the International Workshop on Cognitive Aspects in Intelligent Adaptive Web-Based Education Systems (CIAWES 2008), pp. 3–10, (2008)

  • LRN: LRN, 2010. www.dotlrn.org

  • Martínez A.M., Kak A.C.: PCA versus LDA. IEEE Trans. Knowl. Data Eng. 23(2), 228–233 (2001)

    Google Scholar 

  • McCallum, A., Freitag, D., Pereira, F.C.: Maximum entropy Markov models for information extraction and segmentation. In: Proceedings of the Seventeenth International Conference on Machine Learning, pp. 591–598, (2000)

  • Moodle: Moodle.org: Open-source community-based tools for learning, (2010). www.moodle.org

  • Muldner, K., Burleson, W., Van e Sande, B., VanLehn, K.: An analysis of studentsć6 gaming behaviors in an intelligent tutoring system: predictors and impacts. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011)

  • Nelson-Le Gall S.: Help-seeking: an understudied problem-solving skill in children. Dev. Rev. 1(3), 224–246 (1981)

    Article  Google Scholar 

  • Nelson-Le Gall S.: Help Seeking behaviour in learning. Rev. Res. Educ. 12(1), 55–90 (1985)

    Article  Google Scholar 

  • Newman R.: Adaptive help seeking: a strategy of self-regulated learning. In: Schunk, D., Zimmermann, B. (eds) Self-Regulation of Learning and Performance: Issues and Educational Applications, pp. 283–301. Erlbaum, Hillsdale, NY (1994)

    Google Scholar 

  • Paramythis, A.: Adaptive support for collaborative learning with ims learning design: are we there yet? In: Proceedings of the Workshop on Adaptive Collaboration Support, in Conjunction with the 5th International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH’08), pp.~17–29, (2008)

  • Perera D., Kay J., Koprinska I., Yacef K., Zaïne O.R.: Clustering and sequential pattern mining of online collaborative learning data. IEEE Trans. Knowl. Data Eng. 21(6), 759–772 (2009)

    Article  Google Scholar 

  • Piaget J.: The Construction of Reality in the Child. Basic Books, New York (1954)

    Book  Google Scholar 

  • Qian N., Sejnowski T.J.: Predicting the secondary structure of globular proteins using neural network models. J. Mol. Biol. 202(4), 865–884 (1988)

    Article  Google Scholar 

  • Quignard, M., Baker, M.: Favouring modellable computer-mediated argumentative dialogue in collaborative problem-solving situtations. In: Proceedings of the 9th International Conference on Artificial Intelligence in Education, pp. 129–136, (1999)

  • Rabiner L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. In: Waibel, A., Lee, K.-F. (eds) Readings in Speech Recognition, pp. 267–296. Morgan Kaufmann Publishers Inc, San Francisco (1990)

    Google Scholar 

  • Razzaq, L.M., Heffernan, N.T.: To tutor or not to tutor: that is the question. In: Proceedings of the 2009 Artificial Intelligence in Education Conference, pp. 457–464, (2009)

  • Richmond A.S., Cummings R.: Implementing Kolb’s learning styles into online distance education. Int. J. Technol. Teach. Learn. 1(1), 45–54 (2005)

    Google Scholar 

  • Romero, C., Ventura, S. (eds): Data Mining in E-Learning, vol. 4 of Advances in Management Information. WITPress.com, Wessex (2006)

    Google Scholar 

  • Romero C., Ventura S.: Educational data mining: a review of the state-of-the-art. IEEE Trans. Syst. Man Cybernet. C Appl. Rev. 40(6), 601–618 (2010)

    Article  Google Scholar 

  • Romero C., Ventura S., García E.: Data mining in course management systems: moodle case study and tutorial. Comput. Educ. 51(1), 368–384 (2007)

    Article  Google Scholar 

  • Romero, C., Ventura, S., Espejo, P.G., Hervás, C.: Data mining algorithms to classify students. In: Proceedings of the 1st International Conference on Educational Data Mining (EDM08), pp. 8–17, (2008)

  • Rummel N., Krämer N.: Computer-supported instructional communication: a multidisciplinary account of relevant factors. Educ. Psychol. Rev. 22(1), 1–7 (2010)

    Article  Google Scholar 

  • Ryan A., Pintrich P., Midgley C.: Avoiding seeking help in the classroom: who and why?. Educ. Psychol. Rev. 13(2), 93–114 (2001)

    Article  Google Scholar 

  • Salas E., Sims D.E., Burke C.: Is there a “Big Five” in teamwork?. Small Group Res. 36(5), 555–599 (2005)

    Article  Google Scholar 

  • Schaller, D.T., Borun, M., Allison-Bunnell, S., Chambers, M.: One size does not fit all: learning style, play, and on-line interactives. In: Proceedings of Museums and the Web 2007—the International Conference for Culture and Heritage On-Line, (2007). http://www.archimuse.com/mw2007/papers/schaller/schaller.html

  • Sejnowski T.J., Rosenberg C.R.: Parallel networks that learn to pronounce English text. J. Complex Syst. 1(1), 145–168 (1987)

    MATH  Google Scholar 

  • Seymore, K., McCallum, A., Rosenfeld, R.: Learning hidden Markov model structure for information extraction. In: Proceedings of the AAAI 99 Workshop on Machine Learning for Information Extraction pp. 37–42, (1999)

  • Shannon, C.E.: A mathematical theory of communication. In: Slepian, D. (ed.) Key Papers in the Development of Information Theory. IEEE Press, New York (1974). http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html

  • Simon, S.J.: The relationship of learning style and training method to end-user computer satisfaction and computer use: a structural equation model. Inf. Technol. Learn. Perform. J. 18(1) (2000). http://www.osra.org/itlpj/simon.PDF

  • Soller A.: Adaptive support for distributed collaboration. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds) The Adaptive Web, vol. 4321 of Lecture Notes in Computer Science, pp. 573–595. Springer, Berlin (2007)

    Google Scholar 

  • Soller A., Lesgold A.: Modeling the process of collaborative learning. In: Dillenbourg, P., Hoppe, H., Ogata, H., Soller, A. (eds) The Role of Technology in CSCL, vol. 9 of Computer-Supported Collaborative Learning, pp. 63–86. Springer, New York (2007)

    Google Scholar 

  • Soller A., Martínez A., Jermann P., Muehlenbrock M.: From mirroring to guiding: a review of state of the art technology for supporting collaborative learning. Int. J. Artif. Intell. Educ. 15(4), 261–290 (2005)

    Google Scholar 

  • Srivastava J., Cooley R., Deshpande M., Tan P.-N.: Web usage mining: discovery and applications of usage patterns from web data. SIGKDD Explor. 1(2), 12–23 (2000)

    Article  Google Scholar 

  • Su, J.-M., Tseng, S.-S., Chen, C.-H., Lin, H.-Y.: A personalized learning content adaption mechanism to meet diverse user needs in mobile learning environments. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011)

  • Terrell, S.R.: Supporting different learning styles in an online learning environment: does it really matter in the long run? J. Distance Learn. Admin. 8(2) (2005). http://www.westga.edu/~distance/ojdla/summer82/terrell82.htm

  • Thorndike E.L.: Educational Psychology. Kessinger Publishing, Whitefish (1903)

    Book  Google Scholar 

  • Vail, D.L., Veloso, M.M., Lafferty, J.D.: Conditional random fields for activity recognition. In: Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1–8, (2007)

  • VanLehn K., Lynch C., Schulze K., Shapiro J.A., Shelby R.H., Taylor L., Treacy D., Weinstein A., Wintersgill M.: The Andes physics tutoring system: lessons learned. Int. J. Artif. Intell. Educ. 15(3), 147–204 (2005)

    Google Scholar 

  • Vialardi, C., Bravo, J., Shafti, L., Ortigosa, A.: Recommendations in higher education using data mining techniques. In: Proceedings of the 2nd International Conference on Educational Data Mining (EDM09), pp. 190–199, (2009)

  • Walker E., Rummel N., Koedinger K.R.: CTRL: a research framework for providing adaptive collaborative learning support. User Model. User-Adapt. Interact. 19(5), 387–431 (2009)

    Article  Google Scholar 

  • Wayang Outpost: Wayang Outpost (2010). www.wayangoutpost.com

  • Yoo, J., Li, C., Pettey, C.: Adaptive teaching strategy for online learning. In: Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI ’05), pp. 266–268. ACM, New York (2005)

Download references

Author information

Authors and Affiliations

  1. Institute for Information Processing and Microprocessor Technology, Johannes Kepler University, 4040, Linz, Austria

    Mirjam Köck & Alexandros Paramythis

Authors
  1. Mirjam Köck
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alexandros Paramythis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mirjam Köck.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Köck, M., Paramythis, A. Activity sequence modelling and dynamic clustering for personalized e-learning. User Model User-Adap Inter 21, 51–97 (2011). https://doi.org/10.1007/s11257-010-9087-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-010-9087-z

Keywords

Search

Navigation