Abstract
This study presents how predictive analytics can be used to inform the formulation of adaptive collaborative learning groups in the context of Computer Supported Collaborative Learning considering across-spaces learning situations. During the study we have collected data from different learning spaces which depicted both individual and collaborative learning activity engagement of students in two different learning contexts (namely the classroom learning and distance learning context) and attempted to predict individual student’s future collaborative learning activity participation in a pyramid-based collaborative learning activity using supervised machine learning techniques. We conducted experimental case studies in the classroom and in distance learning settings, in which real-time predictions of student’s future collaborative learning activity participation were used to formulate adaptive collaborative learner groups. Findings of the case studies showed that the data collected from across-spaces learning scenarios is informative when predicting future collaborative learning activity participation of students hence facilitating the formulation of adaptive collaborative group configurations that adapt to the activity participation differences of students in real-time. Limitations of the proposed approach and future research direction are illustrated.
Similar content being viewed by others
Notes
References
Amarasinghe, I., Hernández-Leo, D., Jonsson, A.: Towards data-informed group formation support across learning spaces. In: International Workshop on Learning Analytics across-spaces (Cross-LAK), 7th International Conference on Learning Analytics & Knowledge (LAK’17) (2017)
Baghaei, N., Mitrovic, A., Irwin, W.: Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams. Int. J. Comput. Supported Collab. Learn. 2(2–3), 159–190 (2007)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Cen, L., Ruta, D., Powell, L., Hirsch, B., Ng, J.: Quantitative approach to collaborative learning: performance prediction, individual assessment, and group composition. Int. J. Comput. Supported Collab. Learn. 11(2), 187–225 (2016)
Coffrin, C., Corrin, L., de Barba, P., Kennedy, G.: Visualizing patterns of student engagement and performance in MOOCs. In: 4th International Conference on Learning Analytics and Knowledge, pp. 83–92 (2014)
Cukurova, M., Luckin, R., Millán, E., Mavrikis, M.: The nispi framework: analysing collaborative problem-solving from students’ physical interactions. Comput. Educ. 116, 93–109 (2018)
Dawson, S.: Study of the relationship between student communication interaction and sense of community. Internet High. Education. 9(3), 153–162 (2006)
Demetriadis, S., Karakostas, A.: Adaptive collaboration scripting: a conceptual framework and a design case study. In: International Conference on Complex, Intelligent and Software Intensive Systems, IEEE, pp. 487–492 (2008)
Demetriadis, S., Karakostas, A., Tsiatsos, T., Caballé, S., Dimitriadis, Y., Weinberger, A., Papadopoulos, P.M., Palaigeorgiou, G., Tsimpanis, C., Hodges, M.: Towards integrating conversational agents and learning analytics in moocs. In: International Conference on Emerging Internetworking, Data & Web Technologies, pp. 1061–1072, Springer (2018)
Dillenbourg, P., Tchounikine, P.: Flexibility in macro-scripts for computer-supported collaborative learning. J. Comput. Assist. Learn. 23, 1–13 (2007)
Dillenbourg, P., Zufferey, G., Alavi, H., Jermann, P., Do-Lenh, S., Bonnard, Q., Cuendet, S., Kaplan, F.: Classroom orchestration: the third circle of usability. In: CSCL2011 Proceedings, vol. 1, pp. 510–517 (2011)
Dyckhoff, A., Lukarov, V., Muslim, A., Chatti, M., Schroeder, U.: Supporting action research with learning analytics. In: 3rd International Conference on Learning Analytics and Knowledge, pp. 220–229 (2013)
Ellis, R.A., Goodyear, P.: Spaces of Teaching and Learning: Integrating Perspectives on Research and Practice. Springer, New York (2018)
Fall, R., Webb, N.M., Chudowsky, N.: Group discussion and large-scale language arts assessment: effects on students’ comprehension. Am. Educ. Res. J. 37(4), 911–941 (2000)
Ferguson, R.: Learning analytics: drivers, developments and challenges. Int. J. Technol. Enhanc. Learn. 4(5–6), 304–317 (2012)
Goode, W., Caicedo, G.: Online collaboration: individual involvement used to predict team performance. In: Zaphiris, P., Ioannou, A. (eds.) International Conference on Learning and Collaboration Technologies, pp. 408–416. Springer, New York (2014)
Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pp. 516–517, ACM (2016)
Hagan, M.T., Demuth, H.B., Beale, M.H., De Jess, O.: Neural Network Design, vol. 20. PWS Pub, Boston (1996)
Hernández-Leo, D., Nieves, R., Arroyo, E., Rosales, A., Melero Gallardo, J., Blat, J.: SOS: orchestrating collaborative activities across digital and physical spaces using wearable signaling devices. J. Univers. Comput. Sci. 18(15), 2165–2186 (2012)
Karakostas, A., Demetriadis, S.: Enhancing collaborative learning through dynamic forms of support: the impact of an adaptive domain-specific support strategy. J. Comput. Assist. Learn. 27(3), 243–258 (2011)
Kloos, C.D., Hernández-Leo, D., Asensio-Pérez, J.I.: Technology for learning across physical and virtual spaces: J. UCS special issue. J. Univers. Comput. Sci. 18(15), 2093–2096 (2012)
Kobbe, L., Weinberger, A., Dillenbourg, P., Harrer, A., Hämäläinen, R., Häkkinen, P., Fischer, F.: Specifying computer-supported collaboration scripts. Int. J. Comput. Supported Collab. Learn. 2(2–3), 211–224 (2007)
Kollar, I., Fischer, F., Hesse, F.W.: Collaboration scripts-a conceptual analysis. Educ. Psychol. Rev. 18(2), 159–185 (2006)
Kotsiantis, S.B., Zaharakis, I., Pintelas, P.: Supervised machine learning: a review of classification techniques. Emerg. Artif. Intellig. Appl. Comput. Eng. 160, 3–24 (2007)
Kumar, R., Rosé, C.P., Wang, Y.C., Joshi, M., Robinson, A.: Tutorial dialogue as adaptive collaborative learning support. In: Luckin, R., Kenneth, R., Greer, Jim E. (eds.) International Conference on Artificial Intelligence in Education, pp. 383–390. IOS Press, Amsterdam (2007)
Liaw, S., Huang, H.: Enhancing interactivity in web-based instruction: a review of the literature. Educ. Technol. 40(3), 41–45 (2000)
Lykourentzou, I., Giannoukos, I., Nikolopoulos, V., Mpardis, G., Loumos, V.: Dropout prediction in e-learning courses through the combination of machine learning techniques. Comput. Educ. 53(3), 950–965 (2009)
Manathunga, K., Hernández-Leo, D.: Authoring and enactment of mobile pyramid-based collaborative learning activities. Br. J. Educ. Technol. 49(2), 262–275 (2018)
Martinez-Maldonado, R., Yacef, K., Kay, J.: Data mining in the classroom: discovering groups’ strategies at a multi-tabletop environment. In: International Conference on Educational Data Mining, pp. 121–128 (2013)
Martinez-Maldonado, R., Pardo, A., Hernández-Leo, D.: Introduction to cross LAK 2016: Learning analytics across spaces. In: First International Workshop on Learning Analytics Across Physical and Digital Spaces co-located with 6th International Conference on Learning Analytics & Knowledge (LAK 2016), CEUR (2016)
Martinez-Maldonado, R., Hernandez-Leo, D., Pardo, A., Ogata, H.: 2nd cross-LAK: learning analytics across physical and digital spaces. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 510–511, ACM (2017)
McNely, B.J., Gestwicki, P., Hill, J.H., Parli-Horne, P., Johnson, E.: Learning analytics for collaborative writing: a prototype and case study. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 222–225, ACM (2012)
Moreno, J., Ovalle, D.A., Vicari, R.M.: A genetic algorithm approach for group formation in collaborative learning considering multiple student characteristics. Comput. Educ. 58(1), 560–569 (2012)
Northrup, P.: A framework for designing interactivity into web-based instruction. Educ. Technol. 41(2), 31–39 (2001)
Nyce, C., Cpcu, A.: Predictive Analytics White Paper, pp. 9–10. American Institute for CPCU Insurance Institute of America, Malvern (2007)
Olsen, J.K., Aleven, V., Rummel, N.: Predicting student performance in a collaborative learning environment. In: International Conference on Educational Data Mining, ERIC, pp. 211–217 (2015)
Prieto, L.P., Martínez-Maldonado, R., Spikol, D., Hernández-Leo, D., Rodríguez-Triana, M.J., Ochoa, X.: Joint proceedings of the sixth multimodal learning analytics (MMLA) workshop and the second cross-LAK workshop. In: CEUR Workshop Proceedings (2017)
Prieto, L.P., Sharma, K., Kidzinski, Ł., Dillenbourg, P.: Orchestration load indicators and patterns: in-the-wild studies using mobile eye-tracking. IEEE Trans. Learn. Technol. 11(2), 216–229 (2018)
Rafferty, A., Davenport, J., Brunskill, E.: Estimating student knowledge from paired interaction data. In: International Conference on Educational Data Mining, pp. 260–263 (2013)
Roschelle, J., Teasley, S.D.: The construction of shared knowledge in collaborative problem solving. In: O’Malley, C.E. (ed.) Computer Supported Collaborative Learning, pp. 69–97. Springer, New York (1995)
Rummel, N., Spada, H.: Can people learn computer-mediated collaboration by following a script? In: Fischer, F., Kollar, I., Mandl, H., Haake, J.M. (eds.) Scripting Computer-Supported Collaborative Learning, pp. 39–55. Springer, Boston (2007)
Rummel, N., Weinberger, A., Wecker, C., Fischer, F., Meier, A., Voyiatzaki, E., Kahrimanis, G., Spada, H., Avouris, N., Walker, E., et al.: New challenges in CSCL: towards adaptive script support. In: Proceedings of the 8th International Conference on International Conference for the Learning Sciences, vol. 3, pp. 338–345. International Society of the Learning Sciences (2008)
Sanz-Martínez, L., Martínez-Monés, A., Bote-Lorenzo, M.L., Muñoz-Cristóbal, J.A., Dimitriadis, Y.: Automatic group formation in a MOOC based on students’ activity criteria. In: European Conference on Technology Enhanced Learning, Springer, pp. 179–193 (2017)
Soller, A.: Computational modeling and analysis of knowledge sharing in collaborative distance learning. User Model. User Adapt. Interact. 14(4), 351–381 (2004)
Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. J. Comput. Assist. Learn. 34(4), 366–377 (2018)
Spoelstra, H., Van Rosmalen, P., Houtmans, T., Sloep, P.: Team formation instruments to enhance learner interactions in open learning environments. Comput. Hum. Behav. 45, 11–20 (2015)
Stahl, G., Koschmann, T., Suthers, D.: Computer-supported collaborative learning: an historical perspective. In: Sawyer, R.K. (ed.) Cambridge Handbook of the Learning Sciences, vol. 2006, pp. 409–426. Cambridge University Press, Cambridge (2006)
Taylor, C., Veeramachaneni, K., O’Reilly, U.M.: Likely to stop? Predicting stopout in massive open online courses. arXiv preprint arXiv:1408.3382 (2014)
Tissenbaum, M., Slotta, J.D.: Scripting and orchestration of learning across contexts: a role for intelligent agents and data mining. In: Wong, L.H., Milrad, M., Specht, M. (eds.) Seamless Learning in the Age of Mobile Connectivity, pp. 223–257. Springer, Singapore (2015)
Tsovaltzi, D., Judele, R., Puhl, T., Weinberger, A.: Scripts, individual preparation and group awareness support in the service of learning in facebook: how does CSCL compare to social networking sites? Comput. Hum. Behav. 53, 577–592 (2015)
Vapnik, V.: The Nature of Statistical Learning Theory. Springer-Verlag, New York (2013)
Villasclaras-Fernández, E.D., Hernández-Gonzalo, J.A., Hernández Leo, D., Asensio-Pérez, J.I., Dimitriadis, Y., Martínez-Monés, A.: Instancecollage: a tool for the particularization of collaborative IMS-LD scripts. J. Educ. Technol. Soc. 12(4), 56–70 (2009)
Walker, E., Rummel, N., Koedinger, K.R.: CTRL: a research framework for providing adaptive collaborative learning support. User Model. User Adapt. Interact. 19(5), 387–431 (2009)
Walker, E., Rummel, N., Koedinger, K.R.: Adaptive intelligent support to improve peer tutoring in algebra. Int. J. Artif. Intell. Educ. 24(1), 33–61 (2014)
Waller, M.A., Fawcett, S.E.: Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. J. Bus. Logist. 34(2), 77–84 (2013)
Weinberger, A., Stegmann, K., Fischer, F., Mandl, H.: Scripting argumentative knowledge construction in computer-supported learning environments. In: Fischer, F., Kollar, I., Mandl, H., Haake, J.M. (eds.) Scripting Computer-Supported Collaborative Learning, pp. 191–211. Springer, Boston (2007)
Xing, W., Guo, R., Petakovic, E., Goggins, S.: Participation-based student final performance prediction model through interpretable genetic programming: integrating learning analytics, educational data mining and theory. Comput. Hum. Behav. 47, 168–181 (2015)
Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: Proceedings of the 20th International Conference on Machine Learning (ICML-03), pp. 856–863 (2003)
Acknowledgements
This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R and “la Caixa Foundation” (CoT project, 100010434). DHL is a Serra Húnter Fellow.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This paper or a similar version is not currently under review by a journal or conference. This paper is void of plagiarism or self-plagiarism as defined by the Committee on Publication Ethics and Springer Guidelines.
Rights and permissions
About this article
Cite this article
Amarasinghe, I., Hernández-Leo, D. & Jonsson, A. Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations. User Model User-Adap Inter 29, 869–892 (2019). https://doi.org/10.1007/s11257-019-09233-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11257-019-09233-8