Encyclopedia of Education and Information Technologies

2020 Edition
| Editors: Arthur Tatnall

Multimodal Learning Analytics

  • Daniel SpikolEmail author
  • Mutlu Cukurova
Reference work entry
DOI: https://doi.org/10.1007/978-3-030-10576-1_112
  • 4 Downloads

Synonyms

Introduction

In recent years, many countries in Europe and the rest of the world have invested heavily in digital skills and connectivity, by digitalizing industries, businesses, and public services. These advancements have been made possible by the dynamic development of technology and new innovative services (Luckin et al. 2017). New data-driven technologies and services imply that individuals need to master new skills to effectively integrate the Internet of Things, big data, automation, and artificial intelligence. In the current times, in addition to the acquisition of new skills, there is increased emphasis on some of the innately human skills, such as complex problem-solving, coordinating with others, critical thinking, negotiation, creativity) (WEF 2016). While the automation of industrial, labor-intensive jobs has been an ongoing trend since the 1960s,...

This is a preview of subscription content, log in to check access.

References

  1. Barron B, Darling-Hammond L (2010) Prospects and challenges for inquiry-based approaches to learning. In: The nature of learning: using research to inspire practice, pp 199–225Google Scholar
  2. Blikstein P (2011) Using learning analytics to assess students’ behavior in open-ended programming tasks. In: Proceedings of the 1st international conference on learning analytics and knowledge – LAK ’11. ACM Press, New York, p 110. Retrieved 14 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2090116.2090132.  https://doi.org/10.1145/2090116.2090132CrossRefGoogle Scholar
  3. Blikstein P (2013) Multimodal learning analytics. In: Suthers D, Verbert K (eds) Proceedings of the third international conference on learning analytics and knowledge – LAK ’13. ACM Press, New York, p 102. Retrieved 13 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2460296.2460316.  https://doi.org/10.1145/2460296.2460316CrossRefGoogle Scholar
  4. Blikstein P, Worsley M (2016) Multimodal learning analytics and education data mining: using computational technologies to measure complex learning tasks. J Learn Anal. Retrieved 12 Oct 2016, from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/4383/5596
  5. Chen L, Feng G, Joe J, Leong CW, Kitchen C, Lee CM (2014) Towards automated assessment of public speaking skills using multimodal cues. In: Proceedings of the 16th international conference on multimodal interaction – ICMI ’14. ACM Press, New York, pp 200–203. Retrieved 15 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2663204.2663265.  https://doi.org/10.1145/2663204.2663265CrossRefGoogle Scholar
  6. Commission E (2014) Technology readiness levels [OTHER]. Retrieved 1 Oct 2017, from http://ec.europa.eu/
  7. Cress U, Hesse FW (2013) Quantitative methods for studying small groups. In: The international handbook of collaborative learning. Routledge, New York, pp 105–123Google Scholar
  8. Cukurova M, Luckin R, Millán E, Mavrikis M (2018) The NISPI framework: analysing collaborative problem-solving from students’ physical interactions. Comput Educ 116:93–109. Retrieved 23 Feb 2018, from http://linkinghub.elsevier.com/retrieve/pii/S0360131517301938.  https://doi.org/10.1016/j.compedu.2017.08.007CrossRefGoogle Scholar
  9. Deakin Crick R, Knight S, Barr S (2017) Towards analytics for wholistic school improvement: hierarchical process modelling and evidence visualization. JLA 4(2):160–188. Retrieved 23 Feb 2018, from http://www.learning-analytics.info/journals/index.php/JLA/article/view/4417.  https://doi.org/10.18608/jla.2017.42.13CrossRefGoogle Scholar
  10. Di Mitri D, Scheffel M, Drachsler H, Börner D, Ternier S, Specht M (2017) Learning pulse: a machine learning approach for predicting performance in self-regulated learning using multimodal data. In: Proceedings of the seventh international learning analytics & knowledge conference on – LAK ’17. ACM Press, New York, pp 188–197. Retrieved 23 Feb 2018, from http://dl.acm.org/citation.cfm?doid=3027385.3027447.  https://doi.org/10.1145/3027385.3027447CrossRefGoogle Scholar
  11. Echeverria V, Martinez-Maldonado R, Granda R, Chiluiza K, Conati C, Shum SB (2018) Driving data storytelling from learning design. In: Proceedings of the 8th international conference on learning analytics and knowledge – LAK ’18. ACM Press, New York, pp 131–140. Retrieved 23 Mar 2018, from http://dl.acm.org/citation.cfm?doid=3170358.3170380.  https://doi.org/10.1145/3170358.3170380CrossRefGoogle Scholar
  12. Friend Wise A, Williamson Schaffer D (2015) Why theory matters more than ever in the age of big data. JLA 2(2):5–13. Retrieved 23 Feb 2018, from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/4677.  https://doi.org/10.18608/jla.2015.22.2CrossRefGoogle Scholar
  13. Goverment H (2017) Industrial strategy: building a Britain fit for the future (Tech. Rep.). HM Goverment, London. Retrieved from https://www.gov.uk https://doi.org/10.1049/ir:19930092
  14. Grover S, Bienkowski M, Tamrakar A, Siddiquie B, Salter D, Divakaran A (2016) Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the sixth international conference on learning analytics & knowledge – LAK ’16. ACM Press, New York, pp 516–517. Retrieved 17 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2883851.2883877.  https://doi.org/10.1145/2883851.2883877CrossRefGoogle Scholar
  15. Holstein K, Hong G, Tegene M, McLaren BM, Aleven V (2018) The classroom as a dashboard: co-designing wearable cognitive augmentation for k-12 teachers. In: Proceedings of the 8th international conference on learning analytics and knowledge – LAK ’18. ACM Press, New York, pp 79–88. Retrieved 23 Mar 2018, from http://dl.acm.org/citation.cfm?doid=3170358.3170377.  https://doi.org/10.1145/3170358.3170377CrossRefGoogle Scholar
  16. Järvelä S, Kirschner PA, Hadwin A, Järvenoja H, Malmberg J, Miller M, Laru J (2016) Socially shared regulation of learning in CSCL: understanding and prompting individual- and group-level shared regulatory activities. Comput Support Learn 11(3):263–280. Retrieved 23 Feb 2018, from http://link.springer.com/10.1007/s11412-016-9238-2.  https://doi.org/10.1007/s11412-016-9238-2CrossRefGoogle Scholar
  17. Johnson AM, Azevedo R, Mello SK (2011) The temporal and dynamic nature of self-regulatory processes during independent and externally assisted hypermedia learning. Cogn Instr 29(4):471–504. Retrieved 23 Feb 2018, from http://www.tandfonline.com/doi/abs/10.1080/07370008.2011.610244.  https://doi.org/10.1080/07370008.2011.610244CrossRefGoogle Scholar
  18. Kirschner PA, Sweller J, Clark RE (2006) Why minimal guidance during instruction does not work: an analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educ Psychol 41(2):75–86. Retrieved 10 Nov 2016, from http://www.tandfonline.com/doi/abs/10.1207/s15326985ep4102_1.  https://doi.org/10.1207/s15326985ep4102_1CrossRefGoogle Scholar
  19. Kitto K, Cross S, Waters Z, Lupton M (2015) Learning analytics beyond the LMS: the connected learning analytics toolkit. In: Proceedings of the fifth international conference on learning analytics and knowledge – LAK ’15. ACM Press, New York, pp 11–15. Retrieved 23 Feb 2018, from http://dl.acm.org/citation.cfm?doid=2723576.2723627.  https://doi.org/10.1145/2723576.2723627CrossRefGoogle Scholar
  20. Kreijns K, Kirschner PA, Jochems W (2003) Identifying the pitfalls for social interaction in computer-supported collaborative learning environments: a review of the research. Comput Hum Behav 19(3):335–353. Retrieved 15 Aug 2017, from http://linkinghub.elsevier.com/retrieve/pii/S0747563202000572.  https://doi.org/10.1016/S0747-5632(02)00057-2CrossRefGoogle Scholar
  21. Luckin R, Baines E, Cukurova M, Holmes W, Mann M (2017) Solved! making the case for collaborative problem-solving. Retrieved 15 Aug 2017, from http://oro.open.ac.uk/50105/1/solved-making-case-collaborative-problem-solving.pdf
  22. Martinez-Maldonado R, Schneider B, Charleer S, Shum SB, Klerkx J, Duval E (2016) Interactive surfaces and learning analytics: data, orchestration aspects, pedagogical uses and challenges. In: Proceedings of the sixth international conference on learning analytics & knowledge – LAK ’16. ACM Press, New York, pp 124–133. Retrieved 15 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2883851.2883873.  https://doi.org/10.1145/2883851.2883873CrossRefGoogle Scholar
  23. Martinez-Maldonado R, Yacef K, dos Santos ADP, Shum SB, Echeverria V, Santos OC, Pechenizkiy M (2017) Towards proximity tracking and sensemaking for supporting teamwork and learning. In: 2017 IEEE 17th international conference on advanced learning technologies (ICALT). IEEE, pp 89–91. Retrieved 23 Feb 2018, from http://ieeexplore.ieee.org/document/8001727/.  https://doi.org/10.1109/ICALT.2017.79
  24. Martinez-Maldonado R, Echeverria V, Santos OC, Santos ADPD, Yacef K (2018) Physical learning analytics: a multimodal perspective. In: Proceedings of the 8th international conference on learning analytics and knowledge – LAK ’18. ACM Press, New York, pp 375–379. Retrieved 23 Mar 2018, from http://dl.acm.org/citation.cfm?doid=3170358.3170379.  https://doi.org/10.1145/3170358.3170379CrossRefGoogle Scholar
  25. Molenaar I (2014) Advances in temporal analysis in learning and instruction. Frontline Learn Res 2(4):15–24. Retrieved 23 Feb 2018, from https://journals.sfu.ca/flr/flr/index.php/journal/article/view/118Google Scholar
  26. Nesbit J, Zhou M, Xu Y, Winne PH (2007) Advancing log analysis of student interactions with cognitive tools. In: 12th biennial conference of the European association for research on learning and instruction. Budapest, HungaryGoogle Scholar
  27. Ochoa X, Worsley M (2016) Editorial: Augmenting learning analytics with multim. J Learn Anal 3(2):213–219Google Scholar
  28. Ochoa X, Chiluiza K, Méndez G, Luzardo G, Guamán B, Castells J (2013) Expertise estimation based on simple multimodal features. In: Proceedings of the 15th ACM on international conference on multimodal interaction – ICMI ’13. ACM Press, New York, pp 583–590. Retrieved 17 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2522848.2533789.  https://doi.org/10.1145/2522848.2533789CrossRefGoogle Scholar
  29. Ochoa X, Worsley M, Chiluiza K, Luz S (2014) MLA’14: third multimodal learning analytics workshop and grand challenges. In: Proceedings of the 16th international conference on multimodal interaction. Retrieved 15 Oct 2016, from http://dl.acm.org/citation.cfm?id=2668318
  30. OECD (2015) PISA 2015 Draft collaborative problem solving (Tech. Rep.). Retrieved from https://www.oecd.org/pisa/pisaproducts/Draft PISA2015Collaborative ProblemSolvingFramework.pdf
  31. Pijeira-Díaz HJ, Drachsler H, Järvelä S, Kirschner PA (2016) Investigating collaborative learning success with physiological coupling indices based on electrodermal activity. In: Proceedings of the sixth international conference on learning analytics & knowledge – LAK ’16. ACM Press, New York, pp 64–73). Retrieved 23 Feb 2018, from http://dl.acm.org/citation.cfm?doid=2883851.2883897.  https://doi.org/10.1145/2883851.2883897CrossRefGoogle Scholar
  32. Prieto LP, Sharma K, Dillenbourg P, Rodríguez-Triana MJ (2016) Teaching analytics: towards automatic extraction of orchestration graphs using wearable sensors. In: Proceedings of the sixth international conference on learning analytics & knowledge – LAK ’16. ACM Press, New York, pp 148–157. Retrieved 13 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2883851.2883927.  https://doi.org/10.1145/2883851.2883927CrossRefGoogle Scholar
  33. Schneider B, Blikstein P (2014) Unraveling students’interaction around a tangible interface using gesture recognition. J Educ Data Min 7(2):320–323. Retrieved 23 Feb 2018, from http://blog.bertrandschneider.com/wp-content/uploads/2012/01/23_102-844-3-CE.pdfGoogle Scholar
  34. Sclater N, Berg A, Webb M (2015) Developing an open architecture for learning analytics. In: Proceedings of the EUNIS 2015 Congress. Retrieved 23 Feb 2018, from http://www.eunis.org/eunis2015/wp-content/uploads/sites/3/2015/04/eunis2015_submission_61_P5_TRACK_1_slot_2.pdf
  35. Siemens G, Baker RSJ d (2012) Learning analytics and educational data mining: towards communication and collaboration. In: Proceedings of the 2nd international conference on learning analytics and knowledge – LAK ’12. ACM Press, New York, p 252. Retrieved 14 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2330601.2330661.  https://doi.org/10.1145/2330601.2330661CrossRefGoogle Scholar
  36. Spikol D, Ruffaldi E, Dabisias G, Mukurova M (2018) Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. J Comput Assist Learn 34:366–377CrossRefGoogle Scholar
  37. World Economic Forum (2016) The future of jobs: Employment, skills and workforce strategy for the fourth industrial revolution. In Global Challenge Insight Report, World Economic Forum, Geneva. Retrieved 23 Mar 2018, from https://www.voced.edu.au/content/ngv:71706
  38. Worsley M (2012) Multimodal learning analytics. In: Proceedings of the 14th ACM international conference on multimodal interaction - ICMI ’12. ACM Press, New York, p 353. Retrieved 14 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2388676.2388755.  https://doi.org/10.1145/2388676.2388755CrossRefGoogle Scholar
  39. Worsley M (2014) Multimodal learning analytics as a tool for bridging learning theory and complex learning behaviors. In: Proceedings of the 2014 ACM workshop on multimodal learning analytics workshop and grand challenge – MLA ’14. ACM Press, New York, pp 1–4. Retrieved 15 Oct 2016, from http://dl.acm.org/citation.cfm?doid=2666633.2666634.  https://doi.org/10.1145/2666633.2666634CrossRefGoogle Scholar
  40. Worsley M, Blikstein P (2014) Analyzing engineering design through the lens of computation. J Learn Anal 1(2):151–186CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of Computer Science and Media TechnologyMalmö UniversityMalmöSweden
  2. 2.UCL Knowledge Lab, Institute of EducationUniversity College LondonLondonUK

Section editors and affiliations

  • Jari Multisilta
    • 1
  1. 1.Satakunta University of Applied SciencesPoriFinland