Advertisement

Computer Assisted, Formative Assessment and Dispositional Learning Analytics in Learning Mathematics and Statistics

  • Dirk T. Tempelaar
  • Bart Rienties
  • Bas Giesbers
Part of the Communications in Computer and Information Science book series (CCIS, volume 439)

Abstract

Learning analytics seeks to enhance the learning process through systematic measurements of learning related data and to provide informative feedback to learners and teachers, so as to support the regulation of the learning. Track data from technology enhanced learning systems constitute the main data source for learning analytics. This empirical contribution provides an application of Buckingham Shum and Deakin Crick’s theoretical framework of dispositional learning analytics [1]: an infrastructure that combines learning dispositions data with data extracted from computer assisted, formative assessments. In a large introductory quantitative methods module based on the principles of blended learning, combining face-to-face problem-based learning sessions with e-tutorials, we investigate the predictive power of learning dispositions, outcomes of continuous formative assessments and other system generated data in modeling student performance and their potential to generate informative feedback. Using a dynamic, longitudinal perspective, Computer Assisted Formative Assessments seem to be the best predictor for detecting underperforming students and academic performance, while basic LMS data did not substantially predict learning.

Keywords

blended learning computer assisted assessment dispositional learning analytics e-tutorials formative assessment learning dispositions student profiles 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Buckingham Shum, S., Deakin Crick, R.: Learning Dispositions and Transferable Competencies: Pedagogy, Modelling and Learning Analytics. In: Proceedings LAK 2012: 2nd International Conference on Learning Analytics & Knowledge, pp. 92–101. ACM Press, New York (2012)Google Scholar
  2. 2.
    LASI Dispositional Learning Analytics Workshop (2013), Learningemergence.net/events/lasi-dla.wkshp
  3. 3.
    Buckingham Shum, S., Ferguson, R.: Social Learning Analytics. Journal of Educational Technology & Society 15(3) (2012)Google Scholar
  4. 4.
    Greller, W., Drachsler, H.: Translating Learning into Numbers: A Generic Framework for Learning Analytics. Journal of Educational Technology & Society 15(3) (2012)Google Scholar
  5. 5.
    Macfadyen, L.P., Dawson, S.: Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education 54(2), 588–599 (2010)CrossRefGoogle Scholar
  6. 6.
    Narciss, S.: Feedback strategies for interactive learning tasks. In: Spector, J.M., Merrill, M.D., van Merrienboer, J.J.G., Driscoll, M.P. (eds.) Handbook of Research on Educational Communications and Technology, 3rd edn., pp. 125–144. Lawrence Erlbaum Associates, Mahaw (2008)Google Scholar
  7. 7.
    Narciss, S., Huth, K.: Fostering achievement and motivation with bug-related tutoring feedback in a computer-based training on written subtraction. Learning and Instruction 16, 310–322 (2006)CrossRefGoogle Scholar
  8. 8.
    Tempelaar, D.T., Cuypers, H., Van de Vrie, E.M., Heck, A., Van der Kooij, H.: Formative Assessment and Learning Analytics. In: Proceedings LAK 2013: 3rd International Conference on Learning Analytics & Knowledge, pp. 205–209. ACM Press, New York (2013)Google Scholar
  9. 9.
    Birenbaum, M.: New insights into learning and teaching and their implications for assessment. In: Segers, M., Dochy, F., Cascallar (eds.) Optimizing New Modes of Assessment; in Search of Qualities and Standards, vol. 1, pp. 13–37. Kluwer Academic Publishers, Dordrecht (2003)CrossRefGoogle Scholar
  10. 10.
    Wyatt-Smith, C., Klenowski, V., Colbert, P.: Assessment Understood as Enabling. In: Wyatt-Smith, C., Klenowski, V., Colbert, P. (eds.) Designing Assessment for Quality Learning, vol. 1, pp. 1–20. Springer, Netherlands (2014)CrossRefGoogle Scholar
  11. 11.
    Shute, V., Kim, Y.: Formative and Stealth Assessment. In: Spector, J.M., Merrill, M.D., Elen, J., Bishop, M.J. (eds.) Handbook of Research on Educational Communications and Technology, 4th edn., pp. 311–321. Springer, New York (2014)CrossRefGoogle Scholar
  12. 12.
    Verbert, K., Manouselis, N., Drachsler, H., Duval, E.: Dataset-Driven Research to Support Learning and Knowledge Analytics. Educational Technology & Society 15(3), 133–148 (2012)Google Scholar
  13. 13.
    Wolff, A., Zdrahal, Z., Nikolov, A., Pantucek, M.: Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment. In: Proceedings LAK 2013: 3rd International Conference on Learning Analytics & Knowledge, pp. 145–149. ACM Press, New York (2013)Google Scholar
  14. 14.
    Loyens, S.M.M., Kirschner, P.A., Paas, F.: Problem-based learning. In: Harris, K.R., Graham, S., Urdan, T., Bus, A.G., Major, S., Swanson, H. (eds.) APA Educational Psychology Handbook: Application to Learning and Teaching, vol. 3, pp. 403–425. American Psychological Association, Washington, D.C (2011)Google Scholar
  15. 15.
    Vermunt, J.D.: Leerstijlen en sturen van leerprocessen in het Hoger Onderwijs. Swets & Zeitlinger, Amsterdam/Lisse (1996)Google Scholar
  16. 16.
    Vermunt, J.D., Vermetten, Y.: Patterns in Student Learning: Relationships between Learning Strategies, Conceptions of Learning, and Learning Orientations. Educational Psychology Review 16, 359–385 (2004)CrossRefGoogle Scholar
  17. 17.
    Martin, A.J.: Examining a multidimensional model of student motivation and engagement using a construct validation approach. British Journal of Educational Psychology 77, 413–440 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Dirk T. Tempelaar
    • 1
  • Bart Rienties
    • 2
  • Bas Giesbers
    • 3
  1. 1.School of Business and EconomicsMaastricht UniversityThe Netherlands
  2. 2.Institute of Educational TechnologyOpen University UKMilton KeynesUK
  3. 3.Rotterdam School of ManagementErasmus UniversiteitRotterdamThe Netherlands

Personalised recommendations