Advertisement

Predicting student final performance using artificial neural networks in online learning environments

  • Şeyhmus AydoğduEmail author
Article
  • 60 Downloads

Abstract

Prediction of student performance is one of the most important subjects of educational data mining. Artificial neural networks are seen to be an effective tool in predicting student performance in e-learning environments. In the studies carried out with artificial neural networks, performance predictions based on student scores are generally made, but students’ use of learning management system is not focused. In this study, performances of 3518 university students, who studying and actively participating in a learning management system, were tried to be predicted by artificial neural networks in terms of gender, content score, time spent on the content, number of entries to content, homework score, number of attendance to live sessions, total time spent in live sessions, number of attendance to archived courses and total time spent in archived courses variables. Since it is difficult to interpret how much input variables in artificial neural networks contribute to predicting output variables, these networks are called black boxes. Also, in this study the amount of contribution of input variables on the prediction of output variable was also examined. The artificial neural network created as a result of the study makes a prediction with an accuracy of 80.47%. Finally, it was found that the variables of number of attendance to the live classes, the number of attendance to archived courses and the time spent in the content contributed most to the prediction of the output variable.

Keywords

Performance prediction Educational data mining Artificial neural networks Online learning environments Distance education Deep learning 

Notes

References

  1. Al-Shehri, H., Al-Qarni, A., Al-Saati, L., Batoaq, A., Badukhen, H., Alrashed, S., . . . Olatunji, S. O. (2017, April 30–May 3). Student performance prediction using Support Vector Machine and K-Nearest Neighbor. Paper presented at the 2017 IEEE 30th Canadian conference on electrical and computer engineering (CCECE).Google Scholar
  2. Angeli, C., Howard, S. K., Ma, J., Yang, J., & Kirschner, P. A. (2017). Data mining in educational technology classroom research: Can it make a contribution? Computers & Education, 113, 226–242.  https://doi.org/10.1016/j.compedu.2017.05.021.CrossRefGoogle Scholar
  3. Arsad, P. M., Buniyamin, N., & Manan, J. A. (2013, November 25–27). A neural network students’ performance prediction model (NNSPPM). Paper presented at the 2013 IEEE international conference on smart instrumentation, measurement and applications (ICSIMA).Google Scholar
  4. Asif, R., Merceron, A., Ali, S. A., & Haider, N. G. (2017). Analyzing undergraduate students’ performance using educational data mining. Computers & Education, 113, 177–194.  https://doi.org/10.1016/j.compedu.2017.05.007.CrossRefGoogle Scholar
  5. Baker, R. S., & Yacef, K. (2009). The state of educational data mining in 2009: A review and future visions. JEDM| Journal of Educational Data Mining, 1(1), 3–17.Google Scholar
  6. Bakhshinategh, B., Zaiane, O. R., ElAtia, S., & Ipperciel, D. (2018). Educational data mining applications and tasks: A survey of the last 10 years. Education and Information Technologies, 23(1), 537–553.  https://doi.org/10.1007/s10639-017-9616-z.CrossRefGoogle Scholar
  7. Benítez, J. M., Castro, J. L., & Requena, I. (1997). Are artificial neural networks black boxes? IEEE Transactions on Neural Networks, 8(5), 1156–1164.CrossRefGoogle Scholar
  8. Bousbia, N., & Belamri, I. (2014). Which contribution does EDM provide to computer-based learning environments? In Educational data mining (pp. 3–28). Cham: Springer.CrossRefGoogle Scholar
  9. Chickering, A. W., & Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. AAHE Bulletin, 3, 7.Google Scholar
  10. Chollet, F. (2018). Keras. Retrieved from https://keras.io
  11. Conijn, R., Snijders, C., Kleingeld, A., & Matzat, U. (2017). Predicting student Performance from LMS data: A comparison of 17 blended courses using Moodle LMS. IEEE Transactions on Learning Technologies, 10(1), 17–29.  https://doi.org/10.1109/TLT.2016.2616312.CrossRefGoogle Scholar
  12. Conijn, R., Van den Beemt, A., & Cuijpers, P. (2018). Predicting student performance in a blended MOOC. Journal of Computer Assisted Learning, 34(5), 615–628.CrossRefGoogle Scholar
  13. da Silva, I. N., Hernane Spatti, D., Andrade Flauzino, R., Liboni, L. H. B., & dos Reis Alves, S. F. (2017). Introduction. In Artificial neural networks: A practical course (pp. 3–19). Cham: Springer International Publishing.CrossRefGoogle Scholar
  14. de Barba, P. G., Kennedy, G. E., & Ainley, M. D. (2016). The role of students’ motivation and participation in predicting performance in a MOOC. Journal of Computer Assisted Learning, 32(3), 218–231.  https://doi.org/10.1111/jcal.12130.CrossRefGoogle Scholar
  15. de Oña, J., & Garrido, C. (2014). Extracting the contribution of independent variables in neural network models: A new approach to handle instability. Neural Computing and Applications, 25(3), 859–869.  https://doi.org/10.1007/s00521-014-1573-5.CrossRefGoogle Scholar
  16. Dimopoulos, Y., Bourret, P., & Lek, S. (1995). Use of some sensitivity criteria for choosing networks with good generalization ability. Neural Processing Letters, 2(6), 1–4.CrossRefGoogle Scholar
  17. Garson, G. D. (1991). Interpreting neural-network connection weights. AI Expert, 6(4), 46–51.Google Scholar
  18. Goh, A. T. C. (1995). Back-propagation neural networks for modeling complex systems. Artificial Intelligence in Engineering, 9(3), 143–151.  https://doi.org/10.1016/0954-1810(94)00011-S.CrossRefGoogle Scholar
  19. González-Gómez, F., Guardiola, J., Martín Rodríguez, Ó., & Montero Alonso, M. Á. (2012). Gender differences in e-learning satisfaction. Computers & Education, 58(1), 283–290.  https://doi.org/10.1016/j.compedu.2011.08.017.CrossRefGoogle Scholar
  20. Gray, G., McGuinness, C., & Owende, P. (2014, February 21–22). An application of classification models to predict learner progression in tertiary education. Paper presented at the 2014 IEEE international advance computing conference (IACC).Google Scholar
  21. Guarín, C. E. L., Guzmán, E. L., & González, F. A. (2015). A model to predict low academic performance at a specific enrollment using data mining. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, 10(3), 119–125.  https://doi.org/10.1109/RITA.2015.2452632.CrossRefGoogle Scholar
  22. Huang, S., & Fang, N. (2013). Predicting student academic performance in an engineering dynamics course: A comparison of four types of predictive mathematical models. Computers & Education, 61, 133–145.  https://doi.org/10.1016/j.compedu.2012.08.015.CrossRefGoogle Scholar
  23. Hussain, M., Zhu, W., Zhang, W., Abidi, S. M. R., & Ali, S. (2018). Using machine learning to predict student difficulties from learning session data. Artificial Intelligence Review, 52, 381–407.  https://doi.org/10.1007/s10462-018-9620-8.CrossRefGoogle Scholar
  24. Ibrahim, Z., & Rusli, D. (2007). Predicting students’ academic performance: Comparing artificial neural network, decision tree and linear regression. Paper presented at the 21st annual SAS Malaysia forum.Google Scholar
  25. Ketkar, N. (2017). Deep learning with python: A hands-on introduction. Berkeley: Apress.CrossRefGoogle Scholar
  26. Kim, P. (2017). MATLAB deep learning: With machine learning, neural networks and artificial intelligence. Berkeley: Apress.CrossRefGoogle Scholar
  27. Kumar, A. D., Selvam, R. P., & Kumar, K. S. (2018). Review on prediction algorithms in educational data mining. International Journal of Pure and Applied Mathematics, 118, 531–536.Google Scholar
  28. Ma, J., Han, X., Yang, J., & Cheng, J. (2015). Examining the necessary condition for engagement in an online learning environment based on learning analytics approach: The role of the instructor. The Internet and Higher Education, 24, 26–34.  https://doi.org/10.1016/j.iheduc.2014.09.005.CrossRefGoogle Scholar
  29. Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599.  https://doi.org/10.1016/j.compedu.2009.09.008.CrossRefGoogle Scholar
  30. Narayanan, S. A., Prasanth, M., Mohan, P., Kaimal, M., & Bijlani, K. (2012). Attention analysis in e-learning environment using a simple web camera. Paper presented at the 2012 IEEE international conference on technology enhanced education (ICTEE).Google Scholar
  31. Naser, S. A., Zaqout, I., Ghosh, M. A., Atallah, R., & Alajrami, E. (2015). Predicting student performance using artificial neural network: In the Faculty of Engineering and Information Technology. International Journal of Hybrid Information Technology, 8(2), 221–228.CrossRefGoogle Scholar
  32. Nielsen, M. A. (2015). Neural networks and deep learning (Vol. 25). San Francisco, CA, USA:Determination Press.Google Scholar
  33. Olden, J. D., & Jackson, D. A. (2002). Illuminating the “black box”: A randomization approach for understanding variable contributions in artificial neural networks. Ecological Modelling, 154(1–2), 135–150.CrossRefGoogle Scholar
  34. Olden, J. D., Joy, M. K., & Death, R. G. (2004). An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data. Ecological Modelling, 178(3), 389–397.  https://doi.org/10.1016/j.ecolmodel.2004.03.013.CrossRefGoogle Scholar
  35. Ong, C.-S., & Lai, J.-Y. (2006). Gender differences in perceptions and relationships among dominants of e-learning acceptance. Computers in Human Behavior, 22(5), 816–829.  https://doi.org/10.1016/j.chb.2004.03.006.CrossRefGoogle Scholar
  36. Özonur, M., Yanpar Yelken, T., & Sancar Tokmak, H. (2018). Social presence and motivation in online environments: Second life versus the Enocta learning management system/adobe connect. Australasian Journal of Educational Technology, 34(3).  https://doi.org/10.14742/ajet.3128.
  37. Özonur, M., Kamışlı, H., Yanpar Yelken, T., & Sancar Tokmak, H. (2019). Uzaktan Eğitim Öğrencilerinin Enocta Öğrenme Yönetim Sistemi Hakkında Görüşlerinin İncelenmesi. Mehmet Akif Ersoy Üniversitesi Eğitim Fakültesi Dergisi, 50, 283–302.Google Scholar
  38. Paliwal, M., & Kumar, U. A. (2009). A study of academic performance of business school graduates using neural network and statistical techniques. Expert Systems with Applications, 36(4), 7865–7872.  https://doi.org/10.1016/j.eswa.2008.11.003.CrossRefGoogle Scholar
  39. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(Oct), 2825–2830.MathSciNetzbMATHGoogle Scholar
  40. Peña-Ayala, A. (2014). Educational data mining: A survey and a data mining-based analysis of recent works. Expert Systems with Applications, 41(4, Part 1), 1432–1462.  https://doi.org/10.1016/j.eswa.2013.08.042.CrossRefGoogle Scholar
  41. Quadri, M. M., & Kalyankar, N. V. (2010). Drop out feature of student data for academic performance using decision tree techniques. Global Journal of Computer Science and Technology, 10(2), 2-5.Google Scholar
  42. Romero, C., & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40(6), 601–618.  https://doi.org/10.1109/TSMCC.2010.2053532.CrossRefGoogle Scholar
  43. Romero, C., & Ventura, S. (2013). Data mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 3(1), 12–27.Google Scholar
  44. Romero, C., López, M.-I., Luna, J.-M., & Ventura, S. (2013). Predicting students’ final performance from participation in on-line discussion forums. Computers & Education, 68, 458–472.  https://doi.org/10.1016/j.compedu.2013.06.009.CrossRefGoogle Scholar
  45. Schacter, D. L., & Szpunar, K. K. (2015). Enhancing attention and memory during video-recorded lectures. Scholarship of Teaching and Learning in Psychology, 1(1), 60–71.  https://doi.org/10.1037/stl0000011.CrossRefGoogle Scholar
  46. Şengür, D., & Tekin, A. (2013). Öğrencilerin mezuniyet notlarının veri madenciliği metotları ile tahmini. Bilişim Teknolojileri Dergisi, 6(3), 7–16.Google Scholar
  47. Shahiri, A. M., Husain, W., & Rashid, N. A. (2015). A review on predicting Student’s performance using data mining techniques. Procedia Computer Science, 72, 414–422.  https://doi.org/10.1016/j.procs.2015.12.157.CrossRefGoogle Scholar
  48. Stevens, R., Ikeda, J., Casillas, A., Palacio-Cayetano, J., & Clyman, S. (1999). Artificial neural network-based performance assessments. Computers in Human Behavior, 15(3), 295–313.  https://doi.org/10.1016/S0747-5632(99)00025-4.CrossRefGoogle Scholar
  49. Tanner, T., & Toivonen, H. (2010). Predicting and preventing student failure – using the k-nearest neighbour method to predict student performance in an online course environment. International Journal of Learning Technology, 5(4), 356–377.  https://doi.org/10.1504/ijlt.2010.038772.CrossRefGoogle Scholar
  50. Yang, F., & Li, F. W. B. (2018). Study on student performance estimation, student progress analysis, and student potential prediction based on data mining. Computers & Education, 123, 97–108.  https://doi.org/10.1016/j.compedu.2018.04.006.CrossRefGoogle Scholar
  51. Zhou, Y., Chang, F.-J., Chang, L.-C., Kao, I. F., & Wang, Y.-S. (2019). Explore a deep learning multi-output neural network for regional multi-step-ahead air quality forecasts. Journal of Cleaner Production, 209, 134–145.  https://doi.org/10.1016/j.jclepro.2018.10.243.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Education and Instructional Technologies, Faculty of EducationNevşehir Hacı Bektaş Veli UniversityNevşehirTurkey

Personalised recommendations