Advertisement

Higher Education Analytics: New Trends in Program Assessments

  • Adam Marks
  • Maytha AL-Ali
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 745)

Abstract

End of course evaluations technologies can provide critical analytics that can be used to improve the academic outcomes of almost any university. This paper presents key findings from a study conducted on more than twenty different academic degree-programs, regarding their use of end of course evaluation technology. Data was collected from an online survey instrument, in-depth interviews with academic administrators, and two case studies, one in the US and another in the UAE. The study reveals new trends including sectioning and categorization; questions standardization and benchmarking; alignment with key performance indicators and key learning outcomes; and grouping by course, program outcome, program, college, etc. in addition to those vertical structures, higher education institutions are vertically examining a specific question(s) across.

Keywords

Higher education Course evaluation Academic assessment 

References

  1. 1.
    AbuShawar, B., Al-Sadi, A.: Learning management systems: are they knowledge management tools. Int. J. Emerg. Technol. Learn. IJET 5(1), 4–10 (2010)Google Scholar
  2. 2.
    AL-Smadi, M., Guetl, C., Helic, D.: Towards a standardized e-assessment system: motivations, challenges and first findings. Int. J. Emerg. Technol. Learn. IJET 4(2), 6–12 (2009)Google Scholar
  3. 3.
    Brown, M.: Learning analytics: moving from concept to practice. EDUCAUSE Learning Initiative, Louisville, CO (2012). http://net.educause.edu/ir/library/pdf/ELIB1203.pdf. Accessed 10 Oct 2013
  4. 4.
    Chen, H., Chiang, R.H.L., Storey, V.C.: Business intelligence research. MIS Q. 34(1), 201–203 (2010)Google Scholar
  5. 5.
    Daniel, B.: Big Data and analytics in higher education: opportunities and challenges. Br. J. Educ. Technol. 46(5), 904–920 (2015)CrossRefGoogle Scholar
  6. 6.
    Hazelkorn, E.: The impact of league tables and ranking systems on higher education decision making. High. Educ. Manag. Pol. 19(2), 87–110 (2007)Google Scholar
  7. 7.
    Johnson, L., Adams, S., Cummins, M.: The 2012 Horizon Report. The New Media Consortium, Austin (2012)Google Scholar
  8. 8.
    Johnson, L., Adams, S., Cummins, M., Estrada, V., Freeman, A., Ludgate, H.: The NMC Horizon Report: 2013 Higher Education Edition. The New Media Consortium, Austin, TX (2013). http://www.nmc.org/pdf/2013-horizon-report-HE.pdf. Accessed 2 Oct 2013
  9. 9.
    Jones, S.: Technology review: the possibility of learning analytics to improve learner-centered decision making. Commun. Coll. Enterp. 18(1), 89–92 (2012)Google Scholar
  10. 10.
    Lang, L., Pirani, J.: The Learning Management Systems Evolution, Revised edition. EDUCAUSE Center for Analysis and Research (2014)Google Scholar
  11. 11.
    Long, P.D., Siemens, G.: Penetrating the fog: analytics in learning and education. Educause Rev. 46(5), 30–32 (2011)Google Scholar
  12. 12.
    Majdalawieh, A.M.: Assessing the Effectiveness and Viability of an Academic Program: A Holistic Conceptual Framework. MLambert Academic Publishing, ISBN: 978-3-330-06152-1 (2017)Google Scholar
  13. 13.
    Norris, D., Baer, L., Leonard, J., Pugliese, L., Lefrere, P.: Action analytics. Educause Rev. 43(1), 42–67 (2008)Google Scholar
  14. 14.
    OECD. E-learning in Tertiary Education: Where Do We Stand? (2005)Google Scholar
  15. 15.
    Phillips, R., Maor, D., Preston, G., Cumming-Potvin, W.: Exploring learning analytics as indicators of study behaviour. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications (EDMEDIA) (2012)Google Scholar
  16. 16.
    Reyes, J.: The skinny on Big Data in education: learning analytics simplified. TechTrends 59(2), 75–80 (2015)CrossRefGoogle Scholar
  17. 17.
    Suhirman, J., Haruna, C., Tutut, H.: Data mining for education decision support: a review. Int. J. Emerg. Technol. Learn. IJET 9(6), 4–19 (2014)CrossRefGoogle Scholar
  18. 18.
    Thoronton, G.: The State of Higher Education in 2013. Pressures, Changes, and New Opportunities (2013). http://www.grantthoronton.com/staticfiles/GTCom. Accessed 24 Mar 2014
  19. 19.
    Van Barneveld, A., Arnold, K.E., Campbell, J.P.: Analytics in higher education: establishing a common language. Educause Learn. Initiative 1, 1–11 (2012)Google Scholar
  20. 20.
    Verbert, K., Manouselis, N., Drachsler, H., Duval, E.: Dataset-driven research to support learning and knowledge analytics. Educ. Technol. Soc. 15(3), 133–148 (2012)Google Scholar
  21. 21.
    Williams, S.: 5 barriers to BI success and how to overcome them. Strat. Financ. 93(1), 27–33 (2011)Google Scholar
  22. 22.
    Wixom, B., Ariyachandra, T., Goul, M., Gray, P., Kulkarni, U., Phillips-Wren, G.: The current state of business intelligence in academia. Commun. Assoc. Inf. Syst. 29(16), 299–312 (2011)Google Scholar
  23. 23.
    Marks, A., Rietsema, K., AL-Ali, M.: Learning management systems: a shift toward learning analytics. Int. J. Emerg. Technol. Learn. 11(4), 77–82 (2016)CrossRefGoogle Scholar
  24. 24.
    Meyer, F., Madsen, E., Beks, C., Ferrante, A., Houlton, K., Konar, B., Koskey, M., Skrip, S.: Assessment of electronic course evaluation technology and its applicability to the University of Alaska Fairbanks (2013)Google Scholar
  25. 25.
    Marlin, J., Niss, J.: End of course evaluations as indicators of student learning and instructor effectivness. J. Econ. Educ. 11(2), 16–27 (1980)CrossRefGoogle Scholar
  26. 26.
    Rathke, D., Harmon, J.: Purposes of student course evaluations, owens community college (2011). https://www.owens.edu/ir/purpose-stu-evals.pdf
  27. 27.
    Adams, M.D., Umbach, P.: Nonresponse and online student evaluations of teaching: understanding the influence of salience, fatigue, and academic environments. Res. High. Educ. 53(5), 576–591 (2012)CrossRefGoogle Scholar
  28. 28.
    Hanover research report best practices in using aggregate course evaluation data. Hanover Research (2014)Google Scholar
  29. 29.
    WodE, J., Keiser, J.: Online course evaluation literature review and findings. Academic Affairs, Columbia College Chicago (2011)Google Scholar
  30. 30.
    Ducheva, Z., Pehlivanova, M., Dineva, S.: Possibilities for students to evaluate and imporve electronic courses. In: The 8th International Conferemnce on Virtual Learning ICVL (2013)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Zayed UniversityDubaiUAE

Personalised recommendations