Advertisement

Assessing Learning Outcomes in Vocational Education

  • Hamish CoatesEmail author
Reference work entry

Abstract

As vocational education and training develops, more energy must be invested in ensuring that sufficient learning has been achieved to warrant the award of a qualification and that people are ready for work. Many traditional and commonly used assessment approaches do not scale well, and there remains a pressing need for reform. This chapter distils insights from international investigations of student learning outcomes assessment and uses these to chart frontiers for innovation. The chapter begins with an historical tour of the field, taking stock of progress over the last 30 years by examining signature initiatives. It sets out a framework for understanding and guiding growth, reviews likely facilitators and blockers, and, through these analyses, advances a strategy for guiding future development. The strategy articulates technical, practical, and substantive dimensions of assessment. Energy is invested in discussing each of these dimensions and creating a picture of what assessment will look like in a decade’s time. The chapter’s final section clarifies governance arrangements which would have capacity to spur the kind of progress required to propel the field. Overall this chapter offers insights into the nature, relevance, research, and practice of assessment in VET.

Keywords

Vocational education Assessment methodology Learning outcomes Education reform 

References

  1. Allais S, Young M, Raffe D (2009) Introduction. In: Allais S, Raffe D, Strathdee R, Wheelahan L, Young M (eds) Learning from the first qualifications frameworks. International Labour Office, GenevaGoogle Scholar
  2. American Educational Research Association (AERA), American Psychological Association (APA) and the National Council on Measurement in Education (NCME) (2014) Standards for educational & psychological testing. American Psychological Association, Washington, DCGoogle Scholar
  3. Association of American Colleges and Universities (AAC&U) and State Higher Education Executive Offices (SHEEO) (2015) MSC: a multi-state collaborative to advance learning outcomes assessment. Accessed 20 Sept 2016 from: http://www.sheeo.org/projects/msc-multi-state-collaborative-advance-learning-outcomes-assessment
  4. Australian Learning and Teaching Council (ALTC) (2010) Learning and teaching academic standards project final report. Australian Learning and Teaching Council, SydneyGoogle Scholar
  5. Australian Qualifications Framework Council (AQFC) (2015) Australian qualifications framework. Accessed 1 Sept 2016 from: http://www.aqf.edu.au
  6. Bennett R (2015) The changing nature of educational assessment. Rev Res Educ 39(1):370–407CrossRefGoogle Scholar
  7. Braeken J, Blömeke S (2016) Comparison of beliefs across countries: dealing with measurement invariance and local dependence using Bayesian elastics. Assess Eval Higher Educ 41:733CrossRefGoogle Scholar
  8. Canny B, Coates H (2014) Governance models for collaborations involving assessment. Office for Learning and Teaching, SydneyGoogle Scholar
  9. Chakroun B (2010) National qualification frameworks: from policy borrowing to policy learning. Eur J Educ 45(2):199–216CrossRefGoogle Scholar
  10. Cisco Networking Academy (2012) Advancing assessment with technology. Accessed 2 Dec 2016 from: http://www.cisco.com/c/dam/en_us/training-events/netacad/downloads/pdf/NetAcadPOV.pdf
  11. Coates H (2010) Defining and monitoring academic standards in Australian higher education. High Educ Manag Policy 22(1):1–17CrossRefGoogle Scholar
  12. Coates H (2014) Higher education learning outcomes assessment: international perspectives. Peter Lang, FrankfurtGoogle Scholar
  13. Coates H (2015) Assessment of learning outcomes. In: Pricopie R, Scott P, Salmi J, Curaj A (eds) Future of higher education in Europe. Volume I and Volume II. Springer, DordrechtGoogle Scholar
  14. Coates H (2016) Assessing student learning outcomes internationally: insights and frontiers. Assess Eval Higher Educ 41(5):662–676CrossRefGoogle Scholar
  15. Coates H (2017) The market for learning: leading transparent higher education. Springer, DordrechtCrossRefGoogle Scholar
  16. Coates H (2018) Research and governance architectures to develop the field of learning outcomes assessment. In: Zlatkin-Troitschanskaia O, Pant HA, Toepper M, Lautenbach C Kuhn C (eds) Assessment of learning outcomes in higher education: cross-national comparisons and perspectives. Dordrecht: SpringerGoogle Scholar
  17. Coates H, Richardson S (2012) An international assessment of bachelor degree graduate’s learning outcomes. High Educ Manag Policy 23(3):51–69Google Scholar
  18. Coates H, James R, Baldwin G (2005) A critical examination of the effects of learning management systems on university teaching and learning. Tert Educ Manag 11:19–36CrossRefGoogle Scholar
  19. Department of Education and Training (2017) Training packages. Accessed from: https://www.education.gov.au/training-packages
  20. Dillon GF, Clyman SG, Clauser BE, Margolis MJ (2002) The introduction of computer-based case simulations into the United States medical licensing examination. Acad Med 77(10):94–96CrossRefGoogle Scholar
  21. Educational Testing Service (ETS) (2014) Proficiency profile. Accessed 1 Sept 2014 from: www.ets.org/proficiencyprofile/about
  22. Edwards D, Wilkinson D, Coates H, Canny B (2012) The Australian medical assessment collaboration: developing the foundations for a national assessment of medical student learning outcomes. Office of Learning and Teaching, SydneyGoogle Scholar
  23. European Commission (2012) Thematic working group ‘Assessment of Key Competences’: literature review, glossary and examples. European Commission, BrussellsGoogle Scholar
  24. European Commission (EC) (2015) European qualifications framework. Accessed 1 Sept 2016 from: https://ec.europa.eu/ploteus/search/site?f%5B0%5D=im_field_entity_type%3A97
  25. González J, Wagenaar R (2008) Universities’ contribution to the Bologna process: an introduction. Universidad de Deusto, BilbaoGoogle Scholar
  26. Halliday-Wynes S, Misko J (2013) Assessment issues in VET: minimising the level of risk. NCVER, AdelaideGoogle Scholar
  27. Higher Education Funding Council for England (HEFCE) (2015) £4 million awarded to 12 projects to pilot measures of learning gain. Accessed 1 Sept 2016 from: http://www.hefce.ac.uk/news/newsarchive/2015/Name,105306,en.html
  28. International Testing Commission (ITC) (2015) Guidelines. Accessed 10 Sept 2016 from: https://www.intestcom.org/page/5
  29. Lennon MC, Frank B, Lenton R, Madsen K, Omri A, Turner R (2014) Tuning: identifying and measuring sector-based learning outcomes in postsecondary education. Higher Education Quality Council of Ontario, TorontoGoogle Scholar
  30. Liu OL, Mao L, Frankel L, Xu J (2016) Assessing critical thinking in higher education: the HEIghten™ approach and preliminary validity evidence. Educational Testing Service, PrincetonGoogle Scholar
  31. Loyalka P (2015) Initial results from an international study of student learning in higher education: China, Russia, and the US. Keynote paper presented at the 2nd symposium of learning science and online education. BeijingGoogle Scholar
  32. Luecht RM (2013) An introduction to assessment engineering for automatic item generation. In: Gierl MJ, Haladyna TM (eds) Automatic item generation: theory and practice. Routledge, New YorkGoogle Scholar
  33. Lumina Foundation (2015) The degree qualifications profile. Accessed 1 Sept 2016 from: http://www.luminafoundation.org/files/resources/dqp.pdf
  34. Marshall S, Henry R, Ramburuth P (2013) Improving assessment in higher education: a whole of institution approach. New South Books, SydneyGoogle Scholar
  35. Melguizo T (2015) Are students gaining general and subject area knowledge in university? Evidence from Brazil. Higher EducationGoogle Scholar
  36. Mislevy R, Haertel G, Yarnall L, Wentland E (2011) Evidence centered task design in test development. In: Secolsky C (ed) Measurement, assessment, and evaluation in higher education. Routledge, New YorkGoogle Scholar
  37. National Board of Medical Examiners (NBME) (2008) Primum® computer-based case simulations (CCS). NBME, PhiladelphiaGoogle Scholar
  38. Ofqual (2015) Qualifications and credit framework. Accessed 1 Sept 2016 from: https://www.gov.uk/government/organisations/ofqual
  39. Organisation for Economic Cooperation and Development (OECD) (2015) Education at a glance. OECD, ParisGoogle Scholar
  40. Organisation for Economic Cooperation and Development (OECD) (2017) Survey of adult skills (PIAAC). OECD, ParisGoogle Scholar
  41. Pearson (2014) MyEconLab. Accessed 27 Aug 2014 from: www.pearsonmylabandmastering.com/northamerica/myeconlab
  42. Rhodes T, Finley A (2013) Using the VALUE rubrics for improvement of learning and authentic assessment. AAC&U, Washington, DCGoogle Scholar
  43. Richardson S, Coates H (2014) Essential foundations for establishing equivalence in cross-national higher education assessment. High Educ 68(6):825–836CrossRefGoogle Scholar
  44. Schuwirth LWT, van der Vleuten CPM (2012) The use of progress testing. Perspect Med Educ 1(1):24–30CrossRefGoogle Scholar
  45. Shattock M (2012) University governance. Perspect Policy Pract High Educ 16(2):56–61Google Scholar
  46. Shavelson R (2007) A brief history of student learning assessment: how we got where we are and a proposal for where to go next. Association of American Colleges and Universities, Washington, DCGoogle Scholar
  47. Shavelson RJ, Domingue BW, Mariño JP, Mantilla AM, Morales JA, Wiley EE (2016) On the practices and challenges of measuring higher education value added: the case of ColombiaGoogle Scholar
  48. Smith E (2010) A review of twenty years of competency-based training in the Australian vocational education and training system. Int J Train Dev 14(1):54–64CrossRefGoogle Scholar
  49. Twigg CA (2003) Improving learning and reducing costs: new models for online learning. Educ Rev September/October:28–38Google Scholar
  50. United Nations Education, Scientific and Cultural Organisation (UNESCO) (2017) Global Education Monitoring Report. Accessed fromL https://en.unesco.org/gem-report
  51. Wheelahan L (2009) From old to new – the Australian qualifications framework. In: Allais S, Raffe D, Strathdee R, Wheelahan L, Young M (eds) Learning from the first qualifications frameworks. International Labour Office, GenevaGoogle Scholar
  52. Zlatkin-Troitschanskaia O, Kuhn C, Toepper M (2014) Modelling and assessing higher education learning outcomes in Germany. In: Coates H (ed) Advancing higher education learning outcomes. Peter Lang Publishers, FrankfurtGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Institute of EducationTsinghua UniversityBeijingChina

Section editors and affiliations

  • Esther Winther

There are no affiliations available

Personalised recommendations