Abstract
The ISO/IEC 17024:2012 describes best-practices regarding competence assessment. The standard emphasizes validity and sound processes to create high-quality competence assessments. The question is how to comply with the ISO/IEC standard when creating large-scale, worldwide assessments. In addition, the competence framework describes competences that require years of experience as part of the competence. We determine to what extent of mastery candidates need to master the competence to start working. We assess this by testing the requisite knowledge with a multiple-choice exam and the required minimum level of mastery of the competence with a Practical Assignment. This assignment is assessed by trainers, which creates the need for supervision and accreditation of the trainers. This paper shows an example of a certification scheme to explain how we comply with the ISO/IEC standard. The creation of the certification scheme and the accreditation of the trainers are described. The compliance with the ISO/IEC standard is explained.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mulder, M., Weigel, T., Collins, K.: The concept of competence in the development of vocational education and training in selected EU member states. J. Vocat. Educ. Train. 59, 53–66 (2007). doi:10.1080/13636820601145549
NEN-EN-ISO/IEC. NEN-EN-ISO/IEC 17024:2012, IDT - Conformity assessment - general requirements for bodies operating certification of persons (2012)
CEN. European e-Competence Framework version 3.0 - a common European Framework for ICT Professionals in all industry sectors, 3rd edn. CEN (European Committee for Standardization) (2014)
Borsboom, D., Mellenbergh, G.J., van Heerden, J.: The concept of validity. Psychol. Rev. 111, 1061–1071 (2004). doi:10.1037/0033-295X.111.4.1061
Wools, S. Evaluation of validity and validation. In: 9th Annual AEA-Europe Conference on Hisarya, Bulgaria, pp 1–9 (2008)
Brennan, R.L. (ed.): Educational Measurement, 4th edn. Praeger Publishers, Westport, Connecticut (2006)
Govaerts, M.J.B., Schuwirth, L.W.T., van der Vleuten, C.P.M., Muijtjens, A.M.M.: Workplace-based assessment: effects of rater expertise. Adv. Heal. Sci. Educ. 16, 151–165 (2011). doi:10.1007/s10459-010-9250-7
Van Scotter, J.R., Moustafa, K., Burnett, J.R., Michael, P.G.: Influence of prior acquaintance with the ratee on rater accuracy and halo. J. Manage. Dev. 26, 790–803 (2007). doi:10.1108/02621710710777282
Williams, R.G., Sanfey, H., Chen, X., Dunnington, G.L.: A controlled study to determine measurement conditions necessary for a reliable and valid operative performance assessment: a controlled prospective observational study. Ann. Surg. 256, 177–187 (2012). doi:10.1097/SLA.0b013e31825b6de4
Engelhard, Jr., G., Myford, C.M., Cline, F. Investigating assessor effects in National Board for Professional Teaching Standards assessments for early childhood/generalist and middle childhood/generalist certification. Res. Rep. Educ. Test Serv. I–IV, i-77 (2000)
Pitts, J., Coles, C., Thomas, P., Smith, F.: Enhancing reliability in portfolio assessment: discussions between assessors. Med. Teach. 24, 197–201 (2002). doi:10.1080/01421590220125321
Clauser, B.B.E., Margolis, M.J.M., Clyman, S.G., Ross, L.P.: Development of automated scoring algorithms for complex performance assessments: a comparison of two approaches. J. Educ. Meas. 34, 141–161 (1997). doi:10.1111/j.1745-3984.1997.tb00511.x
Van der Schaaf, M.F., Stokking, K.M., Verloop, N.: Cognitive representations in raters’ assessment of teacher portfolios. Stud. Educ. Eval. 31, 27–55 (2005). doi:10.1016/j.stueduc.2005.02.005
Ryan, A.M., Daum, D., Bauman, T., Grisez, M., Mattimore, K., Nalodka, T., McCormick, S.: Direct, indirect, and controlled observation and rating accuracy. J. Appl. Psychol. 80, 664–670 (1995). doi:10.1037/0021-9010.80.6.664
Eva, K.W., Rosenfeld, J., Reiter, H.I., Norman, G.R.: An admissions OSCE: the multiple mini-interview. Med. Educ. 38, 314–326 (2004). doi:10.1046/j.1365-2923.2004.01776.x
Iramaneerat, C., Yudkowsky, R.: Rater errors in a clinical skills assessment of medical students. Eval. Health Prof. 30, 266–283 (2007). doi:10.1177/0163278707304040
Shechtman, Z.: Agreement between lay participants and professional assessors: support of a group assessment procedure for selection purposes. J. Pers. Eval. Educ. 12, 5–17 (1998). doi:10.1023/A:1007932515469
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Hubregtse, M., Moerbeek, S., Veldkamp, B.P., Eggen, T. (2015). Testing Competences Worldwide in Large Numbers. In: Ras, E., Joosten-ten Brinke, D. (eds) Computer Assisted Assessment. Research into E-Assessment. TEA 2015. Communications in Computer and Information Science, vol 571. Springer, Cham. https://doi.org/10.1007/978-3-319-27704-2_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-27704-2_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27703-5
Online ISBN: 978-3-319-27704-2
eBook Packages: Computer ScienceComputer Science (R0)