Abstract
In the last few years an interdisciplinary team of researchers in the fields of organizational psychology and didactics of informatics have worked together to develop an empirical sound competence structure model, a measurement instrument and a competence level model. This is considered a relevant step for the reliable assessment of competences and the development of competence based curricula to foster the recent outcome orientation of the German educational system.
In this paper we publish the last component of our efforts: a model of proficiency levels, derived from the results of a competence assessment with over 500 German students. We describe different approaches to define proficiency levels and the process we used to derive them from our data. In the end, a detailed overview of the four proficiency levels is given and supplemented with exemplary tasks students should be able to solve on each.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Linck, B., Ohrndorf, L., Schubert, S., Stechert, P., Magenheim, J., Nelles, W., Neugebauer, J., Schaper, N.: Competence model for informatics modelling and system comprehension. In: Proceedings of the 4th Global Engineering Education Conference, IEEE EDUCON 2013, Berlin, pp. 85–93 (2013)
Neumann, K., Fischer, H.E., Kauertz, A.: From Pisa To Educational Standards: The Impact Of Large-Scale Assessments On Science Education In Germany. International Journal of Science and Mathematics Education 8, 545–563 (2010)
Koeppen, K., Hartig, J., Klieme, E., Leutner, D.: Current Issues in Competence Modeling and Assessment. Zeitschrift für Psychologie 216, 61–73 (2008)
Magenheim, J., Nelles, W., Rhode, T., Schaper, N., Schubert, S., Stechert, P.: Competencies for informatics systems and modeling: results of qualitative content analysis of expert interviews. In: Proceedings of the 1st Global Engineering Education Conference, Educon 2010, pp. 513–521. IEEE Computer Society, Madrid (2010)
Nelles, W., Rhode, T., Stechert, P.: Entwicklung eines Kompetenzrahmenmodells – Informatisches Modellieren und Systemverständnis. Informatik-Spektrum 33, 45–53 (2009)
Lehner, L., Magenheim, J., Nelles, W., Rhode, T., Schaper, N., Schubert, S., Stechert, P.: Informatics Systems and Modelling – Case Studies of Expert Interviews. In: Reynolds, N., Turcsányi-Szabó, M. (eds.) KCKS 2010. IFIP AICT, vol. 324, pp. 222–233. Springer, Heidelberg (2010)
Rhode, T.: Entwicklung und Erprobung eines Instruments zur Messung informatischer Modellierungskompetenz im fachdidaktischen Kontext (Doctoral dissertation). University of Paderborn (2013)
Osteen, P.: An Introduction to Using Multidimensional Item Response Theory. Journal of the Society for Social Work and Research 1, 66–82 (2010)
Neugebauer, J., Hubwieser, P., Magenheim, J., Ohrndorf, L., Schaper, N., Schubert, S.: Measuring Student Competences in German Upper Secondary Computer Science Education. In: Gülbahar, Y., Karataş, E. (eds.) ISSEP 2014. LNCS, vol. 8730, pp. 100–111. Springer, Heidelberg (2014)
Hartig, J., Magenheim, J., Höhler, J., Nelles, W., Rhode, T., Schaper, N., Schubert, S., Stechert, P.: Multidimensional IRT models for the assessment of competencies. Studies in Educational Evaluation 35, 57–63 (2009)
Anderson, L.W., Krathwohl, D.R.: A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives. Addison Wesley Longman, New York (2001)
Seehorn, D., Carey, S., Fuschetto, B., Lee, I., Moix, D., O’Grady-Cunniff, D., Boucher Owens, B., Stephenson, C., Verno, A.: CSTA K–12 Computer Science Standards. Computer Science Teachers Association Association for Computing Machinery (2011)
Schaper, N., Ulbricht, T., Hochholdinger, S.: Zusammenhang von Anforderungsmerkmalen und Schwierigkeitsparametern der MT21-Items. In: Blömeke, S., Kaiser, G., and Lehmann, R. (eds.) Professionelle Kompetenz angehender Lehrerinnen und Lehrer: Wissen, Überzeugungen und Lerngelegenheiten deutscher Mathematikstudierender und-referendare. Erste Ergebnisse zur Wirksamkeit der Lehrerausbildung, pp. 453–480. Waxmann Verlag (2008)
Magenheim, J., Nelles, W., Neugebauer, J., Ohrndorf, L., Schaper, N., Schubert, S.: Expert rating of competence levels in Upper Secondary Computer Science Education. In: Brinda, T., Reynolds, N., and Romeike, R. (eds.) KEYCIT 2014 – Key Competencies in Informatics and ICT, pp. 1–12 (2014).
Watermann, R., Klieme, E.: Reporting Results of Large-Scale Assessment in Psychologically and Educationally Meaningful Terms. European Journal of Psychological Assessment 18, 190–203 (2002)
Organisation for Economic Co-operation and development: PISA 2003 Technical Report. OECD (2005)
Hartig, J., Frey, A., Nold, G., Klieme, E.: An Application of Explanatory Item Response Modeling for Model-Based Proficiency Scaling
Beaton, A.E., Allen, N.L.: Interpreting Scales Through Scale Anchoring. Journal of Educational and Behavioral Statistics 17, 191–204 (1992)
DESI-Konsortium [Hrsg]: Unterricht und Kompetenzerwerb in Deutsch und Englisch Ergebnisse der DESI-Studie Weinheim ua: Beltz, pp. 34–54 (2008)
Martin, M.O., Mullis, I.V.S.: Overview of TIMSS 2003. In: Martin, M.O., Mullis, I.V.S., Chrostowski, S.J. (eds.) TIMSS 2003 Technical Report, pp. 3–20. Boston College, Chestnut Hill (2004)
Hammond, M., Rogers, P.: An investigation of children’s conceptualisation of computers and how they work. Education and Information Technologies 12, 3–15 (2006)
Magenheim, J., Neugebauer, J., Stechert, P., Ohrndorf, L., Linck, B., Schubert, S., Nelles, W., Schaper, N.: Competence Measurement and Informatics Standards in Secondary Education. In: Diethelm, I., Mittermeir, R.T. (eds.) ISSEP 2013. LNCS, vol. 7780, pp. 159–170. Springer, Heidelberg (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Neugebauer, J., Magenheim, J., Ohrndorf, L., Schaper, N., Schubert, S. (2015). Defining Proficiency Levels of High School Students in Computer Science by an Empirical Task Analysis Results of the MoKoM Project. In: Brodnik, A., Vahrenhold, J. (eds) Informatics in Schools. Curricula, Competences, and Competitions. ISSEP 2015. Lecture Notes in Computer Science(), vol 9378. Springer, Cham. https://doi.org/10.1007/978-3-319-25396-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-25396-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25395-4
Online ISBN: 978-3-319-25396-1
eBook Packages: Computer ScienceComputer Science (R0)