Abstract
This paper reports an analysis of features of mathematics assessment items developed for the OECD’s Programme for International Student Assessment survey (PISA) in relation to a set of six mathematical competencies. These competencies have underpinned the PISA mathematics framework since the inception of the PISA survey; they have been used to drive mathematics curriculum and assessment review and reform in several countries; and the results of the study are therefore likely to be of interest to the broad mathematics education community.
We present a scheme used to describe this set of mathematical competencies, to quantify the extent to which solution of each assessment item calls for the activation of those competencies, and to investigate how the demand for activation of those competencies relates to the difficulty of the items. We find that the scheme can be used effectively, and that ratings of items according to their demand for activation of the competencies are highly predictive of the difficulty of the items.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Blum, W., Drueke-Noe, C., Hartung, R., & Köller, O. (2006). Bildungsstandards Mathematik: konkret. Berlin: Cornelsen-Scriptor.
Chatterjee, S., & Price, B. (1977). Regression Analysis by Example. New York: Wiley.
Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements. New York: Wiley.
De Lange, J. (1987). Mathematics, Insight and Meaning. Utrecht: CD-Press.
Draper, N. R., & Smith, H. (1966). Applied Regression Analysis. New York: Wiley.
Neubrand, M., Biehler, R., Blum, W., Cohors-Fresenborg, E., Flade, L., Knoche, N., et al. (2001). Grundlagen der Ergänzung des internationalen OECD/PISA-Mathematik-Tests in der deutschen Zusatzerhebung. Zentralblatt für Didaktik der Mathematik, 33(2), 45–59.
Niss, M. (1999). Kompetencer og uddannelsesbeskrivelse. Uddannelse, 9, 21–29.
Niss, M. (2003). Mathematical Competencies and the Learning of Mathematics: The Danish KOM Project. In A. Gagatsis & S. Papastavridis (Eds.), 3rd Mediterranean Conference on Mathematical Education (pp. 115–124). Athens: The Hellenic Mathematical Society.
Niss, M., & Hoejgaard, T. (eds.) (2011) Competencies and mathematical learning. Ideas and inspiration for the development of mathematics teaching and learning in Denmark. English edition, October 2011 (IMFUFAtekst no. 485). Roskilde: Roskilde University.
OECD. (2003). The PISA 2003 Assessment Framework: Mathematics, Reading, Science and Problem Solving Knowledge and Skills. Paris: Directorate for Education, OECD.
OECD. (2004). Learning for Tomorrow's World – First Results from PISA 2003. Paris: Directorate for Education, OECD.
OECD. (2006). Assessing Scientific, Reading and Mathematical Literacy: A Framework for PISA 2006. Paris: Directorate for Education, OECD.
Planas, N. (2010). Pensar i comunicar matemàtiques. Barcelona: Fundació Prepedagogic.
Shrout, P. E., & Fleiss, J. L. (1979). Intraclass Correlations: Uses in Assessing Rater Reliability. Psychological Bulletin, 86(2), 420–428.
Von Eye, A., & Mun, E. Y. (2005). Analyzing rater agreement: manifest variable methods. Mahwah: Lawrence Erlbaum. www.ug.dk/uddannelser/professionsbacheloruddannelse/enkeltfag. Visited 19 May 2011.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Turner, R., Dossey, J., Blum, W., Niss, M. (2013). Using Mathematical Competencies to Predict Item Difficulty in PISA: A MEG Study. In: Prenzel, M., Kobarg, M., Schöps, K., Rönnebeck, S. (eds) Research on PISA. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4458-5_2
Download citation
DOI: https://doi.org/10.1007/978-94-007-4458-5_2
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-4457-8
Online ISBN: 978-94-007-4458-5
eBook Packages: Humanities, Social Sciences and LawEducation (R0)