Skip to main content
SpringerLink
Log in

Factors Influencing the Accuracy of Diagnostic Judgments

  • Chapter
  • First Online:
Diagnostic Competence of Mathematics Teachers

Part of the book series: Mathematics Teacher Education ((MTEN,volume 11))

Abstract

Diagnostic judgments suffer from several biases, one of which is the so-called ‘expert blind spot’. Looking at this phenomenon from a cognitive perspective helps to explain certain tendencies to misjudge students. The chapter reports empirical results about factors influencing diagnostic judgments from mathematics education and discusses the hypothesis that teachers underestimate the difficulty of tasks resp. overestimate the performance of students.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Section 2.1 is taken from Ostermann, Leuders and Philipp (2017, in press) and translated by the author.

References

  • Anders, Y., Kunter, M., Brunner, M., Krauss, S., & Baumert, J. (2010). Diagnostische Fähigkeiten von Mathematiklehrkräften und ihre Auswirkungen auf die Leistungen ihrer Schülerinnen und Schüler. [Mathematics teachers’ diagnostic skills and their impact on students’ achievements]. Psychologie in Erziehung und Unterricht, 57(3), 175–193.

    Article  Google Scholar 

  • Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching what makes it special? Journal of Teacher Education, 59(5), 389–407.

    Article  Google Scholar 

  • Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., & Tsai, Y.-M. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180.

    Article  Google Scholar 

  • Betsch, C. (2004). Präferenz für intuition und deliberation (PID). Zeitschrift für Differentielle und Diagnostische Psychologie, 25(4), 179–197.

    Article  Google Scholar 

  • Chi, M. T., Siler, S. A., & Jeong, H. (2004). Can tutors monitor students’ understanding accurately? Cognition and Instruction, 22(3), 363–387.

    Article  Google Scholar 

  • Dünnebier, K., Gräsel, C., & Krolak-Schwerdt, S. (2009). Urteilsverzerrungen in der schulischen Leistungsbeurteilung: Eine experimentelle Studie zu Ankereffekten. [Biases in teachers’ assessments of student performance: An experimental study of anchoring effects.] Zeitschrift für Pädagogische Psychologie, 23(34), 187–195.

    Article  Google Scholar 

  • Evans, J. S. B. (2008). Dual-processing accounts of reasoning, judgment, and social cognition. Annual Review of Psychology, 59, 255–278.

    Article  Google Scholar 

  • Gigerenzer, G., & Gaissmaier, W. (2011). Heuristic decision making. Annual Review of Psychology, 62, 451–482.

    Article  Google Scholar 

  • Hadjidemetriou, C., & Williams, J. (2002a). Children’s graphical conceptions. Research in Mathematics Education, 4(1), 69–87.

    Article  Google Scholar 

  • Hadjidemetriou, C., & Williams, J. (2002b). Teachers’ pedagogical content knowledge: Graphs, from a cognitivist to a situated perspective. In A. D. Cockburn & E. Nardi (Eds.), Proceedings of the 26th Conference of the International Group for the Psychology of Mathematics Education (Vol. 3, pp. 57–64). Norwich, UK: PME.

    Google Scholar 

  • Helmke, A., & Schrader, F.-W. (1987). Interactional effects of instructional quality and teacher judgement accuracy on achievement. Teaching and Teacher Education, 3(2), 91–98.

    Article  Google Scholar 

  • Herppich, S., Wittwer, J., Nückles, M., & Renkl, A. (2010). Do tutors’ content knowledge and beliefs about learning influence their assessment of tutees’ understanding. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32th Annual Conference of the Cognitive Science Society (pp. 314–319). New York, NY: Erlbaum.

    Google Scholar 

  • Hinds, P. J. (1999). The curse of expertise: The effects of expertise and debiasing methods on prediction of novice performance. Journal of Experimental Psychology: Applied, 5(2), 205–221.

    Google Scholar 

  • Hoge, R. D., & Coladarci, T. (1989). Teacher-based judgments of academic achievement: A review of literature. Review of Educational Research, 59(3), 297–313.

    Article  Google Scholar 

  • Kahneman, D. (2003). A perspective on judgment and choice: Mapping bounded rationality. American Psychologist, 58(9), 697.

    Article  Google Scholar 

  • Kaiser, J., Helm, F., Retelsdorf, J., Südkamp, A., & Möller, J. (2012). Zum Zusammenhang von Intelligenz und Urteilsgenauigkeit bei der Beurteilung von Schülerleistungen im Simulierten Klassenraum. [On the relation of intelligence and judgment accuracy in the process of assessing student achievement in the simulated classroom.] Zeitschrift für Pädagogische Psychologie, 26, 251–261.

    Google Scholar 

  • Karst, K. (2012). Kompetenzmodellierung des diagnostischen Urteils von Grundschullehrern. Münster, German: Waxmann.

    Google Scholar 

  • Karst, K., Schoreit, E., & Lipowsky, F. (2014). Diagnostische Kompetenzen von Mathematiklehrern und ihr Vorhersagewert für die Lernentwicklung von Grundschulkindern. Zeitschrift für Pädagogische Psychologie, 28(4), 237–248.

    Article  Google Scholar 

  • Kelley, C. M. (1999). Subjective experience as basis of “objective” judgments: Effects of past experience on judgments of difficulty. Effects of past experience on judgments of difficulty. In D. Gopher & A. Koriat (Hrsg.), Attention and performance (Bd. 17, S. 516–536). MIT Press.

    Google Scholar 

  • Klug, J., Bruder, S., Kelava, A., Spiel, C., & Schmitz, B. (2013). Diagnostic competence of teachers: A process model that accounts for diagnosing learning behavior tested by means of a case scenario. Teaching and Teacher Education, 30, 38–46.

    Article  Google Scholar 

  • Leuders, T., Bruder, R., Kroehne, U., Naccarella, D., Nitsch, R., Henning-Kahmann, J., & Wirtz, M. (2017). Development, validation, and application of a competence model for mathematical problem solving by using and translating representations of functions. In Competence Assessment in Education (pp. 389–406). Springer International Publishing.

    Google Scholar 

  • Leuders, T., Dörfler, T., Leuders, J., & Philipp, K. (2018). Diagnostic competence of mathematics teachers – unpacking a complex construct. In T. Leuders, K. Philipp, & J. Leuders (Eds.), Diagnostic competence of mathematics teachers. Cham: Springer.

    Google Scholar 

  • Lin, J. W., & Chiu, M. H. (2010). The mismatch between students’ mental models of acids/bases and their sources and their teacher’s anticipations thereof. International Journal of Science Education, 32(12), 1617–1646.

    Article  Google Scholar 

  • Morris, A. K., Hiebert, J., & Spitzer, S. M. (2009). Mathematical knowledge for teaching in planning and evaluating instruction: What can preservice teachers learn? Journal for Research in Mathematics Education, 40, 491–529.

    Google Scholar 

  • Nathan, M. J., & Koedinger, K. R. (2000). An investigation of teachers’ beliefs of students’ algebra development. Cognition and Instruction, 18(2), 209–237.

    Article  Google Scholar 

  • Nathan, M. J., & Petrosino, A. (2003). Expert blind spot among preservice teachers. American Educational Research Journal, 40(4), 905–928.

    Article  Google Scholar 

  • Nickerson, R. S. (1999). How we know—And sometimes misjudge—What others know: Imputing one’s own knowledge to others. Psychological Bulletin, 125(6), 737–795.

    Article  Google Scholar 

  • Nickerson, R. S. (2001). The projective way of knowing: A useful heuristic that sometimes misleads. Current Directions in Psychological Science, 10(5), 168–172.

    Article  Google Scholar 

  • Ostermann, A., Leuders, T., & Nückles, M. (2015). Wissen, was Schülerinnen und Schülern schwer fällt. Welche Faktoren beeinflussen die Schwierigkeitseinschätzung von Mathematikaufgaben? [Knowing what students know. Which factors influence teachers’ estimation of task difficulty?]. Journal für Mathematik-Didaktik, 36(1), 45–76.

    Article  Google Scholar 

  • Ostermann, A., Leuders, T., Philipp, K. (2017). Fachbezogene diagnostische Kompetenzen von Lehrkräften – Von Verfahren der Erfassung zu kognitiven Modellen zur Erklärung. In Leuders, T., Nückles, M., Mikelskis-Seifert, S. & Philipp, K. (Eds.), Pädagogische Professionalität in Mathematik und Naturwissenschaften. Springer

    Google Scholar 

  • Plessner, H., & Czenna, S. (2008). The benefits of intuition. In H. Plessner, C. Betsch, & T. Betsch (Eds.), Intuition in judgment and decision making (pp. 251–265). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Plessner, H., Freiberger, V., Kurle, A., & Ochs, K. (2006, May). Besser früh und spontan als spät und analytisch: Die Genauigkeit von Expertenvorhersagen für den FIFA Confed-erations Cup 2005 [Better early and spontaneous than late and analytic: The accuracy of expert predictions concerning the FIFA Confederations Cup 2005]. Paper presented at the 36th Meeting of the Arbeitsgemeinschaft Sportpsychologie in Münster, Germany.

    Google Scholar 

  • Rikers, R. M., Schmidt, H. G., & Boshuizen, H. P. (2000). Knowledge encapsulation and the intermediate effect. Contemporary Educational Psychology, 25(2), 150–166.

    Article  Google Scholar 

  • Schrader, F.-W. (2006): Diagnostische Kompetenz von Eltern und Lehrern (3. Aufl.). In D. H. Rost (Hrsg.), Handwörterbuch Pädagogische Psychologie (3. Aufl., S. 95–100). Weinheim, Germany: Beltz.

    Google Scholar 

  • Selter, C. (1995). Zur Fiktivität der Stunde Null im arithmetischen Anfangsunterricht. Mathematische Unterrichtspraxis, 16(2), 11–19.

    Google Scholar 

  • Spinath, B. (2005). Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz. [Accuracy of teacher judgments on student characteristics and the construct of diagnostic competence]. Zeitschrift für Pädagogische Psychologie, 19(1), 85–95.

    Article  Google Scholar 

  • Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology, 104(3), 743–762.

    Article  Google Scholar 

  • Südkamp, A., & Möller, J. (2009). Referenzgruppeneffekte im Simulierten Klassenraum: direkte und indirekte Einschätzungen von Schülerleistungen. [Reference-group-effects in a simulated classroom: Direct and indirect judgments.] Zeitschrift für Pädagogische Psychologie, 23(34), 161–174.

    Article  Google Scholar 

  • Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131.

    Article  Google Scholar 

  • Vollrath, H.-J. (1989). Funktionales Denken. Journal für Mathematik-Didaktik, 10(1), 3–37.

    Article  Google Scholar 

  • Wilson, T. D., & Schooler, J. W. (1991). Thinking too much: Introspection can reduce the quality of preferences and decisions. Journal of Personality and Social Psychology, 60(2), 181.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Education Freiburg, Freiburg, Germany

    Andreas Ostermann

Authors
  1. Andreas Ostermann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andreas Ostermann .

Editor information

Editors and Affiliations

  1. University of Education Freiburg, Freiburg, Germany

    Timo Leuders

  2. School of Education, University of Applied Sciences and Arts of Northwestern Switzerland, Basel, Switzerland

    Kathleen Philipp

  3. University of Education Freiburg, Freiburg, Germany

    Juliane Leuders

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ostermann, A. (2018). Factors Influencing the Accuracy of Diagnostic Judgments. In: Leuders, T., Philipp, K., Leuders, J. (eds) Diagnostic Competence of Mathematics Teachers. Mathematics Teacher Education, vol 11. Springer, Cham. https://doi.org/10.1007/978-3-319-66327-2_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-66327-2_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-66325-8

  • Online ISBN: 978-3-319-66327-2

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation