Skip to main content
SpringerLink
Log in

A Standardized Approach for Measuring Teachers’ Professional Vision: The Observer Research Tool

  • Chapter
  • First Online:
Teacher Noticing: Bridging and Broadening Perspectives, Contexts, and Frameworks

Part of the book series: Research in Mathematics Education ((RME))

Abstract

In this chapter, we introduce the Observer Research Tool that has been proven to measure teachers’ professional vision in a valid and reliable way. Teachers’ professional vision is seen as a promising approach to investigate the effectiveness of teachers’ professional development in light of the demands of real teaching practice. The Observer Research Tool was developed as the first standardized instrument that combines videotaped classroom situations with rating items. Step by step, we discuss the single components of the instruments in order to illustrate how to best guarantee validity in assessing teachers’ professional vision.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Bauer, J., & Prenzel, M. (2012). European teacher training reforms. Science, 336(6089), 1642–1643. doi:10.1126/science.1218387

    Article  Google Scholar 

  • Baumert, J., Kunter, M., Blum, W., Brunner, M., Voss, T., Jordan, A., et al. (2010). Teachers’ mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47(1), 133–180.

    Article  Google Scholar 

  • Berliner, D. C. (2001). Learning about and learning from expert teachers. International Journal of Educational Research, 35(5), 463–482.

    Article  Google Scholar 

  • Blomberg, G., Renkl, A., Sherin, M., Borko, H., & Seidel, T. (2013). Five research-based heuristics for using video in preservice teacher education. Journal of Educational Research Online, 5(1), 90–114.

    Google Scholar 

  • Blomberg, G., Stürmer, K., & Seidel, T. (2011). How pre-service teachers observe teaching on video: Effects of viewers’ teaching subjects and the subject of the video. Teaching and Teacher Education, 27(7), 1131–1140.

    Article  Google Scholar 

  • Buff, A., Reusser, K., Rakoczy, K., & Pauli, C. (2011). Activating positive affective experiences in the classroom: “Nice to have” or something more? Learning and Instruction, 21(3), 452–466. doi:10.1016/j.learninstruc.2010.07.008.

  • Blömeke, S., Gustafson, J.-E., & Shavelson, R. (2015). Beyond dichotomies: Competence viewed as a continuum. Journal for Psychology, 223(1), 3–13. doi:10.1027/2151-2604/a000194

    Google Scholar 

  • Blömeke, S., Kaiser, G., Lehmann, R., Felbich, A., & Müller, C. (2006). Learning to teach mathematics—Teacher education and development study (TEDS-M). Berlin: Humboldt-Universität.

    Google Scholar 

  • Bolhuis, S. (2003). Towards process-oriented teaching for self-directed lifelong learning: A multidimensional perspective. Learning and Instruction, 13(3), 327–347. doi:10.1016/s0959-4752(02)00008-7

    Article  Google Scholar 

  • Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3–15. doi:10.3102/0013189x033008003

    Article  Google Scholar 

  • Borko, H., Jacobs, J. K., Eiteljorg, E., & Pittman, M. E. (2008). Video as a tool for fostering productive discussions in mathematics professional development. Teaching and Teacher Education, 24(2), 417–436. doi:10.1016/j.tate.2006.11.012

    Article  Google Scholar 

  • Brophy, J. (Ed.). (2004). Using video in teacher education. New York: Elsevier.

    Google Scholar 

  • Brouwer, N., & Korthagen, F. (2005). Can teacher education make a difference? American Educational Research Journal, 42(1), 153–224. doi:10.3102/00028312042001153

    Article  Google Scholar 

  • Cochran-Smith, M. (2003). Assessing assessment in teacher education. Journal of Teacher Education, 54(3), 187–191.

    Article  Google Scholar 

  • Darling-Hammond, L. (2006). Assessing teacher education: The usefulness of multiple measures for assessing program outcomes. Journal of Teacher Education, 57(2), 120–138. doi:10.1177/0022487105283796

    Article  Google Scholar 

  • Darling-Hammond, L., & Bransford, J. D. (Eds.). (2005). Preparing teachers for a changing world: What teachers should learn and be able to do. San Francisco: Jossey-Bass.

    Google Scholar 

  • Deci, E., & Ryan, R. M. (Eds.). (2004). Handbook of self-determination research. Rochester, NY: University of Rochester Press.

    Google Scholar 

  • de Jong, T., & Ferguson-Hessler, M. G. M. (1996). Types and qualities of knowledge. Educational Psychologist, 31, 105–113.

    Google Scholar 

  • Döhrmann, M., Kaiser, G., & Blömeke, S. (2012). The conceptualisation of mathematics competencies in the international teacher education study TEDS-M. ZDM The International Journal on Mathematics Education, 44(3), 325–340.

    Article  Google Scholar 

  • Erickson, F. (2011). Mathematics teacher noticing: Seeing through teachers’ eyes. In M. G. Sherin, V. R. Jacobs, & R. A. Philipp (Eds.), On noticing teacher noticing (pp. 17–34). New York: Routledge.

    Google Scholar 

  • Ericson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363–406.

    Article  Google Scholar 

  • Fraser, B. J., Walberg, H. J., Welch, W. W., & Hattie, J. A. (1987). Syntheses of educational productivity research. International Journal of Educational Research, 11(2), 145–252.

    Article  Google Scholar 

  • Fuchs, D., Fuchs, L. S., Benowitz, S., & Barringer, K. (1987). Norm-referenced tests: Are they valid for use with handicapped students? Exceptional Children, 54(3), 263–271.

    Google Scholar 

  • Goldman, R., Pea, R., Barron, B., & Denny, S. J. (Eds.). (2007). Video research in the learning sciences. Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Goldstein, G., & Hersen, M. (2000). Handbook of psychological assessment. Oxford: Elsevier Science.

    Google Scholar 

  • Goodwin, C. (1994). Professional vision. American Anthropologist, 96(3), 606–633. doi:10.1525/aa.1994.96.3.02a00100

    Article  Google Scholar 

  • Grossman, P., Compton, C., Igra, D., Ronfeldt, M., Shahan, E., & Williamson, P. W. (2009). Teaching practice: A cross-professional perspective. Teachers College Record, 111(9), 2055–2100.

    Google Scholar 

  • Hammerness, K., Darling-Hammond, L., & Shulman, L. S. (2002). Toward expert thinking: How curriculum case writing prompts the development of theory-based professional knowledge in student teachers. Teaching Education, 13(2), 219–243.

    Article  Google Scholar 

  • Hattie, J. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to Achievement. New York: Routledge.

    Google Scholar 

  • Hill, H. C., Rowan, B., & Ball, D. L. (2005). Effects of teachers’ mathematical knowledge for teaching on student achievement. American Educational Research Journal, 42(2), 371–406. doi:10.3102/00028312042002371

    Article  Google Scholar 

  • Jahn, G., Prenzel, M., Stürmer, K., & Seidel, T. (2011). Varianten einer computergestützten Erhebung von Lehrerkompetenzen. [The computer-based assessment of teachers’ competencies]. Unterrichtswissenschaft, 39(2), 136–153.

    Google Scholar 

  • Jahn, G., Stürmer, K., Seidel, T., & Prenzel, M. (2014). Professionelle Unterrichtswahrnehmung von Lehramtsstudierenden - Eine Scaling-up Studie des Observe-Projekts. [Pre-service teachers’ professional vision. A scaling up study of the Observer project]. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 46(4), 171–180.

    Google Scholar 

  • Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19(4), 509–539. doi:10.1007/s10648-007-9054-3

    Article  Google Scholar 

  • Kane, M. (1994). Validating the performance standards associated with passing scores. Review of Educational Research, 64(3), 425–461. doi:10.3102/00346543064003425

    Article  Google Scholar 

  • Kersting, N. (2008). Using video clips of mathematics classroom instruction as item prompts to measure teachers’ knowledge of teaching mathematics. Educational and Psychological Measurement, 68(5), 845–861.

    Article  Google Scholar 

  • König, J., Blömeke, S., Klein, P., Suhl, U., Busse, A., & Kaiser, G. (2014). Is teachers’ general pedagogical knowledge a premise for noticing and interpreting classroom situations? A video-based assessment approach. Teaching and Teacher Education, 38, 76–88.

    Article  Google Scholar 

  • Kunter, M., Baumert, J., & Köller, O. (2007). Effective classroom management and the development of subject-related interest. Learning and Instruction, 17(5), 494–509.

    Article  Google Scholar 

  • Lipowsky, F., Rakoczy, K., Pauli, C., Drollinger-Vetter, B., Klieme, E., & Reusser, K. (2009). Quality of geometry instruction and its short-term impact on students’ understanding of the Pythagorean Theorem. Learning and Instruction, 19(6), 527–537. doi:10.1016/j.learninstruc.2008.11.001

    Article  Google Scholar 

  • Miller, K., & Zhou, X. (2007). Learning from classroom video: What makes it compelling and what makes it hard. In R. Goldmann, R. Pea, B. Barron, & S. J. Derry (Eds.), Video Research in the Learning Sciences (pp. 321–334). Mahwah, N.J.: Lawrence Erlbaum.

    Google Scholar 

  • Oser, F., Heinzer, S., & Salzmann, P. (2010). Die Messung der Qualität von professionellen Kompetenzprofilen von Lehrpersonen. [Assessing the quality of teachers’ competence profiles]. Unterrichtswissenschaft, 38(1), 5–29.

    Google Scholar 

  • Palmeri, T. J., Wong, A. C. N., & Gauthier, I. (2004). Computational approaches to the development of perceptual expertise. Trends in Cognitive Sciences, 8(8), 378–386. doi:10.1016/j.tics.2004.06.001

    Article  Google Scholar 

  • Popham, W. J. (1971). Criterion-referenced measurement. Englewood Cliffs, NJ: Educational Technology Publication.

    Google Scholar 

  • Reusser, K. (2005). Videoportal. Retrieved from http://www.didac.uzh.ch/videoportal/.

  • Santagata, R., & Angelici, G. (2010). Studying the impact of the lesson analysis framework on preservice teachers’ abilities to reflect on videos of classroom teaching. Journal of Teacher Education, 61(4), 339–349. doi:10.1177/0022487110369555

    Article  Google Scholar 

  • Seidel, T. (2012). Implementing competence assessment in university education. Empirical Research in Vocational Education and Training, 4(1), 91–94.

    Google Scholar 

  • Seidel, T., Blomberg, G., & Renkl, A. (2013). Instructional strategies for using video in teacher education. Teaching and Teacher Education, 34, 56–65. doi:10.1016/j.tate.2013.03.004

    Article  Google Scholar 

  • Seidel, T., Blomberg, G., & Stürmer, K. (2010a). Observer: Video-based tool to diagnose teachers’ professional vision. [Software]. Unpublished instrument. Retrieved from http://ww3.unipark.de/uc/observer_engl/demo/kv/

  • Seidel, T., Blomberg, G., & Stürmer, K. (2010b). “Observer”—validation of a video-based instrument for measuring the perception of professional education. Zeitschrift für Pädagogik, 296–306.

    Google Scholar 

  • Seidel, T., & Prenzel, M. (2007). Wie Lehrpersonen Unterricht wahrnehmen und einschätzen – Erfassung pädagogisch-psychologischer Kompetenzen bei Lehrpersonen mit Hilfe von Videosequenzen. [How teacher observe and interpret instruction - the assessment of pedagogical-psycological competencies with videotaped classroom situations]. Zeitschrift Fur Erziehungswissenschaft, Sonderheft, 8, 201–218.

    Google Scholar 

  • Seidel, T., Prenzel, M., & Kobarg, M. (Eds.). (2005a). How to run a video study: Technical report of the IPN Video Study. Münster: Waxmann.

    Google Scholar 

  • Seidel, T., Rimmele, R., & Prenzel, M. (2003). Opportunities for learning motivation in classroom discourse—combination of video analysis and student questionnaires. Unterrichtswissenschaft, 31(2), 142–165.

    Google Scholar 

  • Seidel, T., Rimmele, R., & Prenzel, M. (2005b). Clarity and coherence of lesson goals as a scaffold for student learning. Learning and Instruction, 15(6), 539–556. doi:10.1016/j.learninstruc.2005.08.004

    Article  Google Scholar 

  • Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. doi:10.3102/0034654307310317

    Article  Google Scholar 

  • Seidel, T., & Stürmer, K. (2014). Modeling and measuring the structure of professional vision in preservice teachers. American Educational Research Journal, 51(4), 739–771. doi:10.3102/0002831214531321

    Article  Google Scholar 

  • Shavelson, R. J. (2012). Assessing business-planning competence using the Collegiate Learning Assessment as a prototype. Empirical Research in Vocational Education and Training, 4(1), 77–90.

    Google Scholar 

  • Sherin, M. G. (2007). The development of teachers’ professional vision in video clubs. In R. Goldman, R. Pea, B. Barron, & S. J. Derry (Eds.), Video research in the learning sciences (pp. 383–395). Mahwah, N.J.: Lawrence Erlbaum.

    Google Scholar 

  • Sherin, M. G., Jacobs, V. R., & Phillip, R. A. (2011). Situating the study of teacher noticing. In M. G. Sherin, V. R. Jacobs, & R. A. Philipp (Eds.), Mathematics teacher noticing: Seeing through teachers’ eyes (pp. 3–13). New York: Routledge.

    Google Scholar 

  • Sherin, M. G., Linsenmeier, K. A., & van Es, E. A. (2009). Selecting video clips to promote mathematics teachers’ discussion of student thinking. Journal of Teacher Education, 60(3), 213–230. doi:10.1177/0022487109336967

    Article  Google Scholar 

  • Sherin, M. G., & van Es, E. A. (2009). Effects of video club participation on teachers’ professional vision. Journal of Teacher Education, 60(1), 20–37. doi:10.1177/0022487108328155.

  • Shulman, L. S. (1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57(1), 1–22.

    Article  Google Scholar 

  • Star, J. R., & Strickland, S. K. (2008). Learning to observe: Using video to improve preservice mathematics teachers’ ability to notice. Journal of Mathematics Teacher Education, 11(2), 107–125. doi:10.1007/s10857-007-9063-7

    Article  Google Scholar 

  • Steffensky, M., Gold, B., Holodynski, M., & Möller, K. (2015). Professional vision of classroom management and learning support in science classrooms—does professional vision differ across general and content-specific classroom interactions? International Journal of Science and Mathematics Education, 13(2), 351–368. doi:10.1007/s10763-014-9607-0

    Article  Google Scholar 

  • Stürmer, K., Könings, K. D., & Seidel, T. (2013a). Declarative knowledge and professional vision in teacher education: Effect of courses in teaching and learning. British Journal of Educational Psychology, 83(3), 467–483. doi:10.1111/j.2044-8279.2012.02075.x

    Article  Google Scholar 

  • Stürmer, K., & Seidel, T. (2015). Assessing professional vision in teacher candidates: Approaches to validating the Observer Extended Research Tool. Journal of Psychology, 223(1), 54–63. doi:10.1027/2151-2604/a000200

    Google Scholar 

  • Stürmer, K., Seidel, T., & Schäfer, S. (2013). Changes in professional vision in the context of practice. Preservice teachers´ professional vision changes following practical experience: A video-based approach in university-based teacher education. Gruppendynamik & Organisationsberatung, 44(3). doi:10.1007/s11612-013-0216-0

  • van Es, E., & Sherin, M. G. (2002). Learning to notice: Scaffolding new teachers’ interpretations of classroom interactions. Journal of Educational Psychology, 10(4), 571–596.

    Google Scholar 

  • van Es, E., & Sherin, M. G. (2008). Mathematics teachers’ “learning to notice” in the context of a video club. Teaching and Teacher Education, 24(2), 244–276. doi:10.1016/j.tate.2006.11.005

    Article  Google Scholar 

  • van Es, E. A. (2009). Participants’ roles in the context of a video club. Journal of the Learning Sciences, 18(1), 100–137. doi:10.1080/10508400802581668.

  • Voss, T., Kunter, M., & Baumert, J. (2011). Assessing teacher candidates’ general pedagogical/psychological knowledge: test construction and validation. Journal of Educational Psychology, 103(4), 952–969. doi:10.1037/a0025125

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Technical University of Munich, Munich, Germany

    Kathleen Stürmer & Tina Seidel

Authors
  1. Kathleen Stürmer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tina Seidel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kathleen Stürmer .

Editor information

Editors and Affiliations

  1. Morehead State University, Morehead, Kentucky, USA

    Edna O. Schack

  2. University of Kentucky, Lexington, Kentucky, USA

    Molly H. Fisher

  3. STEM Education, University of Kentucky, Lexington, Kentucky, USA

    Jennifer A. Wilhelm

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Stürmer, K., Seidel, T. (2017). A Standardized Approach for Measuring Teachers’ Professional Vision: The Observer Research Tool. In: Schack, E., Fisher, M., Wilhelm, J. (eds) Teacher Noticing: Bridging and Broadening Perspectives, Contexts, and Frameworks. Research in Mathematics Education. Springer, Cham. https://doi.org/10.1007/978-3-319-46753-5_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46753-5_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46752-8

  • Online ISBN: 978-3-319-46753-5

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation