Skip to main content

Evaluating Learning Outcomes

  • Chapter
  • First Online:
Understanding Problems of Practice

Abstract

Classroom practitioners are often asked to adopt continually changing standards, to be collaborators and reflective practitioners, and to make new and evolving technologies an integral part of their practice. Understanding Problems of Practice: A Case Study in Design Research describes a process for thinking about and reflecting on innovative practice – the design research process. Each of the five phases of the design research process is exemplified by a discussion of how the authors used this process to create a technology education course for perspective secondary educators. In this chapter, the authors explore the fourth phase of the design research process, evaluating learning outcomes. Acknowledging that even though design decisions may result in powerful learning environments, they may not result in powerful learning. Thus, it is necessary in the fourth phase of the design research process to evaluate learning outcomes. The authors describe strategies and techniques recommended in the design research literature associated with evaluating learning outcomes. They conclude the chapter with the fourth phase of the design research project in which they describe how as classroom practitioners they used quantitative research methods to evaluate changes in teacher attitudes and technology knowledge.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Angeli, C., & Valanides, N. (2008, March). TCPK in preservice teacher education: Preparing primary education students to teach with technology. New York: Paper presented at the AERA annual conference.

    Google Scholar 

  • Bannan, B. (2013). The integrative learning design framework: An illustrated example from the domain of instructional technology. In T. Plomp & N. Nieveen (Eds.), Educational design research part A: An introduction (2nd ed., pp. 114–133). Enschede: Netherlands Institute for Curriculum Development (SLO).

    Google Scholar 

  • Bannan-Ritland, B. (2003). The role of design in research: The integrative learning design framework. Educational Researcher, 32(1), 21–24.

    Article  Google Scholar 

  • Borko, H., & Putnam, R. T. (1995). Expanding a teacher’s knowledge base: A cognitive psychological perspective on professional development. In T. R. Guskey & M. Huberman (Eds.), Professional development in education: New paradigms & practices (pp. 35–66). New York: Teachers College Press.

    Google Scholar 

  • Cullen, T. A., & Greene, B. A. (2011). Preservice teachers’ beliefs, attitudes, and motivation about technology integration. Journal of Educational Computing Research, 45(1), 29–47.

    Article  Google Scholar 

  • Ertmer, P., & Ottenbriet-Leftwich, A. T. (2010). Teacher technology change: How knowledge, confidence, beliefs, and culture intersect. Journal of Research on Technology in Education, 42(3), 255–284.

    Article  Google Scholar 

  • Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley. Retrieved from http://people.umass.edu/aizen/f&a1975.html.

    Google Scholar 

  • Hathaway, D., & Norton, P. (2016). A preservice secondary education technology course: Attitudes, knowledge, and learner outcomes. In L. Liu & D. C. Gibson (Eds.), Research highlights in technology and teacher education 2016 (pp. 119–126). Chesapeake, VA: AACE.

    Google Scholar 

  • McKenney, S., & Reeves, T. C. (2012). Conducting educational design research. New York: Routledge.

    Google Scholar 

  • McMillan, J. H., & Schumacher, S. (2001). Research in education: A conceptual introduction (5th ed.). New York: Longman.

    Google Scholar 

  • Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017–1054.

    Article  Google Scholar 

  • Palak, D., & Walls, R. (2009). Teachers’ beliefs and technology practices: A mixed-methods approach. Journal of Research on Technology in Education, 41(4), 417–441.

    Article  Google Scholar 

  • Pelton, L., & Pelton, T. W. (1996). Building attitudes: How a technology course affects preservice teachers’ attitudes about technology. Technology and Teacher Education Annual, 1996, 167–172.

    Google Scholar 

  • Razzak, N. A. (2014). In-service teachers’ attitudes towards technology integration in the Bahraini classroom. World Journal on Educational Technology, 6(1), 60–74.

    Google Scholar 

  • Sang, G., Valcke, M., van Braak, J., & Tondeur, J. (2010). Student teachers’ thinking processes and ICT integration: Predictors of prospective teaching behaviors with educational technology. Computers & Education, 54, 103–112.

    Article  Google Scholar 

  • Sauro, J. (2013, August 13). Best practices for using statistics on small sample sizes. Measuring Usability. Retrieved from http://www.measuringu.com/blog/small-n.php

  • Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological, pedagogical content knowledge (TPACK): The development and validation of an assessment instrument for preservice teachers. Journal of Research on Technology in Education, 42(2), 123–149.

    Article  Google Scholar 

  • Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Association for Educational Communications and Technology (AECT)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hathaway, D., Norton, P. (2018). Evaluating Learning Outcomes. In: Understanding Problems of Practice. SpringerBriefs in Educational Communications and Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-77559-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77559-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77558-6

  • Online ISBN: 978-3-319-77559-3

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics