Skip to main content

Theories of Training Program Evaluation Frameworks and Methodologies

  • Chapter
  • First Online:
English Language Training in the Workplace
  • 817 Accesses

Abstract

This book investigates the training effectiveness of workplace English programs, the comprehensive impact, and the influencing factors in different business contexts.

The conceptual framework also contains a critical review of the literature on workplace English training program evaluation. The program evaluation is composed of process evaluation , impact evaluation, and effectiveness evaluation. There are also the cost-benefit analysis methodologies which are applicable in evaluating workplace English training programs. Theories of language program evaluation frameworks are also included. Different program evaluation models depicting the program evaluation process have been reviewed.

Based on the program evaluation models, a unique evaluation framework based on relevant curriculum evaluation models suited to the workplace English program context is developed and applied to evaluating workplace English training programs in the Chinese context, which has been missing in the previous literature. This newly constructed evaluation framework examines various aspects of the workplace English training program development and implementation, drawing on those important factors from the conceptual framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adamson, B., & Morris, P. (2007). Comparing curricula. In M. Bray, B. Adamson, & M. Mason (Eds.), Comparative education research: Approaches and methods (pp. 263–282). Hong Kong, Hong Kong: Comparative Education Research Centre, The University of Hong Kong; Dordrecht, The Netherlands: Springer.

    Google Scholar 

  • Basturkmen, H. (2010). Developing courses in English for specific purposes. Basingstoke, UK: Palgrave Macmillan.

    Book  Google Scholar 

  • Belfiore, M. E., & Burnaby, B. (1995). Teaching English in the workplace. Toronto, ON: OISE Press.

    Google Scholar 

  • Bingham, R. D., & Felbinger, C. L. (1989). Evaluation in practice: A methodological approach. New York: Longman.

    Google Scholar 

  • Buckley, R., & Caple, J. (2009). The theory and practice of training (6th ed.). London: Kogan Page.

    Google Scholar 

  • Cedefop. (2007). Fundamentals of a Common Quality Assurance Framework (CQAF) for VET in Europe. Luxembourg, Luxembourg: Office for Official Publications of the European Communities.

    Google Scholar 

  • Chan, W., & Suen, W. (2000). An evaluation of the Hong Kong employees retraining program. Asian Economic Journal, 14(3), 255–281.

    Article  Google Scholar 

  • Chen, H.-T. (2005). Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA: Sage Publications.

    Book  Google Scholar 

  • Cheng, A. (2006). Understanding learners and learning in ESP genre-based instruction. English for Specific Purposes, 25, 76–89.

    Article  Google Scholar 

  • Cheng, A. (2011). ESP classroom research: Basic considerations and future research questions. In D. Belcher, A. M. Johns, & B. Paltridge (Eds.), New directions in English for specific purposes research (pp. 44–72). Ann Arbor, MI: University of Michigan Press.

    Google Scholar 

  • Cheung, J. T.-Y., & Tang, K.-L. (1997). Models of workplace training: Lessons from the employees retraining scheme in Hong Kong (Mellen studies in business, Vol. 9). Lampeter, UK: The Edwin Mellen Press.

    Google Scholar 

  • Diamantidis, A. D., & Chatzoglou, P. D. (2012). Evaluation of formal training programmes in Greek organizations. European Journal of Training and Development, 36(36), 888–910.

    Article  Google Scholar 

  • Fisher, R., Iredale, A., Ollin, R., & Robinson, D. (2010). Evaluation and quality assurance. In J. Avis, R. Fisher, & R. Thompson (Eds.), Teaching in lifelong learning: A guide to theory and practice (pp. 238–245). Berkshire, UK: Open University Press, McGraw-Hill Education.

    Google Scholar 

  • Fretwell, D. (2003). A framework for evaluating Vocational Education and Training (VET). European Journal of Education, 38, 2.

    Article  Google Scholar 

  • Gillet, A., & Wray, L. (2006). EAP and success. In A. Gillet & L. Wray (Eds.), Assessing the effectiveness of EAP programmes (pp. 1–11). London: British Association of Lectures in English for Academic Purposes.

    Google Scholar 

  • Graaff, R. D., & Housen, A. (2009). Investigating the effects and effectiveness of L2 instruction. In M. H. Long & C. J. Doughty (Eds.), The handbook of language teaching (pp. 726–747). Chichester, UK: Wiley-Blackwell.

    Chapter  Google Scholar 

  • Grognet A. G. (1996). Planning, implementing, and evaluating workplace ESL programs. Center for Applied Linguistics, Project in Adult Immigrant Education (PAIE), http://www.cal.org/caela/esl_resources/digests/planningqa.html

  • Harding, K. (2007). English for specific purposes. Oxford, UK: Oxford University Press.

    Google Scholar 

  • Hubball, H. T., & Burt, H. D. (2004). An integrated approach to developing and implementing learning-centred curricula. International Journal for Academic Development, 9(1), 51–65.

    Article  Google Scholar 

  • Hutchinson, T., & Waters, A. (1987). English for specific purposes: A learning centered approach. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Jacob, L., & De Wet, C. (2013). Evaluation of the vocational education orientation programme (VEOP) at a university in South Africa. The International Review of Research in Open and Distance Learning, 14(4), 68–89.

    Google Scholar 

  • Johns A. M., & Dudley-Evans T. (1991). English for specific purposes: International in scope, specific in purpose. TESOL Quarterly, 25, 297–314. In H. Basturkmen (Ed.) (2010), Developing courses in English for specific purposes (p. 9). Basingstoke, UK: Palgrave Macmillan.

    Google Scholar 

  • Jurmo P. (1997). Evaluation of western suffolk BOCES workplace education program. Learning Partnership, East Brunswick, NY. Office of Vocational and Adult Education.

    Google Scholar 

  • Kiely, R., & Rea-Dickins, P. (2005). Program evaluation in language education. Basingstoke, UK: Palgrave Macmillan.

    Book  Google Scholar 

  • Kim, D. (2008). English for occupational purposes: One language? London: Continuum.

    Google Scholar 

  • Kirkpatrick, D. (1950). The Kirkpatrick model. http://www.kirkpatrickpartners.com/OurPhilosophy/tabid/66/Default.aspx.

  • Lam, P. W. Y., Cheng, W., & Kong, K. C. C. (2014). Learning English through workplace communication: An evaluation of existing resources in Hong Kong. English for Specific Purposes, 34, 68–78.

    Article  Google Scholar 

  • Li Y. J. (2012). Zhiye jiaoyu xiaoyi: jiben shiyu yu tiaojian zhichi [TVET Benefits: Basic Horizon and Support], Zhiye jishu jiaoyu [Vocational and Technical Education], 2012(1).

    Google Scholar 

  • Lynch, B. K. (1996). Language program evaluation: Theory and practice. In M. H. Long & J. C. Richards (Eds.), Cambridge applied linguistics. Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Marsh, C. J. (2004). Key concepts for understanding curriculum. London: Routledge.

    Book  Google Scholar 

  • Master, P. (2005). English for specific purposes. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 99–115). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Melkman, A., & Trotman, J. (2005). Training international managers: Designing, deploying and delivering effective training for multi-cultural groups. Aldershot, UK: Gower Publishing Limited.

    Google Scholar 

  • Morrison B. J. (2003). The development of a framework for the evaluation of a self-access language learning centre. Doctoral dissertations, Hong Kong Polytechnic University. http://library.polyu.edu.hk/record=b1714682

  • Morrison, B. J. (2005). Evaluating learning gain in a self-access language learning centre. Language Teaching Research, 9(3), 267–293.

    Article  Google Scholar 

  • Mouzakitis, G. S. (2010). The role of vocational education and training curricula in economic development. Procedia Social and Behavioral Sciences, 2(2010), 3914–3920.

    Article  Google Scholar 

  • Nunan, D., & Burton, J. (1989). English for the workplace vocational proficiency: A curriculum framework for adult second language learners. A National Curriculum Project, NSW: National Center for English Language Teaching and Research, Macquarie University.

    Google Scholar 

  • Owen, J. M. (1993). Program evaluation: Forms and approaches. St Leonards, New South Wales: Allen & Unwin.

    Google Scholar 

  • Paltridge, B. (2012). Teaching English for specific purposes. In A. Burns & J. Richards (Eds.), The Cambridge guide to pedagogy and practice in second language teaching (pp. 179–185). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Percival, J. C., Cozzarin, B. P., & Formaneck, S. D. (2013). Return on investment for workplace training: The Canadian experience. International Journal of Training and Development, 17(1), 20–32.

    Article  Google Scholar 

  • Praslova, L. (2010). Adaptation of Kirkpatrick’s four level model of training criteria to assessment of learning outcomes and program evaluation in Higher Education. Educational Assessment Evaluation and Accountability, 22, 215–225.

    Article  Google Scholar 

  • Räisänen, A., & Räkköläinen, M. (2009). Social and communicational skills in upper secondary vocational education and training. U.S.-China Education Review, 6(12) (Serial No. 61), 36.

    Google Scholar 

  • Riddiford, N. (2011). Helping skilled migrants intoar employment: The workplace communication program. In J. Macalister & Nation, I.S.P (Eds.), Case studies in language curriculum design: Concepts and approaches in action around the world (ESL & Applied Linguistics Professional Series, pp. 72–81). New York: Routledge, Taylor & Francis Group.

    Google Scholar 

  • Smidt, A., Balandin, S., Sigafoos, J., & Reed, V. A. (2009). The Kirkpatrick model: A useful tool for evaluating training outcomes. Journal of Intellectual & Developmental Disability, 34(3), 266–274.

    Article  Google Scholar 

  • Tabbron, G., & Yang, J. (1997). The interaction between Technical and Vocational Education and Training (TVET) and economic development in advanced countries. International Journal of Educational Development, 17(3), 323–334.

    Article  Google Scholar 

  • Tsou, W. L., & Chen, F. (2014). ESP program evaluation framework: Description and application to a Taiwanese university ESP program. English for Specific Purposes, 33, 39–53.

    Article  Google Scholar 

  • Vitello, R. (2013). Operating a workplace English language program: FAQs for employers. English Works. http://www.english-works.org/Pdfs/Operating%20a%20Workplace%20ESOL%20Program.pdf.

  • Zhu X. S., & Xie Z.-Q. (2011). Empirical study on the contribution of secondary vocational education in industrial structure adjusting – an analysis based on Suzhou, Wuxi and Changzhou. Vocational and Technical Education 16, 32(650), 29–33.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Xie, Q. (2016). Theories of Training Program Evaluation Frameworks and Methodologies. In: English Language Training in the Workplace. Technical and Vocational Education and Training: Issues, Concerns and Prospects, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-319-30157-0_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-30157-0_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-30155-6

  • Online ISBN: 978-3-319-30157-0

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics