Magnitudes of Impact: A Three-Level Review of Evidence from Scholarship Evaluation

  • Matt Mawer


Research on international scholarship program outcomes has proliferated during the last decade. This chapter reviews the literature to establish ‘what we know’ from these analyses. Focusing the critique at three levels—individual, institutional, and societal—the chapter draws out themes from government reports, consultant-led evaluation, academic papers, and other ‘grey’ literature. At the individual level, career outcomes, attitudinal change, and intercultural gains are explored. At the institutional level, the usefulness of international study to organizational development, and the impacts of individual mobility and critical mass are examined. At the societal level, evidence for socio-political, civic, economic, and diplomatic impacts is discussed. The chapter concludes by arguing that comparative research and greater focus on ‘complex’ questions about outcomes are necessary to advance understanding.


  1. Asian Development Bank [ADB]. (2007). ADB’s Japan funds: Japan Scholarship Program, Manilla: Asian Development Bank.Google Scholar
  2. Atkinson, C. (2010). Does soft power matter? A comparative analysis of student exchange programs, 1980–2006. Foreign Policy Analysis, 6(1), pp. 1–22.Google Scholar
  3. Atkinson, C. (2015). The role of U.S. elite military schools in promoting intercultural understanding and democratic governance. All Azimuth, 4(2), pp. 19–29.Google Scholar
  4. Barnard, H., Cowan, R. and Müller, M. (2016). On the value of foreign PhDs in the developing world: Training versus selection effects, UNU-MERIT: Maastricht.Google Scholar
  5. Campbell, A. (2016). International scholarship graduates influencing social and economic development at home: The role of alumni networks in Georgia and Moldova. Current Issues in Comparative Education, 19(1), pp. 76–91.Google Scholar
  6. Chalid, M.N.H. (2014). Soft skills, intercultural competency and transnational education: An Australian-Indonesian case study. International Journal of Arts and Sciences, 7(1), pp. 359–373.Google Scholar
  7. Chauvet, L. and Mercier, M. (2014). Do return migrants transfer political norms to their origin country? Evidence from Mali. Journal of Comparative Economics 42 (3), pp. 630–651.CrossRefGoogle Scholar
  8. Chesterfield, R. and Dant, W. (2013). Evaluation of LAC Higher Education Scholarships Program: Final report, North Bethesda, MD: JBS International.Google Scholar
  9. Constant, A. and Tien, B. (2010), African Leaders: Their Education Abroad and FDI Flows, IZA Discussion Paper no. 5353. IZA, Bonn.Google Scholar
  10. DAAD. (2013), Knowledge – Action – Change Three alumni surveys in review 25 years of DAAD postgraduate courses, Bonn: Deutscher Akademischer Austauschdienst [DAAD].Google Scholar
  11. DAMVAD. (2012). Evaluation of the Quota Scheme 2001–2012 Assessing impact in higher education and development, Oslo: DAMVAD.Google Scholar
  12. Dong, L. and Chapman, D. (2008). The Chinese Government Scholarship Program: An effective form of foreign assistance?. International review of education, 54(2), pp. 155–173.CrossRefGoogle Scholar
  13. Dreher, A. and Yu, S. (2016). The Alma Mater Effect – Does Foreign Education of Political Leaders Influence Foreign Policy? CESifo Working Paper Series No. 5871. Munich: CESifo.Google Scholar
  14. Grigg, T. (2016). The Atlantic Philanthropies-University of Queensland Vietnamese Scholarship Program 2000–2006: Assessing the Impact, Queensland, Au: Carisgold Pty.Google Scholar
  15. Hinz, S., Scurfield, K., Barabhuiya, F. and Day, R. (2013). Evaluating Commonwealth Scholarships in the United Kingdom: Assessing impact in environmental sustainability, London: Commonwealth Scholarship Commission in the UK.Google Scholar
  16. Kalisman, H.F. (2015). Bursary Scholars at the American University of Beirut: Living and Practising Arab Unity. British Journal of Middle Eastern Studies, 42(4), pp. 599–617.CrossRefGoogle Scholar
  17. Kent, A. (2012). Australian Development Scholarships and their place within diplomacy, education and development., University of Melbourne: Unpublished Dissertation.Google Scholar
  18. Mansukhani, V. and Handa, N. (2013). Opening doors: Ten years of the Ford Foundation International Fellowships Program in India, New Delhi: Ford Foundation International Fellowships Program.Google Scholar
  19. Marsh, R., Baxter, A., Di Genova, L., Jamison, A., and Madden, M. (2016). Career Choices, Return Paths and Social Contributions: The African Alumni Project, Full Report, Toronto: The MasterCard Foundation.Google Scholar
  20. Martel, M. and Bhandari, R. (2016). Social Justice and Sustainable Change: The impacts of higher education, New York: Institute of International Education.Google Scholar
  21. Mawer, M. (2014). Trajectories and impact of UK Commonwealth Scholarship and Fellowship Programme alumni: Interim quantitative analysis, London: Commonwealth Scholarship Commission in the UK.Google Scholar
  22. Mawer, M., Quraishi, S. and Day, R. (2016). Successes and complexities: the outcomes of UK Commonwealth Scholarships 1960–2012, London: Commonwealth Scholarship Commission in the UK.Google Scholar
  23. Mellors-Bourne, R., Jones, E. and Woodfield, S. (2015). Transnational education and employability development, York: Higher Education Academy.Google Scholar
  24. Něměckova, K. and Krylova, P. (2014). The Czech government scholarship programme for students from developing countries – Evaluation findings and policy reflections. Evaluation and Program Planning, 43, pp. 83–92.CrossRefGoogle Scholar
  25. Nijathaworn, B., Semblat, R., Takagi, S. and Tsumagari, T. (2009). Final report of the committee to review the Japan-IMF Scholarship Program for Asia (JISPA), Washington, DC: International Monetary Fund.Google Scholar
  26. Norad. (2009). Evaluation of the Norwegian Programme for Development, Research and Education (NUFU) and of Norad’s programme for Master Studies (NOMA), Oslo: Norad.Google Scholar
  27. Nuffic. (2009). NFP tracer 2009: Final report, The Hague: Nuffic.Google Scholar
  28. Nugroho, D. and Lietz, P. (2011). Meta-analysis of AusAID surveys of current and former scholarship awardees, Melbourne: Australian Council for Educational Research.Google Scholar
  29. Penny, A. and Teferra, D. (2010). Country evaluation Ethiopia, Brussels: VLIR-UOS.Google Scholar
  30. Pfutze, T. (2012), Does migration promote democratization? Evidence from the Mexican transition. Journal of Comparative Economics 40 (2), pp. 159–175.CrossRefGoogle Scholar
  31. Pietsch, T. (2011). Many Rhodes: Travelling scholarships and imperial citizenship in the British academic world, 1880–1940. History of Education, 40(6), pp. 723–739.CrossRefGoogle Scholar
  32. Purdey, J. (2015). Investing in good will: Australia’s scholarships programs for Indonesian tertiary students, 1950s–2010. In: A. Missbach and J. Purdey, eds. Linking people: Connections and encounters between Australians and Indonesians. Berlin: Regiospectra 2015, pp. 111–132.Google Scholar
  33. Raetzell, L., Stern, T., Plutta, K. and Krämer, M. (2013). Programme area evaluation: Educational Cooperation with Developing Countries, Bonn: Deutscher Akademischer Austauschdienst [DAAD].Google Scholar
  34. Scott-Smith, G. (2008). Mapping the undefinable: Some thoughts on the relevance of exchange programs within international relations theory. The Annals of the American Academy of Political and Social Science, 616(1), pp. 173–195.CrossRefGoogle Scholar
  35. Sin, I.L. (2009). The aspiration for social distinction: Malaysian students in a British university. Studies in Higher Education, 34(3), pp. 285–299.CrossRefGoogle Scholar
  36. Norwegian Centre for International Cooperation in Education [SIU]. (2015). Graduate tracer study: Norad’s Programme for Master Studies (NOMA) and Norwegian Programme for Development, Research and Education (NUFU), Bergen: SIU.Google Scholar
  37. Spilimbergo, A. (2008). Democracy and foreign education. The American Economic Review, 99(1), pp. 528–543.CrossRefGoogle Scholar
  38. Strömbom, M. (1989). Evaluation of fellowships awarded to developing countries: What do studies tell?. Higher Education, 18(6), pp. 707–724.CrossRefGoogle Scholar
  39. Tsvetkova, N. (2008). International education during the cold war: Soviet social transformation and American social reproduction. Comparative Education Review, 52(2), pp. 199–217.CrossRefGoogle Scholar
  40. van der Aa, R., Willensen, A. and Warmerdam, S. (2012). Evaluation of the Netherlands Fellowship Programme, 2002–2010: Final report, Rotterdam: Ecorys.Google Scholar
  41. Webb, S. (2009). Australian scholarships in Cambodia: Tracer study and evaluation, Canberra: AusAID.Google Scholar
  42. Wilson, I. (2015). Exchanges and Peacemaking: Counterfactuals and Unexplored Possibilities. All Azimuth, 4(2), pp. 5–18.Google Scholar
  43. World Bank Institute. (2008). Joint Japan/World Bank graduate scholarship program: Tracer study 8, Washington, DC: World Bank.Google Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  • Matt Mawer
    • 1
  1. 1.The Association of Commonwealth UniversitiesLondonUK

Personalised recommendations