Skip to main content
SpringerLink
Log in

Evaluating the Impacts That Impact Evaluations Don’t Evaluate

  • Chapter
Mixed Methods Research in Poverty and Vulnerability

Abstract

Development interventions aim to achieve a pre-determined set of positive improvements in the lives of people who receive them. They embody an implicit or explicit theory of change: people’s wellbeing is impaired by certain deficits or challenges they face, so providing specific benefits to them will alleviate these constraints and improve their wellbeing. Impact evaluations test whether the theory of change holds in practice: did the intervention actually improve wellbeing as predicted?

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Adato, M. (2008). Combining Survey and Ethnographic Methods to Improve Evaluation of Conditional Cash Transfer programmes. International Journal of Multiple Research Approaches, 2: 222–236.

    Article  Google Scholar 

  • Adelman, S., Gilligan, D. and Lehrer, K. (2008). How Effective are Food for Education Programs? A Critical Assessment of the Evidence from Developing Countries. Food Policy Review 9. Washington, DC: International Food Policy Research Institute (IFPRI).

    Google Scholar 

  • Befani, B., Barnett, C. and Stern, E. (2014). Introduction: Rethinking Impact Evaluation for Development. IDS Bulletin, 45(6): 1–5. doi: 10.1111/1759–5436.12108.

    Article  Google Scholar 

  • Berhane, G., Devereux, S., Hoddinott, J., Tegebu, F. N., Roelen, K. and Schwab, B. (2012). Evaluation of the Social Cash Transfers Pilot Programme, Tigray Region, Ethiopia: Baseline Report. Washington, DC: International Food Policy Research Institute (IFPRI); Brighton: Institute of Development Studies (IDS); Mekelle: Mekelle University.

    Google Scholar 

  • Bundy, D., Burbano, C., Grosh, M., Gelli, A., Jukes, M. and Drake, L. (2009). Rethinking School Feeding: Social Safety Nets, Child Development, and the Education Sector. Washington, DC: World Bank.

    Book  Google Scholar 

  • Camfield, L. and Duvendack, M. (2014). Impact Evaluation: Are We ‘Off the Gold Standard’?. European Journal of Development Research, 26: 1–11.

    Article  Google Scholar 

  • Davies, S. and Davey, J. (2008). A Regional Multiplier Approach to Estimating the Impact of Cash Transfers on the Market: The Case of Rural Malawi. Development Policy Review, 26 (1): 91–111.

    Article  Google Scholar 

  • Department of Social Development (DSD), South African Social Security Agency (SASSA) and UNICEF. (2011). Child Support Grant Evaluation 2010: Qualitative Research Report. Pretoria: UNICEF South Africa.

    Google Scholar 

  • Devereux, S. and Jere, P. (2008). ‘Choice, Dignity and Empowerment’? Cash and Food Transfers in Swaziland: An evaluation of Save the Children’s Emergency Drought Response, 2007/08. Mbabane: Save the Children Swaziland.

    Google Scholar 

  • Ellis, F. (2012). ‘We Are All Poor Here’: Economic Difference, Social Divisiveness and Targeting Cash Transfers in Sub-Saharan Africa. Journal of Development Studies, 48(2): 201–214.

    Article  Google Scholar 

  • Goetz, A. and Sen Gupta, R. (1996). Who Takes the Credit? Gender, Power, and Control Over Loan Use in Rural Credit Programs in Bangladesh. World Development, 24 (1): 45–63.

    Article  Google Scholar 

  • Harrison, G. (2014). Impact Evaluation and Welfare Evaluation. European Journal of Development Research, 26 (1): 39–45.

    Article  Google Scholar 

  • Hoddinott, J., Gilligan, D. and Taffesse, A. (2011). The Impact of Ethiopia’s Productive Safety Net Program on Schooling and Child Labour. Chapter 5. In Handa, S., Devereux, S. and Webb, D. (eds.), Social Protection for Africa’s Children. London: Routledge, 71–95.

    Google Scholar 

  • Kagin, J., Taylor, J., Alfani, F. and Davis, B. (2014). Local Economy-wide Impact Evaluation (LEWIE) of Ethiopia’s Social Cash Transfer Pilot Programme. From Protection to Production Report. Rome: FAO, http://www.fao.org/3/a-i3815e.pdf

    Google Scholar 

  • Kanbur, R. and Shaffer, P. (2007). Epistemology, Normative Theory and Poverty Analysis: Implications for Q- Squared in Practice. World Development, 35(2): 183–196. doi: http://dx.doi.org/10.1016/j.worlddev.2005.10.016

    Article  Google Scholar 

  • Khagram, S. and Thomas, C. (2010). Toward a Platinum Standard for Evidence-Based Assessment by 2020. Public Administration Review, December: S100–S106.

    Google Scholar 

  • Kristjansson, E., Robinson, V., Petticrew, M., MacDonald, B., Krasevec, J., Janzen, L., Greenhalgh, T., Wells, G., MacGowan, J., Farmer, A., Shea, B., Mayhew, A. and Tugwell, P. (2006). School Feeding for Improving the Physical and Psychosocial Health of Disadvantaged Students. Campbell Systematic Reviews, 2006: 14. Campbell Collaboration. doi: 10.4073/csr.2006.14.

    Google Scholar 

  • Long, N. (2001). Development Sociology: Actor Perspectives. London: Routledge.

    Book  Google Scholar 

  • MacAuslan, I. and Riemenschneider, N. (2011). Richer But Resented: What Do Cash Transfers Do to Social Relations?. IDS Bulletin, 42 (6): 60–66.

    Article  Google Scholar 

  • NPC. (2012). Assessment of Karnali Employment Program. Kathmandu: National Planning Commission (NPC).

    Google Scholar 

  • Patel, L., Hochfeld, T. and Moodley, J. (2013). Gender and Child Sensitive Social Protection in South Africa. Development Southern Africa, 30 (1): 69–83. doi: 10.1080/0376835X.2012.755872

    Article  Google Scholar 

  • Roelen, K. and Devereux, S. (2014). Evaluating Outside the Box: Mixing Methods in Analysing Social Protection Programmes. CDI Practice Paper 06. Brighton: Institute of Development Studies.

    Google Scholar 

  • Roelen, K. and Karki Chettri, H. (2014). Researching the Linkages between Social Protection and Children’s Care in Ghana. London: Family for Every Child.

    Google Scholar 

  • Roelen, K. and Karki Chettri, H. (2015). Child Sensitive Social Protection in Nepal. Kathmandu: Save the Children Nepal (forthcoming).

    Google Scholar 

  • Roelen, K. and Shelmerdine, H. (2014). Researching the Linkages between Social Protection and Children’s Care in Rwanda. London: Family for Every Child.

    Google Scholar 

  • Roelen, K., Edstrom, J., Sabates-Wheeler, R. and Davies, M. (2011). Lessons from the Children and AIDS Regional Initiative (CARI): Child- and HIV-sensitive Social Protection in Eastern and Southern Africa. Brighton: Centre for Social Protection, Institute of Development Studies.

    Google Scholar 

  • Shaffer, P. (2013). Ten Years of ‘Q-Squared’: Implications for Understanding and Explaining Poverty. World Development, 45: 269–285. doi: http://dx.doi.org/10.1016/j.worlddev.2012.12.008

    Article  Google Scholar 

  • Slater, R. and Mphale, M. (2008). Cash Transfers, Gender and Generational Relations: Evidence from a Pilot Project in Lesotho. London: Humanitarian Policy Group, Overseas Development Institute. http://www.odi.org.uk/resources/download/1922.pdf (last accessed 12 January 2015)

    Google Scholar 

  • Solomon, C. (2003). Giving Women Choices? Development Interfaces: Women and Microcredit in Northern Ghana. DPhil Thesis. Brighton: Institute of Development Studies, University of Sussex.

    Google Scholar 

  • Ulrichs, M. and Roelen, K. (2012). Equal Opportunities for All? A Critical Analysis of Mexico’s Oportunidades. IDS Working Paper, 413 and CSP Working Paper, 007. Brighton: Institute of Development Studies.

    Google Scholar 

  • USAID. (1995). Guidelines for Social Soundness Analysis. Washington, DC: United States Agency for International Development.

    Google Scholar 

  • Whaley, S., Sigman, M., Neumann, C., Bwibo, N., Guthrie, D., Weiss, R., Alber, S. and Murphy, S. (2003). The Impact of Dietary Intervention on the Cognitive Development of Kenyan School Children. American Society for Nutritional Sciences, 133: 3965S–3971S.

    Google Scholar 

  • World Food Programme (WFP). (2009). Home-Grown School Feeding: A Framework for Action. Rome: WFP.

    Google Scholar 

Download references

Authors
  1. Stephen Devereux
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Keetie Roelen
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Development Studies, University of Sussex, UK

    Keetie Roelen (Research Fellow) (Research Fellow)

  2. University of East Anglia, UK

    Laura Camfield (Senior Lecturer) (Senior Lecturer)

Copyright information

© 2015 Stephen Devereux and Keetie Roelen

About this chapter

Cite this chapter

Devereux, S., Roelen, K. (2015). Evaluating the Impacts That Impact Evaluations Don’t Evaluate. In: Roelen, K., Camfield, L. (eds) Mixed Methods Research in Poverty and Vulnerability. Palgrave Macmillan, London. https://doi.org/10.1057/9781137452511_7

Download citation

Publish with us

Policies and ethics

Search

Navigation