Evaluation Research in Public Health
Discuss approaches to evaluation using logic models and theories of change
Examine program/project evaluation designs to assess methodological rigor and appropriateness
Apply knowledge of global/national/state strategies and public health evidence to guide the development of evaluation indicators
Examine the culturally appropriate and ethically sound approaches in evaluation
KeywordsProgram evaluation Theory-based evaluation Theory of change Logical frameworks Results-based management Evaluation indicators Gender-sensitive evaluation
- ACI. Understanding program evaluation an ACI framework, agency for clinical innovation. Chatswood, NSW Department of Health; 2013.Google Scholar
- Australian Communities Foundation. Theory of change. Fitzroy: Australian Communities Foundation; 2015. Viewed 17 Jan 2018, http://www.communityfoundation.org.au/about-acf/theory-of-change/.
- Bauer G. Developing community health indicators to support comprehensive community building initiatives: A case study of a participatory action research project. (Dr.P.H.), University of California, Berkeley, California; 1999.Google Scholar
- CDC. Framework for program evaluation in public health. CDC Evaluation Working Group, Centers for Disease Control and Prevention, No. RR-11. 1999. https://www.cdc.gov/mmwr/preview/mmwrhtml/rr4811a1.htm.
- Chen HT. Theory-driven evaluations. Thousand Oaks: Sage; 1990.Google Scholar
- Connell JP, Kubisch AC. Applying a theory of change approach to the evaluation of comprehensive community initiatives: progress, prospects, and problems. New approaches to evaluating community initiatives, 1998;2(15–44):1–16.Google Scholar
- De Silva M, Lee L, Ryan G. Using theory of change in the development, implementation and evaluation of complex health interventions A practical guide. London: The Centre for Global Mental Health & the Mental Health Innovation Network; 2014a.Google Scholar
- EU. EVALSED: the resource for the evaluation of socio-economic development. European Commission. 2013. http://ec.europa.eu/regional_policy/en/information/publications/evaluations-guidance-documents/2013/evalsed-the-resource-for-the-evaluation-of-socio-economic-development-evaluation-guide.
- Foy R, Ovretveit J, Shekelle PG, Pronovost PJ, Taylor SL, Dy S, Hempel S, McDonald KM, Rubenstein LV, Wachter RM. The role of theory in research to develop and evaluate the implementation of patient safety practices. Qual Saf Health Care. 2011;20(5):453–9.Google Scholar
- Green L, Kreuter M. Health program planning: an educational and ecological approach, vol. 4.New York: McGraw-Hill Higher Education; 2015.Google Scholar
- IFRC. Project/programme monitoring and evaluation (M&E) guide. International Federation of Red Cross and Red Crescent Societies, Geneva; 2011.Google Scholar
- Lea S, Callaghan L, Eick S, Heslin M, Morgan J, Bolt M, Healey A, Barrett B, Rose D, Patel A. The management of individuals with enduring moderate to severe mental health needs: a participatory evaluation of client journeys and the interface of mental health services with the criminal justice system in Cornwall. National Institute of Health Research, Southampton, No. 3.15. 2015. https://www.ncbi.nlm.nih.gov/books/NBK285789/.
- Logan S, Boutotte J, Wilce M, Etkind S. Using the CDC framework for program evaluation in public health to assess tuberculosis contact investigation programs. Int J Tuberc Lung Dis. 2003;7(12):S375–S83.Google Scholar
- Marsh D, Aakesson A, Anah K. Community case management essentials: treating common childhood illnesses in the community. In: A guide for program managers. Washington, DC: CORE Group Save the Children BASICS MCHIP; 2012.Google Scholar
- Patton MQ. Utilization-focused evaluation. 4th ed. Thousand Oaks: Sage; 2008.Google Scholar
- Patton MQ, McKegg K, Wehipeihana N. Developmental evaluation exemplars: principles in practice. New York: Guilford Press; 2016.Google Scholar
- Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.Google Scholar
- Ramsay CR, Thomas RE, Croal BL, Grimshaw JM, Eccles MP. Using the theory of planned behaviour as a process evaluation tool in randomised trials of knowledge translation strategies: a case study from UK primary care. Implement Sci. 2010;5:71. https://doi.org/10.1186/748-5908-5-71.CrossRefGoogle Scholar
- Reisman J, Gienapp A, Langley K, Stachowiak S. Theory of change a practical tool for action, results and learning. Seattle: Organizational Research Services, Annie E. Casey Foundation; 2004. http://www.aecf.org/resources/theory-of-change/.
- Rogers P. Theory of change, methodological briefs: impact evaluation, vol. 2. Florence: UNICEF Office of Research; 2014.Google Scholar
- Schierhout G, Hains J, Si D, Kennedy C, Cox R, Kwedza R, O’Donoghue L, Fittock M, Brands J, Lonergan K. Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implement Sci. 2013;8:119. https://doi.org/10.1186/748-5908-8-119.CrossRefGoogle Scholar
- Sinha RK, Haghparast-Bidgoli H, Tripathy PK, Nair N, Gope R, Rath S, Prost A. Economic evaluation of participatory learning and action with women’s groups facilitated by Accredited Social Health Activists to improve birth outcomes in rural eastern India. Cost Effectiveness and Resource Allocation, 2017;15(2), https://doi.org/10.1186/s12962-12017-10064-12969.
- Taplin D, Clark C, Collins E, Colby D. Theory of change a series of papers to support development of theories of change based on practice in the field. New York: Center for Human Environments; 2013.Google Scholar
- University of Kansas. Developing a framework or model of change. Kansas: Center for Community Health and Development, University of Kansas; 2017. Viewed 17 Jan 2018, http://ctb.ku.edu/en/4-developing-framework-or-model-change.
- USAID. Evaluation learning from experience: USAID evaluation policy. Washington, DC: U.S. Agency for International Development; 2011.Google Scholar
- Vogel I. Review of the use of ‘theory of change’ in international development review report. UK Department of International Development, London; 2012.Google Scholar
- Weiss CH. Nothing as practical as good theory: exploring theory-based evaluation for comprehensive community initiatives for children and families. In: Connell JP, Kubisch AC, Schorr LB, Weiss CH, editors. New approaches to evaluating community initiatives: concepts, methods and context. Washington DC: The Aspen Institute; 1995. p. 65–92.Google Scholar
- WHO. WHO evaluation practice handbook. Geneva: World Health Organization; 2013.Google Scholar
- WHO. WHO’s results framework. Geneva: World Health Organization; 2017. Viewed 21 Oct 2017, http://www.who.int/about/who_reform/change_at_who/results_framework/en/#.WfLd4rVx2Uk www.who.int/about/resources_planning/WHO_GPW12_results_chain.pdf.
- Young SL, Tuthill E. Ethnography as a tool for formative research and evaluation in public health nutrition: illustrations from the world of infant and young child feeding. In: Chrzan J, Brett J, editors. Research methods for anthropological studies of food and nutrition: food research. New York: Berghahn Books; 2017.Google Scholar