Evaluating Participatory Health Research
This chapter explores some of the challenges in evaluating PHR. Firstly, it examines the reasons for evaluating participatory health research (PHR), placing that need in the context of different paradigms of public health research and the ongoing debates about methodology and different models of evaluation. Four key issues/challenges are identified. Secondly, this chapter introduces the community-based participatory research (CBPR) conceptual model as a framework that helps to address these key issues. Thirdly, this chapter includes several cases to illustrate ways of PHR evaluation: from New Zealand, the USA (including communities of immigrants/refugees), and Nicaragua. Finally, this chapter ends with a discussion on ways in which PHR researchers can proactively evaluate their research, so lessons can be learnt and case studies can be developed to showcase alternative ways of documenting process, impact, and outcomes. This discussion highlights how the conceptual model addresses some of the key issues surrounding the evaluation of PHR.
KeywordsProcess evaluation Outcome evaluation Community-based participatory research conceptual model
The following authors are associated with the cases: (a) New Zealand, John Oetzel and Rangimahora Reddy; (b) Rochester, Mark Wieland, Irene Sia, and Abigail Reese; and (c) Nicaragua, Laura Parajon. We also thank our many community partners and colleagues with whom we have collaborated and learnt from over the years. The CBPR model was originally developed and tested with US National Institutes of Health NARCH funding (U261HS300293; U261IHS0036-04-00) and revised under “Engage for Equity” National Institute of Nursing Research funding (1R01NR015241-01A1).
- Bradbury-Huang, H. (2014). Quality in action research. In M. Brydon-Miller, D. Coghlan, & P. Gaya (Eds.), Encyclopedia of action research. London: Sage.Google Scholar
- Campilan, D., & Prain, G. (2000). Self-assessment as an approach to evaluating participatory research: An Asian experience. In N. Lilja & L. Sperling (Eds.), Assessing the impact of participatory research and gender analysis (pp. p172–p182). Cali: CGIAR SWP-PRGA.Google Scholar
- Center for Participatory Research A (n.d.). CBPR project: Research for improvement health 2009–2013. Available via https://cpr.unm.edu/research-projects/cbpr-project/research-for-improved-health.html. Accessed: 2 Nov 2017.
- Center for Participatory Research B (n.d.). CBPR model visioning guide for planning and evaluation. Available via https://cpr.unm.edu/research-projects/cbpr-project/index.html. Accessed: 2 Nov 2017.
- Center for Participatory Research C (n.d.). Empowerment curriculum. Available via http://cpr.unm.edu/curricula--classes/empowerment-curriculum.html. Accessed: 2 Nov 2017.
- Chambers, R. (1998). Foreword. In J. Holland and J. Blackburn (eds.). Whose voice? Participatory research and policy change. London. Immediate Technology Publications.Google Scholar
- de Sousa Santos, B. (2014). Epistemologies of the south: Justice against epistemicide. Boulder: Paradigm Publishers.Google Scholar
- Duran, B., Oetzel, J.G., Pearson, C., et al. (under review). Promising practices in community-based participatory research: Evidence from a national study.Google Scholar
- Green, L. W., George, M. A., Daniel, M., et al. (1995). Study of participatory research in health promotion: Review and recommendations for development of participatory research in health promotion in Canada. Ottawa: The Royal Society of Canada.Google Scholar
- Greene, J. C. (1994). Qualitative program evaluation practices and promise. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 530–544). London: Sage Publications., London.Google Scholar
- Guthrie, S., Wamae, W., Diepeveen, S., et al. (2013). Measuring research: A guide to research evaluation frameworks and tools. Europe: RAND.Google Scholar
- Hall, B., Tandon, R., & Tremblay, C. (2015). Strengthening community university research partnerships: Global perspectives. Victoria: University of Victoria.Google Scholar
- House, E. R. (2015). Evaluating: Values, biases, and practical wisdom. Charlotte: IAP.Google Scholar
- Hummelbrunner, R. (2010). Beyond logframe: Critique, variations and alternatives. In N. Fujita (Ed.), Beyond logframe: Using systems concepts in evaluation. Tokyo: Foundation for Advanced Studies on International Development.Google Scholar
- International Collaboration for Participatory Health Research (ICPHR). (2013). Position paper 1: What is participatory Health Research? Berlin: International Collaboration for Participatory Health Research.Google Scholar
- Israel, B. A., Schulz, A. J., Parker, E. A., et al. (2018). Critical issues in developing and following CBPR principles. In N. Wallerstein, B. Duran, J. G. Oetzel, & M. Minkler (Eds.), Community-based participatory research for health (3rd ed., pp. 31–44). San Francisco: Jossey-Bass.Google Scholar
- Kastelic, S., Wallerstein, N., Duran, B., et al. (2018). Socio-ecologic framework for CBPR: Development and testing of a model. In N. Wallerstein, B. Duran, J. G. Oetzel, & M. Minkler (Eds.), Community-based participatory research for health (3rd ed., pp. 77–94). San Francisco: Jossey-Bass.Google Scholar
- Kennedy, V., & Cram, F. (2010). Ethics of researching with Whānau collectives. MAI Review, 2010(3), 1–8.Google Scholar
- Lucero, J., Wallerstein, N., Duran, B., Alegria, M., Greene-Moton, E., Israel, B., Kastelic, S., Magarati, M., Oetzel, J., Pearson, C., Schulz, A., Villegas, M., & White Hat, E. (2018). Development of a mixed methods investigation of process and outcomes of community-based participatory research. Journal of Mixed Methods Research, 12, 55–74.CrossRefPubMedCentralGoogle Scholar
- Oetzel, J. G., Duran, B., Sussman, A., et al. (2018). Evaluation of CBPR partnerships and outcomes: Lessons and tools from the Research for Improved Health study. In N. Wallerstein, B. Duran, J. G. Oetzel, & M. Minkler (Eds.), Community-based participatory research for health (3rd ed., pp. 237–250). San Francisco: Jossey-Bass.Google Scholar
- Oetzel, J.G., Wallerstein, N., Duran, B., et al. (in press). Community-engaged research for health: A test of the CBPR conceptual model. BioMed Research International.Google Scholar
- Orange, C. (1987). The story of a treaty. Wellington: Allen & Unwin.Google Scholar
- Oetzel, J. G., Wallerstein, N., Duran, B., Villegas, M., Sanchez-Youngman, S., Nguyen, T., Woo, K., Wang, J., Schulz, A., Kaholokula, Israel, B., & Alegria, M. (2018). Community-engaged research for health: A test of the CBPR conceptual model. BioMed Research International. 2018, Article ID: 7281405Google Scholar
- Rochester Healthy Community Partnership (n.d.). Our research model. Available via https://rochesterhealthy.org/our-research-model; Accessed on 2 Nov 2017.
- Sanchez-Youngman, S., & Wallerstein, N. (2018). Appendix 7: Partnership river of life: Creating an historical timeline. In N. Wallerstein, B. Duran, J. G. Oetzel, & M. Minkler (Eds.), Community-based participatory research for health (3rd ed., pp. 375–378). San Francisco: Jossey-Bass.Google Scholar
- Springett, J., Wright, M. T., & Roche, B. (2011). Developing quality criteria for participatory health research. An agenda for action, WZB Discussion Paper. Berlin: Wissenschaftszentrum Berlin für Sozialforschung.Google Scholar
- Staley, K. (2009). Exploring impact: Public involvement in NHS, public health and social care research. Eastleigh: INVOLVE.Google Scholar
- Wallerstein, N., Oetzel, J., Duran, B., et al. (2008). CBPR: What predicts outcomes? In M. Minkler & N. Wallerstein (Eds.), Community-based participatory research for health: From process to outcomes (2nd ed., pp. 371–392). San Francisco: Jossey-Bass.Google Scholar
- Wallerstein, N., Oetzel, J. G., Duran, B., et al. (under review). Cultural-centeredness in community-based participatory research: Culture as power and agency.Google Scholar
- Wieland, M. L., Weis, J. A., Yawn, B. P., et al. (2012). Perceptions of tuberculosis among immigrants and refugees at an adult education center: A community-based participatory research approach. Journal of Immigrant and Minority Health/Center for Minority Public Health, 14, 14–22.CrossRefGoogle Scholar