Skip to main content
SpringerLink
Log in

Reviewing the Effectiveness of Participatory Health Research: Challenges and Possible Solutions

  • Chapter
  • First Online:
Book cover Participatory Health Research

  • 660 Accesses

Abstract

Participation in health research is becoming more important as health systems are challenged to contain costs in the face of ageing populations and increased demand for support with chronic and long-term conditions. Partnership working, community engagement and participation in the process of designing research and delivering health interventions are now a major focus for funders, requiring high-quality evaluations of effectiveness. Systematic reviews of these initiatives indicate that they are effective, but providing explanations for how and why participation works is difficult due to thin reporting of the process. This chapter outlines the challenges of conducting reviews of participation in health research, including how to assemble an experienced review team, construct definitions of participation and impact and locate good information on participation in health research. Solutions for reviewing participation are presented, based on international guidance for systematic reviews and practical experiences of conducting reviews on participation and community engagement.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 89.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adams, A. K., LaRowe, T. L., Cronin, K. A., Prince, R. J., Wubben, D. P., Parker, T., & Jobe, J. B. (2012). The Healthy Children, Strong Families intervention: design and community participation. The journal of primary prevention, 33(4), 175–185.

    Article  PubMed Central  PubMed  Google Scholar 

  • Allmark, P., Baxter, S., Goyder, E., Guillaume, L., & Crofton-Martin, G. (2013). Assessing the health benefits of advice services: Using research evidence and logic model methods to explore complex pathways. Health & Social Care in the Community, 21(1), 59–68.

    Article  Google Scholar 

  • Anderson, L. M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., Francis, D., & Tugwell, P. (2011). Using logic models to capture complexity in systematic reviews. Research Synthesis Methods, 2(1), 33–42.

    Article  PubMed  Google Scholar 

  • Anderson LM, Adeney KL, Shinn C, Krause LK, Safranek S. (2012). Community coalition-driven interventions to reduce health disparities among racial and ethnic minority populations (Protocol). Cochrane Database of Systematic Reviews. Issue 6. Art. No.: CD009905. https://doi.org/10.1002/14651858.CD009905.

  • Andreae, S. J., Halanych, J. H., Cherrington, A., & Safford, M. M. (2012). Recruitment of a rural, southern, predominantly African-American population into a diabetes self-management trial. Contemporary Clinical Trials, 33(3), 499–506.

    Article  PubMed  Google Scholar 

  • Arnstein, S. R. (1969). A ladder of citizen participation. Journal of the American Institute of Planners, 35(4), 216–224.

    Article  Google Scholar 

  • Barreto, J. M. (2014). Epistemologies of the South and human rights: Santos and the quest for global and cognitive justice. Indiana Journal of Global Legal Studies, 21(2), 395–422.

    Article  Google Scholar 

  • Baxter, S., Killoran, A., Kelly, M. P., & Goyder, E. (2010). Synthesizing diverse evidence: The use of primary qualitative data analysis methods and logic models in public health reviews. Public Health, 124(2), 99–106.

    Article  CAS  PubMed  Google Scholar 

  • Baxter, S. K., Blank, L., Woods, H. B., Payne, N., Rimmer, M., & Goyder, E. (2014). Using logic model methods in systematic review synthesis: Describing complex pathways in referral management interventions. BMC Medical Research Methodology, 14(1), 62.

    Article  PubMed Central  PubMed  Google Scholar 

  • Beresford, P. (2013). Theory and practice of user involvement in research: Making the connection with public policy and practice. In Involving service users in health and social care research (pp. 15–26). London: Routledge.

    Google Scholar 

  • Booth, A., Harris, J., Croot, E., Springett, J., Campbell, F., & Wilkins, E. (2013). Towards a methodology for cluster searching to provide conceptual and contextual “richness” for systematic reviews of complex interventions: Case study (CLUSTER). BMC Medical Research Methodology, 13(1), 118.

    Article  PubMed Central  PubMed  Google Scholar 

  • Booth, A. (2006). Clear and present questions: Formulating questions for evidence based practice. Library Hi Tech, 24(3), 355–368.

    Article  Google Scholar 

  • Cargo, M., Stankov, I., Thomas, J., Saini, M., Rogers, P., Mayo-Wilson, E., & Hannes, K. (2015). Development, inter-rater reliability and feasibility of a checklist to assess implementation (Ch-IMP) in systematic reviews: the case of provider-based prevention and treatment programs targeting children and youth. BMC medical research methodology, 15(1), 73.

    Google Scholar 

  • Chesla, C. A., Chun, K. M., Kwan, C. M., Mullan, J. T., Kwong, Y., Hsu, L., Huang, P., Strycker, L. A., Shum, T., To, D., & Kao, R. (2013). Testing the efficacy of culturally adapted coping skills training for Chinese American immigrants with type 2 diabetes using community-based participatory research. Research in Nursing & Health, 36(4), 359–372.

    Article  Google Scholar 

  • Cook, T. (2012). Where participatory approaches meet pragmatism in funded (health) research: The challenge of finding meaningful spaces. In Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 13(1).

    Google Scholar 

  • Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. The Annals of Family Medicine, 6(4), 331–339.

    Article  PubMed  Google Scholar 

  • Cornwall, A. (2008). Unpacking ‘participation’: Models, meanings and practices. Community Development Journal, 43(3), 269–283.

    Article  Google Scholar 

  • Daivadanam, M., Wahlstrom, R., Ravindran, T. S., Sarma, P. S., Sivasankaran, S., & Thankappan, K. R. (2013). Design and methodology of a community-based cluster-randomized controlled trial for dietary behaviour change in rural Kerala. Global Health Action, 6(1), 20993.

    Article  PubMed  Google Scholar 

  • Funnell, S. C., & Rogers, P. J. (2011). Purposeful program theory: Effective use of theories of change and logic models (Vol. 31). Hoboken: Wiley.

    Google Scholar 

  • Grant, M. J., & Booth, A. (2009). A typology of reviews: An analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108.

    Article  Google Scholar 

  • Heyvaert, M., Hannes, K., Maes, B., & Onghena, P. (2013). Critical appraisal of mixed methods studies. Journal of Mixed Methods Research, 7(4), 302–327.

    Article  Google Scholar 

  • Harris, J., Cook, T., Gibbs, L., Oetzel, J., Salsbury, J., & Shinn, C. (2018). Searching for the Impact of Participation in Health and Health Research: Challenges and Methods. BioMed Research International. https://doi.org/10.1155/2018/9427452/.

    Article  Google Scholar 

  • Harris, J., Croot, L., Thompson, J., & Springett, J. (2016). How stakeholder participation can contribute to systematic reviews of complex interventions. Journal of Epidemiology and Community Health, 70(2), 207. https://doi.org/10.1136/jech-2015-205701.

    Article  CAS  PubMed  Google Scholar 

  • Harris, J., Graue, M., Dunning, T., Haltbakk, J., Austrheim, G., Skille, N., Rokne, B., & Kirkevold, M. (2015a). Involving people with diabetes and the wider community in diabetes research: A realist review protocol. Systematic Reviews, 4(1), 146.

    Article  PubMed Central  PubMed  Google Scholar 

  • Harris, J., Graue, M., Dunning, T., Haltbakk, J., Kirkevold, M., & Austrheim, G (submitted). How patient and community involvement in diabetes research influences health outcomes: A realist review.

    Google Scholar 

  • Harris, J., Springett, J., Booth, A., Campbell, F., Thompson, J., Goyder, E., Van Cleemput, P., Wilkins, E., & Yang, Y. (2015b). Can community-based peer support promote health literacy and reduce inequalities? A realist review. Journal of Public Health Research, 3(3).

    Article  Google Scholar 

  • Hasnain-Wynia, R. (2003). Overview of the community care network demonstration program and its evaluation. Medical Care Research and Review, 60(4_suppl), 5S–16S.

    Article  PubMed  Google Scholar 

  • Hawe, P., Shiell, A., & Riley, T. (2009). Theorising interventions as events in systems. American Journal of Community Psychology, 43(3–4), 267–276.

    Article  PubMed  Google Scholar 

  • International Collaboration for Participatory Health Research (ICPHR). (2018). Position paper 3: What is impact in participatory health research? Berlin: International Collaboration for Participatory Health Research.

    Google Scholar 

  • International Collaboration for Participatory Health Research (ICPHR). (2013). Position paper 1: What is participatory health research? Version: May 2013. Berlin: International Collaboration for Participatory Health Research.

    Google Scholar 

  • Jagosh, J., Bush, P. L., Salsberg, J., Macaulay, A. C., Greenhalgh, T., Wong, G., Cargo, M., Green, L. W., Herbert, C. P., & Pluye, P. (2015). A realist evaluation of community-based participatory research: Partnership synergy, trust building and related ripple effects. BMC Public Health, 15(1), 725.

    Article  PubMed Central  PubMed  Google Scholar 

  • Joanna Briggs Institute. (2015). Methodology for JBI scoping reviews, Joanna Briggs Institute Reviewers’ Manual. University of Adelaide, Adelaide, Australia.

    Google Scholar 

  • Khodyakov, D., Stockdale, S., Jones, F., Ohito, E., Jones, A., Lizaola, E., & Mango, J. (2011). An exploration of the effect of community engagement in research on perceived outcomes of partnered mental health services projects. Society and Mental Health, 1(3), 185–199.

    Article  PubMed Central  PubMed  Google Scholar 

  • Kneale, D., Thomas, J., & Harris, K. (2015). Developing and optimising the use of logic models in systematic reviews: Exploring practice and good practice in the use of programme theory in reviews. PLoS One, 10(11), e0142187.

    Article  PubMed Central  PubMed  Google Scholar 

  • Liu, J. J., Davidson, E., Bhopal, R. S., White, M., Johnson, M. R. D., Netto, G., Deverill, M., & Sheikh, A. (2012). Adapting health promotion interventions to meet the needs of ethnic minority groups: Mixed-methods evidence synthesis. Health Technology Assessment (Winchester, England), 16(44), 1.

    Google Scholar 

  • Lucero, J., Wallerstein, N., Duran, B., Alegria, M., Greene-Moton, E., Israel, B., Kastelic, S., Magarati, M., Oetzel, J., Pearson, C., & Schulz, A. (2016). Development of a mixed methods investigation of process and outcomes of community-based participatory research. Journal of Mixed Methods Research, 1558689816633309.

    Google Scholar 

  • Macaulay, A. C., Paradis, G., Potvin, L., Cross, E. J., Saad-Haddad, C., McComber, A., Desrosiers, S., Kirby, R., Montour, L. T., Lamping, D. L., & Leduc, N. (1997). The Kahnawake schools diabetes prevention project: Intervention, evaluation, and baseline results of a diabetes primary prevention program with a native community in Canada. Preventive Medicine, 26(6), 779–790.

    Article  CAS  PubMed  Google Scholar 

  • Milton, B., Attree, P., French, B., Povall, S., Whitehead, M., & Popay, J. (2011). The impact of community engagement on health and social outcomes: A systematic review. Community Development Journal, 47(3), 316–334.

    Article  Google Scholar 

  • Oetzel, J. G., & Minkler, M. (2017). Community-based participatory research for health: advancing social and health equity. John Wiley & Sons.

    Google Scholar 

  • Oetzel, J. G., Zhou, C., Duran, B., Pearson, C., Magarati, M., Lucero, J., Wallerstein, N., & Villegas, M. (2015). Establishing the psychometric properties of constructs in a community-based participatory research conceptual model. American Journal of Health Promotion, 29(5), e188–e202.

    Article  PubMed  Google Scholar 

  • Oliver, K., Rees, R., Brady, L. M., Kavanagh, J., Oliver, S., & Thomas, J. (2015). Broadening public participation in systematic reviews: A case example involving young people in two configurative reviews. Research Synthesis Methods, 6(2), 206–217.

    Article  PubMed Central  PubMed  Google Scholar 

  • O’Mara-Eves, A., Brunton, G., McDaid, G., Oliver, S., Kavanagh, J., Jamal, F., ... & Thomas, J. (2013). Community engagement to reduce inequalities in health: a systematic review, meta-analysis and economic analysis. Public Health Research, 1(4).

    Article  Google Scholar 

  • O’Mara-Eves, A., Brunton, G., Oliver, S., Kavanagh, J., Jamal, F., & Thomas, J. (2015). The effectiveness of community engagement in public health interventions for disadvantaged groups: A meta-analysis. BMC Public Health, 15(1), 129.

    Article  PubMed Central  PubMed  Google Scholar 

  • Pearson, A., Wiechula, R., Court, A., & Lockwood, C. (2005). The JBI model of evidence-based healthcare. International Journal of Evidence-Based Healthcare, 3(8), 207–215.

    PubMed  Google Scholar 

  • Pearson, M., Brand, S. L., Quinn, C., Shaw, J., Maguire, M., Michie, S., Briscoe, S., Lennox, C., Stirzaker, A., Kirkpatrick, T., & Byng, R. (2015). Using realist review to inform intervention development: Methodological illustration and conceptual platform for collaborative care in offender mental health. Implementation Science, 10(1), 134.

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Phipps, D., Pepler, D., Craig, W., Cummings, J., & Cardinal, S. (2016). The co-produced pathway to impact describes knowledge mobilization processes. Journal of Community Engagement and Scholarship, 9, 31.

    Google Scholar 

  • Richardson, W. S., Wilson, M. C., Nishikawa, J., & Hayward, R. S. (1995). The well-built clinical question: A key to evidence-based decisions. ACP Journal Club, 123(3), A12–A12.

    CAS  PubMed  Google Scholar 

  • Rifkin, S. B. (2014). Examining the links between community participation and health outcomes: A review of the literature. Health Policy and Planning, 29(suppl_2), ii98–ii106.

    Article  PubMed Central  PubMed  Google Scholar 

  • Roussos, S. T., & Fawcett, S. B. (2000). A review of collaborative partnerships as a strategy for improving community health. Annual Review of Public Health, 21(1), 369–402.

    Article  CAS  PubMed  Google Scholar 

  • Rowher, A., Booth, A., Pfadenhauer, L., Brereton, L., Gerdhardus, J., Mozygemba, K., Oortwijn, W., Tummers, M., van der Wilt, G. J., & Rehfuess, E. (2016). Guidance on the use of logic models in health technology assessments of complex interventions. International Journal of Technology Assessment in Health Care.

    Google Scholar 

  • Sandelowski, M., Barroso, J., & Voils, C. I. (2007). Using qualitative metasummary to synthesize qualitative and quantitative descriptive findings. Research in Nursing & Health, 30(1), 99–111.

    Article  Google Scholar 

  • Shaw, R.L. (2010). Conducting literature reviews. In M. Forrester (Ed.) Doing qualitative research in psychology: A practical guide (pp.39–52). London: Sage.

    Google Scholar 

  • Shippee, N. D., Domecq Garces, J. P., Prutsky Lopez, G. J., Wang, Z., Elraiyah, T. A., Nabhan, M., Brito, J. P., Boehmer, K., Hasan, R., Firwana, B., & Erwin, P. J. (2015). Patient and service user engagement in research: A systematic review and synthesized framework. Health Expectations, 18(5), 1151–1166.

    Article  PubMed  Google Scholar 

  • Trickett, E. J., Beehler, S., Deutsch, C., Green, L. W., Hawe, P., McLeroy, K., Miller, R. L., Rapkin, B. D., Schensul, J. J., Schulz, A. J., & Trimble, J. E. (2011). Advancing the science of community-level interventions. American Journal of Public Health, 101(8), 1410–1419.

    Article  PubMed Central  PubMed  Google Scholar 

  • Trickett, E. J., Trimble, J. E., & Allen, J. (2014). Most of the story is missing: Advocating for a more complete intervention story. American journal of community psychology, 54(1–2), 180–186.

    Article  PubMed Central  PubMed  Google Scholar 

  • Van de Ven, A. H. (2007). Engaged scholarship: A guide for organizational and social research. Oxford: Oxford University Press on Demand.

    Google Scholar 

  • Viswanathan, M., Ammerman, A., Eng, E., Gartlehner, G., Lohr, K. N., Griffth, D., et al. (2004). Community-based participatory research: Assessing the evidence, Evidence Report/Technology Assessment No. 99; Prepared by RTI International-University of North Carolina. Rockville: Agency for Healthcare Research and Quality.

    Google Scholar 

  • Wallerstein, N. (1992). Powerlessness, empowerment, and health: Implications for health promotion programs. American Journal of Health Promotion, 6(3), 197–205.

    Article  CAS  PubMed  Google Scholar 

  • Wallerstein, N., & Duran, B. (2010). CBPR contributions to intervention research: The interaction of science and practice to improve health equity. American Journal Public Health S1, 100, 540–546.

    Article  Google Scholar 

  • Weick, K. E. (1995). Sensemaking in organizations. Thousand Oaks: Sage.

    Google Scholar 

  • Wong, G., Greenhalgh, T., Westhorp, G., Buckingham, J., & Pawson, R. (2013). RAMESES publication standards: Realist syntheses. BMC Medicine, 11(1), 21.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Sheffield, School of Health and Related Research (ScHARR), Sheffield, UK

    Janet Harris

Authors
  1. Janet Harris
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Janet Harris .

Editor information

Editors and Affiliations

  1. Institute for Social Health, Catholic University of Applied Sciences, Berlin, Germany

    Michael T. Wright

  2. School of Public Health, University of Alberta, Edmonton, AB, Canada

    Krystyna Kongats

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Harris, J. (2018). Reviewing the Effectiveness of Participatory Health Research: Challenges and Possible Solutions. In: Wright, M., Kongats, K. (eds) Participatory Health Research. Springer, Cham. https://doi.org/10.1007/978-3-319-92177-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-92177-8_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-92176-1

  • Online ISBN: 978-3-319-92177-8

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation