Challenges in Shaping Health Programmes with Data

  • Sarah B. MacfarlaneEmail author
  • Muhammed M. Lecky
  • Olufemi Adegoke
  • Nkata Chuku


Macfarlane, Lecky, Adegoke and Chuku follow the development and assessment of evidence-based interventions—from research through to implementation—against the backdrop of achieving the Sustainable Development Goals (SDGs) including Universal Health Coverage. They distinguish between the evidence that policymakers need to select interventions and the information that managers need to shape and evaluate implemented programmes. They review methods by which researchers and international institutions gather evidence to identify and promote interventions for consideration by policymakers. The authors also examine how programme managers monitor and evaluate implementation of the interventions they have adopted and how they assess long-term impact of interventions taken to scale. They conclude by presenting an internationally agreed framework that governments can use to monitor overall health sector performance and progress towards the SDGs.


  1. 1.
    World Health Organization and International Bank for Reconstruction and Development / The World Bank. Tracking Universal Health Coverage: Global monitoring report. Geneva, Switzerland: World Health Organization. 2017 [cited 2018 5th November]. Available from:
  2. 2.
    Huda T, Khan JAM, Ahsan KZ, Jamil K, Arifeen SE. Monitoring and evaluating progress towards universal health coverage in Bangladesh. PLoS Medicine. 2014 Sep 22;11(9):e1001722. Available from:
  3. 3.
    Scientific Advisory Committee on Nutrition. Salt and health. London, UK: Food Standards Agency and the Department of Health. The Stationery Office. 2003 [cited 2018 5th November]. Available from:
  4. 4.
    He FJ, Brinsden HC, MacGregor GA. Salt reduction in the United Kingdom: a successful experiment in public health. Journal of Human Hypertension. 2013 Oct 31;28(6):345–52. Available from:
  5. 5.
    Haynes B. Can it work? Does it work? Is it worth it? The testing of healthcare interventions is evolving. British Medical Journal. 1999 Sep 11;319(7211):652–3. Available from:
  6. 6.
    World Health Organization. World malaria report 2017. Geneva, Switzerland: World Health Organization. 2017 [cited 2018 5th November]. Available from:
  7. 7.
    Smith PG, Morrow RH, Ross DA, editors. Introduction to field trials of health interventions. Field Trials of Health Interventions. Oxford University Press; 2015 Jun;1–4. Available from:
  8. 8.
    Richardson WS, Wilson MC, Nishikawa J, Hayward RS. The well-built clinical question: a key to evidence-based decisions. ACP Journal Club. 1995;123(3):A12–A.Google Scholar
  9. 9.
    Atkins D, Best D, Briss PA, Eccles M, Falck-Ytter Y, Flottorp S, et al. Grading quality of evidence and strength of recommendations. British Medical Journal 2004;328(7454):1490.Google Scholar
  10. 10.
    Petrisor B, Bhandari M. The hierarchy of evidence: Levels and grades of recommendation. Indian Journal of Orthopaedics. 2007;41(1):11. Available from:
  11. 11.
    Shidhaye R. Implementation Science for closing the treatment gap for mental disorders by translating evidence base into practice: experiences from the PRIME project. Australasian Psychiatry. 2015 Dec;23(6_suppl):35–7. Available from:
  12. 12.
    Eccles MP, Mittman BS. Welcome to implementation science. Implementation Science. 2006 Feb 22;1(1). Available from:
  13. 13.
    Peters DH, Tran NT, Adam T. Implementation research in health: a practical guide. Geneva, Switzerland: Alliance for Health Policy and Systems Research, World Health Organization. 2013 [cited 2018 5th November]. Available from:
  14. 14.
    de Savigny D, Adam T. Systems thinking for health systems strengthening. Geneva, Switzerland: Alliance for Health Policy and Systems Research. Geneva, Switzerland: World Health Organization. 2009 [cited 2018 5th November]. Available from:
  15. 15.
    Pulkki-Brännström A-M, Wolff C, Brännström N, Skordis-Worrall J. Cost and cost effectiveness of long-lasting insecticide-treated bed nets—a model-based analysis. Cost Effectiveness and Resource Allocation. 2012;10(1):5. Available from:
  16. 16.
    World Health Organization. World Health Organization guidelines approved by the guidelines review committee. Geneva, Switzerland: World Health Organization. 2009 [cited 2018 5th November]. Available from:
  17. 17.
    World Health Organization. Handbook for guideline development. 2012 [cited 2018 14th February]. Available from:
  18. 18.
    Lengeler C. Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database of Systematic Reviews. 2004 Apr 19; Available from:
  19. 19.
    Grade Working Group. What is GRADE? [cited 2018 14th February]. Available from:
  20. 20.
    Haidich A-B. Meta-analysis in medical research. Hippokratia. 2010;14(Suppl 1):29. Available from:
  21. 21.
    Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul 21;339(jul21 1):b2535–b2535. Available from: 
  22. 22.
    Cochrane Library. Cochrane Database of Systematic Reviews. [cited 2018 23rd December]. Available from
  23. 23.
    Campbell Collaboration. [cited 2018 14th February]. Available from:
  24. 24.
    Prospero. International prospective register of systematic reviews. [cited 2018 14th February]. Available from:
  25. 25.
    Watkins DA, Jamison DT, Mills A, Atun R, Danforth K, Glassman A, et al. Universal health coverage and essential packages of care. Disease Control Priorities, Third ed. (Volume 9): Improving Health and Reducing Poverty. The World Bank; 2017 Dec 6;43–65. Available from:
  26. 26.
    WK Kellogg Foundation. WK Kellogg Foundation logic model development guide. Battle Creek, Michigan, USA: WK Kellogg Foundation. 2004 [cited 2018 5th November]. Available from:
  27. 27.
    Mundial B. Logframe Handbook, a logical framework approach to project cycle management. 2003 [cited 2018 14th February]. Available from:
  28. 28.
    Roberts D, Khattri N. Designing a results framework for achieving results: a how-to guide. Washington, DC:, USA: Independent Evaluation Group, World Bank. 2012 [cited 2018 5th November]. Available from:
  29. 29.
    Centers for Disease Control and Prevention (CDC). Types of evaluation. [cited 2018 14th February]. Available from:
  30. 30.
    Wilson-Grau R, Britt H. Outcome harvesting. 2012 [cited 2018 14th February]. Available from:
  31. 31.
    BetterEvaluation. Outcome harvesting. 2015 [cited 2018 14th February]. Available from:
  32. 32.
    Habicht J-P, Victora C, Vaughan JP. Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. International Journal of Epidemiology. 1999 Feb 1;28(1):10–8. Available from:
  33. 33.
    Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. BMJ. 2015 Feb 6;350(feb06 1):h391–h391. Available from: 
  34. 34.
    Victora CG, Schellenberg JA, Huicho L, Amaral J, El Arifeen S, Pariyo G, et al. Context matters: interpreting impact findings in child survival evaluations. Health Policy and Planning. 2005 Dec 1;20(suppl_1):i18–i31. Available from:
  35. 35.
    Eckert E, Florey LS, Tongren JE, Salgado SR, Rukundo A, Habimana JP, et al. Impact evaluation of malaria control interventions on morbidity and all-cause child mortality in Rwanda, 2000–2010. American Journal of Tropical Medicine and Hygiene. 2017 Sep 27;97(3_Suppl):99–110. Available from:
  36. 36.
    World Health Organization. Measuring the impact of national PMTCT programmes: towards the elimination of new HIV infections among children by 2015 and keeping their mothers alive. A short guide on methods. Geneva, Switzerland: World Health Organization; 2012. [cited 2018 5th November]. Available from:
  37. 37.
    Hill A, Dauncey T, Levi J, Heath K, Casas CP. Higher risks of mother-to-child HIV transmission in countries with lower HIV prevalence: UNAIDS 2013 results for 32 countries with generalised epidemics. Journal of Virus Eradication. 2015;1(4):257. Available from:
  38. 38.
    Ministry of Health Rwanda. Mid term review of the Rwanda third health sector strategic plan. 2015 [cited 2018 14th February]. Available from:
  39. 39.
    International Health Partnership (IHP). Joint annual health sector reviews: A review of experience. 2013 [cited 2018 14th February]. Available from:
  40. 40.
    Bennett S, Peters DH. Assessing national health systems: Why and how. Health Systems & Reform. 2015 Jan 2;1(1):9–17. Available from:
  41. 41.
    World Health Organization. A common framework for monitoring performance and evaluation of the scale-up for better health. 2008 [cited 2018 14th February]. Available from:
  42. 42.
    Wikipedia. International Health Partnership. 2015 [cited 2018 16th February]. Available from:
  43. 43.
    Universal Health Coverage (UHC). UHC 2030 is the global movement to build stronger health systems for universal health coverage. [cited 2018 16th January]. Available from:
  44. 44.
    World Health Organization. Monitoring, evaluation and review of national health strategies: a country-led platform for information and accountability. 2011 [cited 2018 14th February]. Available from:

Copyright information

© The Author(s) 2019

Authors and Affiliations

  • Sarah B. Macfarlane
    • 1
    Email author
  • Muhammed M. Lecky
    • 2
  • Olufemi Adegoke
    • 3
  • Nkata Chuku
    • 4
  1. 1.Department of Epidemiology and Biostatistics, School of Medicine, and Institute for Global Health SciencesUniversity of California San FranciscoSan FranciscoUSA
  2. 2.Independent National Electoral CommissionAbujaNigeria
  3. 3.Oxford Policy ManagementAbujaNigeria
  4. 4.Health Systems Consult LtdAbujaNigeria

Personalised recommendations