Cost-Effectiveness Thresholds: the Past, the Present and the Future

  • Praveen Thokala
  • Jessica Ochalek
  • Ashley A. Leech
  • Thaison Tong
Leading Article

Abstract

Cost-effectiveness (CE) thresholds are being discussed more frequently and there have been many new developments in this area; however, there is a lack of understanding about what thresholds mean and their implications. This paper provides an overview of the CE threshold literature. First, the meaning of a CE threshold and the key assumptions involved (perfect divisibility, marginal increments in budget, etc.) are highlighted using a hypothetical example, and the use of historic/heuristic estimates of the threshold is noted along with their limitations. Recent endeavours to estimate the empirical value of the thresholds, both from the supply side and the demand side, are then presented. The impact on CE thresholds of future directions for the field, such as thresholds across sectors and the incorporation of multiple criteria beyond quality-adjusted life-years as a measure of ‘value’, are highlighted. Finally, a number of common issues and misconceptions associated with CE thresholds are addressed.

Notes

Acknowledgements

The authors would like to thank Brian Reddy and Simon Walker for their advice on the Irish threshold and economic evaluation across multiple sectors, respectively.

Author contributions

PT conceived the initial idea for the paper, and all authors (PT, JO, AL, TT) contributed to developing the outline of the paper. TT led on the hypothetical example, including the development of the Microsoft Excel file in the ESM; JO led on the sections on empirical estimates of the supply side threshold; AL led on the section about the WHO-CHOICE guidelines and contributed to the demand side thresholds; and PT led on the remaining sections in the paper. All authors were involved in the multiple revisions of the paper before signing off on the final version.

Compliance with ethical standards

Conflict of interest

Praveen Thokala, Jessica Ochalek, Ashley Leech, and Thaison Tong have no conflicts of interest to declare.

Supplementary material

40273_2017_606_MOESM1_ESM.xlsm (358 kb)
Supplementary material 1 (XLSM 128 kb)

References

  1. 1.
    Neumann PJ, Thorat T, Zhong Y, Anderson J, Farquhar M, Salem M, et al. A systematic review of cost-effectiveness studies reporting cost-per-DALY averted. PloS One. 2016;11(12):e0168512.CrossRefPubMedPubMedCentralGoogle Scholar
  2. 2.
    Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015. p. 464.Google Scholar
  3. 3.
    Guide to the methods of technology appraisal 2013. Guidance and guidelines. NICE. https://www.nice.org.uk/process/pmg9/chapter/foreword. Accessed 14 Dec 2017.
  4. 4.
    Guidelines for the Economic Evaluation of Health Technologies: Canada. CADTH.ca https://www.cadth.ca/about-cadth/how-we-do-it/methods-and-guidelines/guidelines-for-the-economic-evaluation-of-health-technologies-canada. Accessed 14 Dec 2017.
  5. 5.
    Australian Government Department of Health. Guidelines for preparing a submission to the Pharmaceutical Benefits Advisory Committee: Version 5.0. 2016. https://pbac.pbs.gov.au/content/information/files/pbac-guidelines-version-5.pdf. Accessed Dec 2017.
  6. 6.
    Sculpher M, Claxton K, Pearson SD. Developing a value framework: the need to reflect the opportunity costs of funding decisions. Value Health. 2017;20(2):234–9.CrossRefPubMedGoogle Scholar
  7. 7.
    Culyer T. Cost-effectiveness thresholds in health care: a bookshelf guide to their meaning and use. Health Economics Policy Law. 2016;11(4):415–432Google Scholar
  8. 8.
    Bertram MY, Lauer JA, De Joncheere K, Edejer T, Hutubessy R, Kieny M-P, et al. Cost-effectiveness thresholds: pros and cons. Bull World Health Organ. 2016;94(12):925–30.CrossRefPubMedPubMedCentralGoogle Scholar
  9. 9.
    Woods B, Revill P, Sculpher M, Claxton K. Country-level cost-effectiveness thresholds: initial estimates and the need for further research. Value Health. 2016;19(8):929–35.CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    Vallejo-Torres L, García-Lorenzo B, Castilla I, Valcárcel-Nazco C, García-Pérez L, Linertová R, et al. On the estimation of the cost-effectiveness threshold: Why, What, How? Value Health. 2016;19(5):558–66.CrossRefPubMedGoogle Scholar
  11. 11.
    Schaffer SK, Cubi-Molla P, Devlin N, Towse A. Shaping the research agenda to estimate relevant cost-effectiveness thresholds for health technology assessment decision making: Report for ABPI. 2016. https://www.ohe.org/system/files/private/publications/Shaping%20the%20research%20agenda%20to%20estimate%20cost-effectiveness%20thresholds%20FOR%20PUBLICATION.pdf.
  12. 12.
    Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in health and medicine. Oxford, New York: Oxford University Press; 1996. p. 456.Google Scholar
  13. 13.
    Crown W, Buyukkaramikli N, Thokala P, Morton A, Sir MY, Marshall DA, et al. Constrained optimization methods in health services research-an introduction: Report 1 of the ISPOR optimization methods emerging good practices task force. Value. 2017;20(3):310–9.Google Scholar
  14. 14.
    Paulden M, O’Mahony J, McCabe C. Determinants of change in the cost-effectiveness threshold. Med Decis. 2017;37(2):264–76.CrossRefGoogle Scholar
  15. 15.
    Stinnett AA, Paltiel AD. Mathematical programming for the efficient allocation of health care resources. J Health Econ. 1996;15(5):641–53.CrossRefPubMedGoogle Scholar
  16. 16.
    Epstein DM, Chalabi Z, Claxton K, Sculpher M. Efficiency, equity, and budgetary policies: informing decisions using mathematical programming. Med Decis Mak. 2007;27(2):128–37.CrossRefGoogle Scholar
  17. 17.
    Weinstein M, Zeckhauser R. Critical ratios and efficient allocation. J Public Econ. 1973;2(2):147–57.CrossRefGoogle Scholar
  18. 18.
    Cleemput I, Neyt M, Thiry N, De Laet C, Leys M. Using threshold values for cost per quality-adjusted life-year gained in healthcare decisions. Int J Technol Assess Health Care. 2011;27(1):71–6.CrossRefPubMedGoogle Scholar
  19. 19.
    Hummel JM, Oliveira MD, Bana e Costa CAB, IJzerman MJ. Supporting the project portfolio selection decision of research and development investments by means of multi-criteria resource allocation modelling. In: Marsh K, Goetghebeur M, Thokala P, Baltussen R (eds) Multi-criteria decision analysis to support healthcare decisions. Cham: Springer; 2017 [cited 14 Dec 2017]. pp. 89–103. https://link-springer-com.ezproxy.library.tufts.edu/chapter/10.1007/978-3-319-47540-0_6.
  20. 20.
    Eckermann S, Pekarsky B. Can the real opportunity cost stand up: displaced services, the straw man outside the room. PharmacoEconomics. 2014;32(4):319–25.CrossRefPubMedGoogle Scholar
  21. 21.
    Hutubessy R, Chisholm D, Edejer TTT. Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Eff Resour Alloc. 2003;1(1):8.CrossRefPubMedPubMedCentralGoogle Scholar
  22. 22.
    Newall AT, Jit M, Hutubessy R. Are current cost-effectiveness thresholds for low- and middle-income countries useful? Examples from the world of vaccines. PharmacoEconomics. 2014;32(6):525–31.CrossRefPubMedGoogle Scholar
  23. 23.
    Phoya A, Araru T, Kachala R, Chizonga J, Bowie C. Disease control priorities in developing countries, 3rd edn. Working Paper #9: Setting Strategic Health Sector Priorities in Malawi. http://dcp-3.org/sites/default/files/resources/DCP%20Working%20Paper%209_Malawi%20Case%20Study_0.pdf.
  24. 24.
    McCabe C, Claxton K, Culyer AJ. The NICE cost-effectiveness threshold. PharmacoEconomics. 2008;26(9):733–44.CrossRefPubMedGoogle Scholar
  25. 25.
    O’Mahony JF, Coughlan D. The Irish cost-effectiveness threshold: does it support rational rationing or might it lead to unintended harm of Ireland’s health system? Value Health. 2015;18(7):A570.CrossRefPubMedGoogle Scholar
  26. 26.
    Schwarzer R, Rochau U, Saverno K, Jahn B, Bornschein B, Muehlberger N, et al. Systematic overview of cost-effectiveness thresholds in ten countries across four continents. J Comp Eff Res. 2015;4(5):485–504.CrossRefPubMedGoogle Scholar
  27. 27.
    Raftery JP. NICE’s cost-effectiveness range: should it be lowered? PharmacoEconomics. 2014;32(7):613–5.CrossRefPubMedGoogle Scholar
  28. 28.
    National Institute for Health and Care Excellence. Guide to the methods of technology appraisal 2013. London: (NICE); 2013. https://www.nice.org.uk/process/pmg9/chapter/the-appraisal-of-the-evidence-and-structured-decision-making#research-recommendations.
  29. 29.
    National Institute for Health and Clinical Excellence (NICE). National Institute for Health and Clinical Excellence: appraising life-extending, end of life treatments. 2009. https://www.nice.org.uk/guidance/gid-tag387/resources/appraising-life-extending-end-of-life-treatments-paper2.
  30. 30.
    Devlin N, Parkin D. Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ. 2004;13(5):437–52.CrossRefPubMedGoogle Scholar
  31. 31.
    Claxton K, Sculpher M, Palmer S, Culyer AJ. Causes for concern: is NICE failing to uphold its responsibilities to all NHS patients? Health Econ. 2015;24(1):1–7.CrossRefPubMedGoogle Scholar
  32. 32.
    Framework Agreement between the Irish Pharmaceutical Healthcare Association Ltd and the Department of Health and the Health Service Executive on the Supply Terms, Conditions and Prices of Medicines [cited 14 Dec 2017]. http://www.hse.ie/eng/about/Who/cpu/IPHA_Agreement_2012.pdf.
  33. 33.
    NCPE Submission Process. National Centre for Pharmacoeconomics [cited 14 Dec 2017]. http://www.ncpe.ie/submission-process/.
  34. 34.
    Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness: the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796–7.CrossRefPubMedGoogle Scholar
  35. 35.
    Final Value Assessment Framework: updates for 2017–2019—ICER [cited 17 Oct 2017]. https://icer-review.org/material/final-vaf-2017-2019/.
  36. 36.
    Sullivan SD, Yeung K, Vogeler C, Ramsey SD, Wong E, Murphy CO, et al. Design, implementation, and first-year outcomes of a value-based drug formulary. J Manag Care Spec Pharm. 2015;21(4):269–75.CrossRefPubMedGoogle Scholar
  37. 37.
    Leech AA, Kim D, Cohen J, Neumann PJ. Use and misuse of cost-effectiveness analysis thresholds in low and middle-income countries: trends in cost-per-DALY studies. Value Health. (In press) Google Scholar
  38. 38.
    WHO Commission on Macroeconomics and Health, World Health Organization. Macroeconomics and health: investing in health for economic development: executive summary. Macroéconomie et santé: investir dans la santé pour le développement économique: résumé d’ orientation du rapport. 2001 [cited 17 Oct 2017]. http://www.who.int/iris/handle/10665/42463.
  39. 39.
    Robinson LA, Hammitt JK, Chang AY, Resch S. Understanding and improving the one and three times GDP per capita cost-effectiveness thresholds. Health Policy Plan. 2017;32(1):141–5.CrossRefPubMedGoogle Scholar
  40. 40.
    Shillcutt SD, Walker DG, Goodman CA, Mills AJ. Cost-effectiveness in low- and middle-income countries. PharmacoEconomics. 2009;27(11):903–17.CrossRefPubMedPubMedCentralGoogle Scholar
  41. 41.
    Ochalek J. Cost per DALY averted thresholds for low- and middle-income countries—Research Database, The University of York. https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP122_cost_DALY_LMIC_threshold.pdf. Accessed 3 July 2017.
  42. 42.
    Claxton K, Martin S, Soares M, Rice N, Spackman E, Hinde S, et al. Methods for the estimation of the National Institute for Health and Care Excellence cost-effectiveness threshold. Health Technol Assess. 2015;19(14):1–503 (v–vi).CrossRefPubMedPubMedCentralGoogle Scholar
  43. 43.
    Marseille E, Larson B, Kazi DS, Kahn JG, Rosen S. Thresholds for the cost-effectiveness of interventions: alternative approaches. Bull World Health Organ. 2015;93(2):118–24.CrossRefPubMedGoogle Scholar
  44. 44.
    Paris V, Belloni A. Value in pharmaceutical pricing. Country Profile: Australia. OECD. 2014 Nov (Working Paper No. 63). https://www.oecd.org/health/Value-in-Pharmaceutical-Pricing-Australia.pdf. Accessed Dec 2017.
  45. 45.
    Henry DA, Hill SR, Harris A. Drug prices and value for money: the Australian pharmaceutical benefits scheme. JAMA. 2005;294(20):2630–2.CrossRefPubMedGoogle Scholar
  46. 46.
    Griffiths EA, Vadlamudi NK. Cadth’s $50,000 cost-effectiveness threshold: fact or fiction? 2016; ISPOR. https://www.ispor.org/research_pdfs/54/pdffiles/PHP278.pdf. Accessed Dec 2017.
  47. 47.
    Grocott R, Metcalfe S, Alexander P, Werner R. Assessing the value for money of pharmaceuticals in New Zealand: PHARMAC’s approach to cost-utility analysis. N Z Med J. 2013;126(1378):60–73.PubMedGoogle Scholar
  48. 48.
    O’Keeffe KM, Gander PH, Scott WG, Scott HM. Insomnia treatment in New Zealand. N Z Med J. 2012;125(1349):46–59.PubMedGoogle Scholar
  49. 49.
    Simoens S. Health economic assessment: a methodological primer. Int J Environ Res Public Health. 2009;6(12):2950–66.CrossRefPubMedPubMedCentralGoogle Scholar
  50. 50.
    Metcalfe S, Rodgers A, Werner R, Schousboe C. PHARMAC has no cost-effectiveness threshold. N Z Med J. 2012;125(1350):99–101.PubMedGoogle Scholar
  51. 51.
    Metcalfe S, Grocott R. Comments on “Simoens, S. Health economic assessment: a methodological primer. Int. J. Environ. Res. Public Health 2009, 6, 2950–2966”—New Zealand in fact has no cost-effectiveness threshold. Int J Environ Res Public Health. 2010;7(4):1831–4.CrossRefPubMedPubMedCentralGoogle Scholar
  52. 52.
    Scottish Medicines Consortium. SMC Modifiers used in Appraising New Medicines. https://www.scottishmedicines.org.uk/About_SMC/Policy_statements/SMC_Modifiers_used_in_Appraising_New_Medicines. Accessed 14 Dec 2017.
  53. 53.
    Kamae I. Value-based approaches to healthcare systems and pharmacoeconomics requirements in Asia: South Korea, Taiwan, Thailand and Japan. Pharmacoeconomics. 2010;28(10):831–8.CrossRefPubMedGoogle Scholar
  54. 54.
    Coelho De Soarez P, Dutilh Novaes HM. Cost-effectiveness thresholds and the Brazilian Unified National Health System. 2017. http://www.scielo.br/pdf/csp/v33n4/1678-4464-csp-33-04-e00040717.pdf. Accessed Dec 2017.
  55. 55.
    Gravelle HS, Backhouse ME. International cross-section analysis of the determination of mortality. Soc Sci Med. 1987;25(5):427–41.CrossRefPubMedGoogle Scholar
  56. 56.
    Barnsley P, Towse A, Karlsberg Schaffer S, Sussex J. Critique of CHE Research Paper 81: methods for the estimation of the NICE cost effectiveness threshold. OHE. 2013. https://www.ohe.org/publications/critique-che-research-paper-81-methods-estimation-nice-cost-effectiveness-threshold. Accessed 14 Dec 2017.
  57. 57.
    Claxton K, Sculpher M. Response to the OHE critique of CHE Research paper 81. https://www.york.ac.uk/media/che/documents/Response%20to%20the%20OHE%20critique%20of%20CHE%20Research%20paper%2081.pdf. Accessed Dec 2017.
  58. 58.
    Edney L, Afzali H, Cheng T, Karnon J. Estimating the reference ICER for the Australian health system. Pharmacoeconomics. 2017.  https://doi.org/10.1007/s40273-017-0585-2 (Epub 22 Dec 2017).
  59. 59.
    Vallejo-Torres L, GarcÌa-Lorenzo B, Serrano-Aguilar P. Estimating a cost-effectiveness threshold for the Spanish NHS. FEDEA; 2016 Jun. Report No. eee2016-22. https://www.ucl.ac.uk/dahr/pdf/HESG/Paper_A31.pdf. Accessed Dec 2017.
  60. 60.
    Government of the Republic of Malawi. Health Sector Strategic Plan II (2017–2022): towards Universal Coverage. 2017. www.health.gov.mw/index.php/policies-strategies?download=47:hssp-ii-final Accessed Dec 2017.
  61. 61.
    Ochalek J, Claxton K, Revill P, Sculpher M, Rollinger A. Supporting the development of an essential health package: principles and initial assessment for Malawi. Centre for Health Economics, University of York; 2016 Sep. (Working Papers). Report No.: 136cherp https://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP136_EHP_Malawi_interventions.pdf. Accessed 17 Oct 2017.
  62. 62.
    Thavorncharoensap M, Teerawattananon Y, Natanant S, Kulpeng W, Yothasamut J, Werayingyong P. Estimating the willingness to pay for a quality-adjusted life year in Thailand: does the context of health gain matter? Clinicoecon Outcomes Res. 2013;5:29–36.CrossRefPubMedPubMedCentralGoogle Scholar
  63. 63.
    Teerawattananon Y, Tritasavit N, Suchonwanich N, Kingkaew P. The use of economic evaluation for guiding the pharmaceutical reimbursement list in Thailand. Z Evidenz Fortbild Qual Im Gesundheitswesen. 2014;108(7):397–404.CrossRefGoogle Scholar
  64. 64.
    Lim YW, Shafie AA, Chua GN, Ahmad Hassali MA. Determination of cost-effectiveness threshold for health care interventions in Malaysia. Value Health. 2017;20(8):1131–8.CrossRefPubMedGoogle Scholar
  65. 65.
    GDP per capita (current US$). Data. https://data.worldbank.org/indicator/NY.GDP.PCAP.CD. Accessed 14 Dec 2017.
  66. 66.
    Initiative on US Value Assessment Frameworks. https://www.ispor.org/ValueAssessmentFrameworks/Index. Accessed 17 Oct 2017.
  67. 67.
    Sanders GD, Neumann PJ, Basu A, Brock DW, Feeny D, Krahn M, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103.CrossRefPubMedGoogle Scholar
  68. 68.
    Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG, editors. Cost-effectiveness in health and medicine. 2nd ed. New York: Oxford University Press; 2016. p. 536.Google Scholar
  69. 69.
    Devlin NJ, Sussex J. Incorporating multiple criteria in HTA: methods and processes. OHE, Office of Health Economics Research; 2011. https://healthpolicy.fsi.stanford.edu/sites/default/files/ohe_hta_methods.pdf. Accessed Dec 2017.
  70. 70.
    Carrera P, Ijzerman MJ. Are current ICER thresholds outdated? Valuing medicines in the era of personalized healthcare. Expert Rev Pharmacoecon Outcomes Res. 2016;16(4):435–7.CrossRefPubMedGoogle Scholar
  71. 71.
    Marsh K, Ijzerman M, Thokala P, Baltussen R, Boysen M, Kaló Z, et al. Multiple criteria decision analysis for health care decision making: emerging good practices: report 2 of the ISPOR MCDA Emerging Good Practices Task Force. Value Health. 2016;19(2):125–37.CrossRefPubMedGoogle Scholar
  72. 72.
    Remme M, Martinez-Alvarez M, Vassall A. Cost-effectiveness thresholds in global health: taking a multisectoral perspective. Value Health. 2017;20(4):699–704.CrossRefPubMedGoogle Scholar
  73. 73.
    Nimdet K, Chaiyakunapruk N, Vichansavakul K, Ngorsuraches S. A systematic review of studies eliciting willingness-to-pay per quality-adjusted life year: does it justify CE threshold? PloS One. 2015;10(4):e0122760.CrossRefPubMedPubMedCentralGoogle Scholar
  74. 74.
    Gafni A, Birch S. Incremental cost-effectiveness ratios (ICERs): the silence of the lambda. Soc Sci Med. 2006;62(9):2091–100.CrossRefPubMedGoogle Scholar
  75. 75.
    Afzali HHA, Karnon J, Sculpher M. Should the Lambda (λ) Remain Silent? Pharmacoeconomics. 2016;34(4):323–9.CrossRefGoogle Scholar
  76. 76.
    Towse A. Should NICE’s threshold range for cost per QALY be raised? Yes. BMJ. 2009;338:b181.CrossRefPubMedGoogle Scholar
  77. 77.
    Collins M, Latimer N. NICE’s end of life decision making scheme: impact on population health. BMJ. 2013;346:f1363.CrossRefPubMedGoogle Scholar
  78. 78.
    Lomas J, Claxton K, Martin S, Soares M. Resolving the “cost-effective but unaffordable” “paradox”: estimating the health opportunity costs of non-marginal budget impacts. Value Health. (In Press).Google Scholar
  79. 79.
    Chhatwal J, Kanwal F, Roberts MS, Dunn MA. Cost-effectiveness and budget impact of hepatitis C virus treatment with sofosbuvir and ledipasvir in the United States. Ann Intern Med. 2015;162(6):397–406.CrossRefPubMedPubMedCentralGoogle Scholar
  80. 80.
    National Institute for Health and Care Excellence. Technology Appraisal and Highly Specialised Technologies Programmes. Procedure for varying the funding requirement to take account of net budget impact. https://www.nice.org.uk/Media/Default/About/what-we-do/NICE-guidance/NICE-technology-appraisals/TA-HST-procedure-varying-the-funding-direction.pdf. Accessed 14 Dec 2017.
  81. 81.
    Ubel PA, Hirth RA, Chernew ME, Fendrick AM. What is the price of life and why doesn’t it increase at the rate of inflation? Arch Intern Med. 2003;163(14):1637–41.CrossRefPubMedGoogle Scholar
  82. 82.
    Thokala P, Dixon S, Jahn B. Resource modelling: the missing piece of the HTA jigsaw? Pharmacoeconomics. 2015;33(3):193–203.CrossRefPubMedGoogle Scholar
  83. 83.
    Vassall A, Mangham-Jefferies L, Gomez GB, Pitt C, Foster N. Incorporating demand and supply constraints into economic evaluations in low-income and middle-income countries. Health Econ. 2016;25:95–115.CrossRefPubMedPubMedCentralGoogle Scholar
  84. 84.
    Griffiths EA, Hendrich JK, Stoddart SD, Walsh SC. Acceptance of health technology assessment submissions with incremental cost-effectiveness ratios above the cost-effectiveness threshold. Clinicoecon Outcomes Res. 2015;7:463–76.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Health Economics and Decision Science, School of Health and Related ResearchUniversity of SheffieldSheffieldUK
  2. 2.Centre for Health EconomicsUniversity of YorkYorkUK
  3. 3.Center for the Evaluation of Value and Risk in Health (CEVR), Tufts Medical CenterBostonUSA

Personalised recommendations