Low-value care, typically defined as health services that provide little or no benefit, has potential to cause harm, incur unnecessary costs, and waste limited resources. Although evidence-based guidelines identifying low-value care have increased, the guidelines differ in the type of evidence they cite to support recommendations against its routine use.
We examined the evidentiary rationale underlying recommendations against low-value interventions.
We identified 1167 “low-value care” recommendations across five US organizations: the US Preventive Services Task Force (USPSTF), the “Choosing Wisely” Initiative, American College of Physicians (ACP), American College of Cardiology/American Heart Association (ACC/AHA), and American Society of Clinical Oncology (ASCO). For each recommendation, we classified the reported evidentiary rationale into five groups: (1) low economic value; (2) no net clinical benefit; (3) little or no absolute clinical benefit; (4) insufficient evidence; (5) no reason mentioned. We further investigated whether any cited or otherwise available cost-effectiveness evidence was consistent with conventional low economic value benchmarks (e.g., exceeding $100,000 per quality-adjusted life-year).
Of the identified low-value care recommendations, Choosing Wisely contributed the most (N=582, 50%), followed by ACC/AHA (N=250, 21%). The services deemed “low value” differed substantially across organizations. “No net clinical benefit” (N=428, 37%) and “little or no clinical benefit” (N=296, 25%) were the most commonly reported reasons for classifying an intervention as low value. Consideration of economic value was less frequently reported (N=171, 15%). When relevant cost-effectiveness studies were available, their results were mostly consistent with low-value care recommendations.
Our study found that evidentiary rationales for low-value care vary substantially, with most recommendations relying on clinical evidence. Broadening the evidence base to incorporate cost-effectiveness evidence can help refine the definition of “low-value” care to reflect whether an intervention’s costs are worth the benefits. Developing a consensus grading structure on the strength and evidentiary rationale may help improve de-implementation efforts for low-value care.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
Shrank WH, Rogstad TL, Parekh N. Waste in the US Health Care System: Estimated Costs and Potential for Savings. JAMA. 2019.
Center for Value-Based Insurance Design 2020;Pageshttps://vbidcenter.org/initiatives/low-value-care/ on June 29 2020.
Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390(10090):156-68.
American Board Of Internal Medicine (ABIM) Foundation;Pageshttps://www.choosingwisely.org/ on November 27 2020.
Elshaug AG, McWilliams JM, Landon BE. The value of low-value lists. JAMA. 2013;309(8):775-6.
Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med. 2015;175(12):1913-20.
Carter EA, Morin PE, Lind KD. Costs and Trends in Utilization of Low-value Services Among Older Adults With Commercial Insurance or Medicare Advantage. Med Care. 2017;55(11):931-9.
Chambers JD, Salem MN, D’Cruz BN, Subedi P, Kamal-Bahl SJ, Neumann PJ. A Review of Empirical Analyses of Disinvestment Initiatives. Value Health. 2017;20(7):909-18.
Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring low-value care in Medicare. JAMA Intern Med. 2014;174(7):1067-76.
Schwartz AL, Zaslavsky AM, Landon BE, Chernew ME, McWilliams JM. Low-Value Service Use in Provider Organizations. Health Serv Res. 2018;53(1):87-119.
Colla CH, Morden NE, Sequist TD, Mainor AJ, Li Z, Rosenthal MB. Payer Type and Low-Value Care: Comparing Choosing Wisely Services across Commercial and Medicare Populations. Health Serv Res. 2018;53(2):730-46.
Chua KP, Schwartz AL, Volerman A, Conti RM, Huang ES. Use of Low-Value Pediatric Services Among the Commercially Insured. Pediatrics. 2016;138(6).
Schwartz AL, Jena AB, Zaslavsky AM, McWilliams JM. Analysis of Physician Variation in Provision of Low-Value Services. JAMA Intern Med. 2019;179(1):16-25.
Colla CH. Swimming against the current--what might work to reduce low-value care? N Engl J Med. 2014;371(14):1280-3.
Powers BW, Jain SH, Shrank WH. De-adopting Low-Value Care: Evidence, Eminence, and Economics. JAMA. 2020.
Kim DD, Ollendorf DA, Neumann PJ, Fendrick AM. Crisis into opportunity: can COVID-19 help set a path to improved health care efficiency? Am J Manag Care. 2020;26(9):369-70.
de Vries EF, Struijs JN, Heijink R, Hendrikx RJ, Baan CA. Are low-value care measures up to the task? A systematic review of the literature. BMC Health Serv Res. 2016;16(1):405.
Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M, et al. Reducing ineffective practice: challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy. 2013;18(1):6-12.
Gliwa C, Pearson SD. Evidentiary rationales for the Choosing Wisely Top 5 lists. JAMA. 2014;311(14):1443-4.
Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360-3.
Weinstein MC, Russell LB, Gold MR, Siegel JE. Cost-effectiveness in health and medicine: Oxford university press; 1996.
Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine: Oxford University Press; 2016.
Neumann PJ, Sanders GD. Cost-Effectiveness Analysis 2.0 N Engl J Med. 2017;376(3):203-5.
Center for the Evaluation of Value and Risk in Health 2020;Pages. Accessed at Institute for Clinical Research and Health Policy Studies, Tufts Medical Center at www.cearegistry.org on May 20 2020.
Wilt TJ, Harris RP, Qaseem A. High Value Care Task Force of the American College of P. Screening for cancer: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):718-25.
Harris RP, Wilt TJ, Qaseem A. High Value Care Task Force of the American College of P. A value framework for cancer screening: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):712-7.
US Preventive Services Task Force 2015;Pageshttps://www.uspreventiveservicestaskforce.org/uspstf/sites/default/files/inline-files/procedure-manual-2020_3.pdf on July 10 2020.
Qaseem A, Kansagara D, Lin JS, Mustafa RA, Wilt TJ. Clinical Guidelines Committee of the American College of P. The Development of Clinical Guidelines and Guidance Statements by the Clinical Guidelines Committee of the American College of Physicians: Update of Methods. Ann Intern Med. 2019;170(12):863-70.
Choosing Wisely 2020;Pageshttps://www.choosingwisely.org/our-mission/facts-and-figures/ on July 10 2020.
ACCF/AHA Task Force on Practice Guidelines, American College of Cardiology and American Heart Association, 2010;Pageshttps://www.acc.org/~/media/Non-Clinical/Files-PDFs-Excel-MS-Word-etc/Guidelines/About%20Guidelines%20and%20Clinical%20Documents/Methodology/2014/Methodology%20Practice%20Guidelines.pdf?la=en on July 10 2020.
American Society of Clinical Oncology 2019;Pageshttps://www.asco.org/sites/new-www.asco.org/files/content-files/practice-and-guidelines/documents/2019-Guidelines-Methodology-Manual.pdf on July 10 2020.
Alper BS, Price A, van Zuuren EJ, Fedorowicz Z, Shaughnessy AF, Oettgen P, et al. Consistency of Recommendations for Evaluation and Management of Hypertension. JAMA Network Open. 2019;2(11):e1915975-e.
Parker GB, Graham RK, Tavella G. Is there consensus across international evidence-based guidelines for the management of bipolar disorder? Acta Psychiatrica Scandinavica. 2017;135(6):515-26.
Yu Y, Wang D, Zhou Q, Wang C, Ma X, Gao Y, et al. Recommendations in clinical practice guidelines on gout: systematic review and consistency analysis. Clinical and experimental rheumatology. 2020;38(5):964-72.
Hasan T, Au E, Chen S, Tong A, Wong G. Screening and prevention for latent tuberculosis in immunosuppressed patients at risk for tuberculosis: a systematic review of clinical practice guidelines. BMJ Open. 2018;8(9):e022445.
Schpero WL. Limiting low-value care by “Choosing Wisely”. Virtual Mentor. 2014;16(2):131-4.
Roman BR, Asch DA. Faded promises: the challenge of deadopting low-value care. American College of Physicians; 2014.
Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of clinical epidemiology. 2011;64(4):401-6.
Burgers JS, Grol R, Klazinga NS, Mäkelä M, Zaat J, COLLABORATION FTA. Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003;15(1):31-045.
Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477-81.
Neumann PJ, Cohen JT. Measuring the Value of Prescription Drugs. N Engl J Med. 2015;373(27):2595-7.
Grady D, Redberg RF. Less is more: how less health care can result in better health. Archives of internal medicine. 2010;170(9):749-50.
Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801-2.
American Board of Internal Medicine Foundation, American College of Physicians-American Society of Internal Medicine Foundation, European Federation of Internal Medicine. Medical professionalism in the new millennium: a physician charter. Ann Intern Med. 2002;136(3):243-6.
Pandya A. Adding Cost-effectiveness to Define Low-Value Care. JAMA. 2018;319(19):1977-8.
Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness--the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796-7.
Ryen L, Svensson M. The Willingness to Pay for a Quality Adjusted Life Year: A Review of the Empirical Literature. Health Econ. 2014.
Nimdet K, Chaiyakunapruk N, Vichansavakul K, Ngorsuraches S. A systematic review of studies eliciting willingness-to-pay per quality-adjusted life year: does it justify CE threshold? PLoS One. 2015;10(4):e0122760.
Hirth RA, Chernew ME, Miller E, Fendrick AM, Weissert WG. Willingness to pay for a quality-adjusted life year: in search of a standard. Med Decis Making. 2000;20(3):332-42.
Vanness DJ. Lomas J, Ahn H. A Health Opportunity Cost Threshold for Cost-Effectiveness Analysis in the United States. Ann Intern Med. 2020.
This project was supported by a research grant from Arnold Ventures (formerly, the Laura and John Arnold Foundation).
Conflict of Interest
All of the authors are supported by a research grant from Arnold Ventures. DDK, LAD, ATD, JDS, DAO, and PJN are employees of the Center for the Evaluation of Value and Risk in Health (CEVR) at Tufts Medical Center, which maintains the CEA Registry used as a data source. The CEA Registry is supported by subscription revenue from academic institutions, government agencies, and pharmaceutical and device companies. Dr. Wong is a member of the US Preventive Services Task Force.
This article does not necessarily represent the views and policies of the USPSTF. The funder had no role in study design, data collection and analysis, the decision to publish, and preparation of the manuscript.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kim, D.D., Do, L.A., Daly, A.T. et al. An Evidence Review of Low-Value Care Recommendations: Inconsistency and Lack of Economic Evidence Considered. J GEN INTERN MED (2021). https://doi.org/10.1007/s11606-021-06639-2
- low-value care