Skip to main content
Top
Published in: Journal of General Internal Medicine 11/2021

01-11-2021 | Care | Original Research

An Evidence Review of Low-Value Care Recommendations: Inconsistency and Lack of Economic Evidence Considered

Authors: David D. Kim, PhD, Lauren A. Do, BS, Allan T. Daly, MS, John B. Wong, MD, James D. Chambers, PhD, Daniel A. Ollendorf, PhD, Peter J. Neumann, ScD

Published in: Journal of General Internal Medicine | Issue 11/2021

Login to get access

Abstract

Background

Low-value care, typically defined as health services that provide little or no benefit, has potential to cause harm, incur unnecessary costs, and waste limited resources. Although evidence-based guidelines identifying low-value care have increased, the guidelines differ in the type of evidence they cite to support recommendations against its routine use.

Objective

We examined the evidentiary rationale underlying recommendations against low-value interventions.

Design

We identified 1167 “low-value care” recommendations across five US organizations: the US Preventive Services Task Force (USPSTF), the “Choosing Wisely” Initiative, American College of Physicians (ACP), American College of Cardiology/American Heart Association (ACC/AHA), and American Society of Clinical Oncology (ASCO). For each recommendation, we classified the reported evidentiary rationale into five groups: (1) low economic value; (2) no net clinical benefit; (3) little or no absolute clinical benefit; (4) insufficient evidence; (5) no reason mentioned. We further investigated whether any cited or otherwise available cost-effectiveness evidence was consistent with conventional low economic value benchmarks (e.g., exceeding $100,000 per quality-adjusted life-year).

Results

Of the identified low-value care recommendations, Choosing Wisely contributed the most (N=582, 50%), followed by ACC/AHA (N=250, 21%). The services deemed “low value” differed substantially across organizations. “No net clinical benefit” (N=428, 37%) and “little or no clinical benefit” (N=296, 25%) were the most commonly reported reasons for classifying an intervention as low value. Consideration of economic value was less frequently reported (N=171, 15%). When relevant cost-effectiveness studies were available, their results were mostly consistent with low-value care recommendations.

Conclusions

Our study found that evidentiary rationales for low-value care vary substantially, with most recommendations relying on clinical evidence. Broadening the evidence base to incorporate cost-effectiveness evidence can help refine the definition of “low-value” care to reflect whether an intervention’s costs are worth the benefits. Developing a consensus grading structure on the strength and evidentiary rationale may help improve de-implementation efforts for low-value care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Shrank WH, Rogstad TL, Parekh N. Waste in the US Health Care System: Estimated Costs and Potential for Savings. JAMA. 2019. Shrank WH, Rogstad TL, Parekh N. Waste in the US Health Care System: Estimated Costs and Potential for Savings. JAMA. 2019.
3.
go back to reference Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390(10090):156-68.CrossRef Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390(10090):156-68.CrossRef
5.
go back to reference Elshaug AG, McWilliams JM, Landon BE. The value of low-value lists. JAMA. 2013;309(8):775-6.CrossRef Elshaug AG, McWilliams JM, Landon BE. The value of low-value lists. JAMA. 2013;309(8):775-6.CrossRef
6.
go back to reference Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med. 2015;175(12):1913-20.CrossRef Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, et al. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med. 2015;175(12):1913-20.CrossRef
7.
go back to reference Carter EA, Morin PE, Lind KD. Costs and Trends in Utilization of Low-value Services Among Older Adults With Commercial Insurance or Medicare Advantage. Med Care. 2017;55(11):931-9.CrossRef Carter EA, Morin PE, Lind KD. Costs and Trends in Utilization of Low-value Services Among Older Adults With Commercial Insurance or Medicare Advantage. Med Care. 2017;55(11):931-9.CrossRef
8.
go back to reference Chambers JD, Salem MN, D’Cruz BN, Subedi P, Kamal-Bahl SJ, Neumann PJ. A Review of Empirical Analyses of Disinvestment Initiatives. Value Health. 2017;20(7):909-18.CrossRef Chambers JD, Salem MN, D’Cruz BN, Subedi P, Kamal-Bahl SJ, Neumann PJ. A Review of Empirical Analyses of Disinvestment Initiatives. Value Health. 2017;20(7):909-18.CrossRef
9.
go back to reference Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring low-value care in Medicare. JAMA Intern Med. 2014;174(7):1067-76.CrossRef Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring low-value care in Medicare. JAMA Intern Med. 2014;174(7):1067-76.CrossRef
10.
go back to reference Schwartz AL, Zaslavsky AM, Landon BE, Chernew ME, McWilliams JM. Low-Value Service Use in Provider Organizations. Health Serv Res. 2018;53(1):87-119.CrossRef Schwartz AL, Zaslavsky AM, Landon BE, Chernew ME, McWilliams JM. Low-Value Service Use in Provider Organizations. Health Serv Res. 2018;53(1):87-119.CrossRef
11.
go back to reference Colla CH, Morden NE, Sequist TD, Mainor AJ, Li Z, Rosenthal MB. Payer Type and Low-Value Care: Comparing Choosing Wisely Services across Commercial and Medicare Populations. Health Serv Res. 2018;53(2):730-46.CrossRef Colla CH, Morden NE, Sequist TD, Mainor AJ, Li Z, Rosenthal MB. Payer Type and Low-Value Care: Comparing Choosing Wisely Services across Commercial and Medicare Populations. Health Serv Res. 2018;53(2):730-46.CrossRef
12.
go back to reference Chua KP, Schwartz AL, Volerman A, Conti RM, Huang ES. Use of Low-Value Pediatric Services Among the Commercially Insured. Pediatrics. 2016;138(6). Chua KP, Schwartz AL, Volerman A, Conti RM, Huang ES. Use of Low-Value Pediatric Services Among the Commercially Insured. Pediatrics. 2016;138(6).
13.
go back to reference Schwartz AL, Jena AB, Zaslavsky AM, McWilliams JM. Analysis of Physician Variation in Provision of Low-Value Services. JAMA Intern Med. 2019;179(1):16-25.CrossRef Schwartz AL, Jena AB, Zaslavsky AM, McWilliams JM. Analysis of Physician Variation in Provision of Low-Value Services. JAMA Intern Med. 2019;179(1):16-25.CrossRef
14.
go back to reference Colla CH. Swimming against the current--what might work to reduce low-value care? N Engl J Med. 2014;371(14):1280-3.CrossRef Colla CH. Swimming against the current--what might work to reduce low-value care? N Engl J Med. 2014;371(14):1280-3.CrossRef
15.
go back to reference Powers BW, Jain SH, Shrank WH. De-adopting Low-Value Care: Evidence, Eminence, and Economics. JAMA. 2020. Powers BW, Jain SH, Shrank WH. De-adopting Low-Value Care: Evidence, Eminence, and Economics. JAMA. 2020.
16.
go back to reference Kim DD, Ollendorf DA, Neumann PJ, Fendrick AM. Crisis into opportunity: can COVID-19 help set a path to improved health care efficiency? Am J Manag Care. 2020;26(9):369-70.CrossRef Kim DD, Ollendorf DA, Neumann PJ, Fendrick AM. Crisis into opportunity: can COVID-19 help set a path to improved health care efficiency? Am J Manag Care. 2020;26(9):369-70.CrossRef
17.
go back to reference de Vries EF, Struijs JN, Heijink R, Hendrikx RJ, Baan CA. Are low-value care measures up to the task? A systematic review of the literature. BMC Health Serv Res. 2016;16(1):405.CrossRef de Vries EF, Struijs JN, Heijink R, Hendrikx RJ, Baan CA. Are low-value care measures up to the task? A systematic review of the literature. BMC Health Serv Res. 2016;16(1):405.CrossRef
18.
go back to reference Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M, et al. Reducing ineffective practice: challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy. 2013;18(1):6-12.CrossRef Garner S, Docherty M, Somner J, Sharma T, Choudhury M, Clarke M, et al. Reducing ineffective practice: challenges in identifying low-value health care using Cochrane systematic reviews. J Health Serv Res Policy. 2013;18(1):6-12.CrossRef
19.
go back to reference Gliwa C, Pearson SD. Evidentiary rationales for the Choosing Wisely Top 5 lists. JAMA. 2014;311(14):1443-4.CrossRef Gliwa C, Pearson SD. Evidentiary rationales for the Choosing Wisely Top 5 lists. JAMA. 2014;311(14):1443-4.CrossRef
20.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360-3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360-3.PubMed
21.
go back to reference Weinstein MC, Russell LB, Gold MR, Siegel JE. Cost-effectiveness in health and medicine: Oxford university press; 1996. Weinstein MC, Russell LB, Gold MR, Siegel JE. Cost-effectiveness in health and medicine: Oxford university press; 1996.
22.
go back to reference Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine: Oxford University Press; 2016.CrossRef Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine: Oxford University Press; 2016.CrossRef
23.
go back to reference Neumann PJ, Sanders GD. Cost-Effectiveness Analysis 2.0 N Engl J Med. 2017;376(3):203-5.CrossRef Neumann PJ, Sanders GD. Cost-Effectiveness Analysis 2.0 N Engl J Med. 2017;376(3):203-5.CrossRef
24.
go back to reference Center for the Evaluation of Value and Risk in Health 2020;Pages. Accessed at Institute for Clinical Research and Health Policy Studies, Tufts Medical Center at www.cearegistry.org on May 20 2020. Center for the Evaluation of Value and Risk in Health 2020;Pages. Accessed at Institute for Clinical Research and Health Policy Studies, Tufts Medical Center at www.​cearegistry.​org on May 20 2020.
25.
go back to reference Wilt TJ, Harris RP, Qaseem A. High Value Care Task Force of the American College of P. Screening for cancer: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):718-25.CrossRef Wilt TJ, Harris RP, Qaseem A. High Value Care Task Force of the American College of P. Screening for cancer: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):718-25.CrossRef
26.
go back to reference Harris RP, Wilt TJ, Qaseem A. High Value Care Task Force of the American College of P. A value framework for cancer screening: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):712-7.CrossRef Harris RP, Wilt TJ, Qaseem A. High Value Care Task Force of the American College of P. A value framework for cancer screening: advice for high-value care from the American College of Physicians. Ann Intern Med. 2015;162(10):712-7.CrossRef
28.
go back to reference Qaseem A, Kansagara D, Lin JS, Mustafa RA, Wilt TJ. Clinical Guidelines Committee of the American College of P. The Development of Clinical Guidelines and Guidance Statements by the Clinical Guidelines Committee of the American College of Physicians: Update of Methods. Ann Intern Med. 2019;170(12):863-70.CrossRef Qaseem A, Kansagara D, Lin JS, Mustafa RA, Wilt TJ. Clinical Guidelines Committee of the American College of P. The Development of Clinical Guidelines and Guidance Statements by the Clinical Guidelines Committee of the American College of Physicians: Update of Methods. Ann Intern Med. 2019;170(12):863-70.CrossRef
32.
go back to reference Alper BS, Price A, van Zuuren EJ, Fedorowicz Z, Shaughnessy AF, Oettgen P, et al. Consistency of Recommendations for Evaluation and Management of Hypertension. JAMA Network Open. 2019;2(11):e1915975-e. Alper BS, Price A, van Zuuren EJ, Fedorowicz Z, Shaughnessy AF, Oettgen P, et al. Consistency of Recommendations for Evaluation and Management of Hypertension. JAMA Network Open. 2019;2(11):e1915975-e.
33.
go back to reference Parker GB, Graham RK, Tavella G. Is there consensus across international evidence-based guidelines for the management of bipolar disorder? Acta Psychiatrica Scandinavica. 2017;135(6):515-26.CrossRef Parker GB, Graham RK, Tavella G. Is there consensus across international evidence-based guidelines for the management of bipolar disorder? Acta Psychiatrica Scandinavica. 2017;135(6):515-26.CrossRef
34.
go back to reference Yu Y, Wang D, Zhou Q, Wang C, Ma X, Gao Y, et al. Recommendations in clinical practice guidelines on gout: systematic review and consistency analysis. Clinical and experimental rheumatology. 2020;38(5):964-72.PubMed Yu Y, Wang D, Zhou Q, Wang C, Ma X, Gao Y, et al. Recommendations in clinical practice guidelines on gout: systematic review and consistency analysis. Clinical and experimental rheumatology. 2020;38(5):964-72.PubMed
35.
go back to reference Hasan T, Au E, Chen S, Tong A, Wong G. Screening and prevention for latent tuberculosis in immunosuppressed patients at risk for tuberculosis: a systematic review of clinical practice guidelines. BMJ Open. 2018;8(9):e022445.CrossRef Hasan T, Au E, Chen S, Tong A, Wong G. Screening and prevention for latent tuberculosis in immunosuppressed patients at risk for tuberculosis: a systematic review of clinical practice guidelines. BMJ Open. 2018;8(9):e022445.CrossRef
36.
go back to reference Schpero WL. Limiting low-value care by “Choosing Wisely”. Virtual Mentor. 2014;16(2):131-4.CrossRef Schpero WL. Limiting low-value care by “Choosing Wisely”. Virtual Mentor. 2014;16(2):131-4.CrossRef
37.
go back to reference Roman BR, Asch DA. Faded promises: the challenge of deadopting low-value care. American College of Physicians; 2014. Roman BR, Asch DA. Faded promises: the challenge of deadopting low-value care. American College of Physicians; 2014.
38.
go back to reference Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of clinical epidemiology. 2011;64(4):401-6.CrossRef Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. Journal of clinical epidemiology. 2011;64(4):401-6.CrossRef
39.
go back to reference Burgers JS, Grol R, Klazinga NS, Mäkelä M, Zaat J, COLLABORATION FTA. Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003;15(1):31-045.CrossRef Burgers JS, Grol R, Klazinga NS, Mäkelä M, Zaat J, COLLABORATION FTA. Towards evidence-based clinical practice: an international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003;15(1):31-045.CrossRef
40.
go back to reference Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477-81.CrossRef Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477-81.CrossRef
41.
go back to reference Neumann PJ, Cohen JT. Measuring the Value of Prescription Drugs. N Engl J Med. 2015;373(27):2595-7.CrossRef Neumann PJ, Cohen JT. Measuring the Value of Prescription Drugs. N Engl J Med. 2015;373(27):2595-7.CrossRef
42.
go back to reference Grady D, Redberg RF. Less is more: how less health care can result in better health. Archives of internal medicine. 2010;170(9):749-50.CrossRef Grady D, Redberg RF. Less is more: how less health care can result in better health. Archives of internal medicine. 2010;170(9):749-50.CrossRef
43.
go back to reference Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801-2.CrossRef Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801-2.CrossRef
44.
go back to reference American Board of Internal Medicine Foundation, American College of Physicians-American Society of Internal Medicine Foundation, European Federation of Internal Medicine. Medical professionalism in the new millennium: a physician charter. Ann Intern Med. 2002;136(3):243-6.CrossRef American Board of Internal Medicine Foundation, American College of Physicians-American Society of Internal Medicine Foundation, European Federation of Internal Medicine. Medical professionalism in the new millennium: a physician charter. Ann Intern Med. 2002;136(3):243-6.CrossRef
45.
go back to reference Pandya A. Adding Cost-effectiveness to Define Low-Value Care. JAMA. 2018;319(19):1977-8.CrossRef Pandya A. Adding Cost-effectiveness to Define Low-Value Care. JAMA. 2018;319(19):1977-8.CrossRef
46.
go back to reference Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness--the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796-7.CrossRef Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness--the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796-7.CrossRef
47.
go back to reference Ryen L, Svensson M. The Willingness to Pay for a Quality Adjusted Life Year: A Review of the Empirical Literature. Health Econ. 2014. Ryen L, Svensson M. The Willingness to Pay for a Quality Adjusted Life Year: A Review of the Empirical Literature. Health Econ. 2014.
48.
go back to reference Nimdet K, Chaiyakunapruk N, Vichansavakul K, Ngorsuraches S. A systematic review of studies eliciting willingness-to-pay per quality-adjusted life year: does it justify CE threshold? PLoS One. 2015;10(4):e0122760.CrossRef Nimdet K, Chaiyakunapruk N, Vichansavakul K, Ngorsuraches S. A systematic review of studies eliciting willingness-to-pay per quality-adjusted life year: does it justify CE threshold? PLoS One. 2015;10(4):e0122760.CrossRef
49.
go back to reference Hirth RA, Chernew ME, Miller E, Fendrick AM, Weissert WG. Willingness to pay for a quality-adjusted life year: in search of a standard. Med Decis Making. 2000;20(3):332-42.CrossRef Hirth RA, Chernew ME, Miller E, Fendrick AM, Weissert WG. Willingness to pay for a quality-adjusted life year: in search of a standard. Med Decis Making. 2000;20(3):332-42.CrossRef
50.
go back to reference Vanness DJ. Lomas J, Ahn H. A Health Opportunity Cost Threshold for Cost-Effectiveness Analysis in the United States. Ann Intern Med. 2020. Vanness DJ. Lomas J, Ahn H. A Health Opportunity Cost Threshold for Cost-Effectiveness Analysis in the United States. Ann Intern Med. 2020.
Metadata
Title
An Evidence Review of Low-Value Care Recommendations: Inconsistency and Lack of Economic Evidence Considered
Authors
David D. Kim, PhD
Lauren A. Do, BS
Allan T. Daly, MS
John B. Wong, MD
James D. Chambers, PhD
Daniel A. Ollendorf, PhD
Peter J. Neumann, ScD
Publication date
01-11-2021
Publisher
Springer International Publishing
Keyword
Care
Published in
Journal of General Internal Medicine / Issue 11/2021
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-021-06639-2

Other articles of this Issue 11/2021

Journal of General Internal Medicine 11/2021 Go to the issue