Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Are low-value care measures up to the task? A systematic review of the literature

Authors: Eline F. de Vries, Jeroen N. Struijs, Richard Heijink, Roy J. P. Hendrikx, Caroline A. Baan

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Reducing low-value care is a core component of healthcare reforms in many Western countries. A comprehensive and sound set of low-value care measures is needed in order to monitor low-value care use in general and in provider-payer contracts. Our objective was to review the scientific literature on low-value care measurement, aiming to assess the scope and quality of current measures.

Methods

A systematic review was performed for the period 2010–2015. We assessed the scope of low-value care recommendations and measures by categorizing them according to the Classification of Health Care Functions. Additionally, we assessed the quality of the measures by 1) analysing their development process and the level of evidence underlying the measures, and 2) analysing the evidence regarding the validity of a selected subset of the measures.

Results

Our search yielded 292 potentially relevant articles. After screening, we selected 23 articles eligible for review. We obtained 115 low-value care measures, of which 87 were concentrated in the cure sector, 25 in prevention and 3 in long-term care. No measures were found in rehabilitative care and health promotion. We found 62 measures from articles that translated low-value care recommendations into measures, while 53 measures were previously developed by institutions as the National Quality Forum. Three measures were assigned the highest level of evidence, as they were underpinned by both guidelines and literature evidence. Our search yielded no information on coding/criterion validity and construct validity for the included measures. Despite this, most measures were already used in practice.

Conclusion

This systematic review provides insight into the current state of low-value care measures. It shows that more attention is needed for the evidential underpinning and quality of these measures. Clear information about the level of evidence and validity helps to identify measures that truly represent low-value care and are sufficiently qualified to fulfil their aims through quality monitoring and in innovative payer-provider contracts. This will contribute to creating and maintaining the support of providers, payers, policy makers and citizens, who are all aiming to improve value in health care.
Appendix
Available only for authorised users
Literature
1.
go back to reference IOM (Institute of Medicine). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington: National Academy Press; 2001 IOM (Institute of Medicine). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington: National Academy Press; 2001
3.
go back to reference Bhatia RS, Levinson W, Shortt S, Pendrith C, Fric-Shamji E, Kallewaard M, Peul W, Veillard J, Elshaug A, Forde I, et al. Measuring the effect of Choosing Wisely: an integrated framework to assess campaign impact on low-value care. BMJ Qual Saf. 2015;24(8):523–31.CrossRefPubMed Bhatia RS, Levinson W, Shortt S, Pendrith C, Fric-Shamji E, Kallewaard M, Peul W, Veillard J, Elshaug A, Forde I, et al. Measuring the effect of Choosing Wisely: an integrated framework to assess campaign impact on low-value care. BMJ Qual Saf. 2015;24(8):523–31.CrossRefPubMed
4.
go back to reference Levinson W, Huynh T. Engaging physicians and patients in conversations about unnecessary tests and procedures: Choosing Wisely Canada. CMAJ. 2014;186(5):325–6.CrossRefPubMedPubMedCentral Levinson W, Huynh T. Engaging physicians and patients in conversations about unnecessary tests and procedures: Choosing Wisely Canada. CMAJ. 2014;186(5):325–6.CrossRefPubMedPubMedCentral
5.
go back to reference Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA. ‘Choosing Wisely’: a growing international campaign. BMJ Qual Saf. 2015;24(2):167–74.CrossRefPubMed Levinson W, Kallewaard M, Bhatia RS, Wolfson D, Shortt S, Kerr EA. ‘Choosing Wisely’: a growing international campaign. BMJ Qual Saf. 2015;24(2):167–74.CrossRefPubMed
6.
go back to reference Angus DC, Deutschman CS, Hall JB, Wilson KC, Munro CL, Hill NS. Choosing wisely in critical care: maximizing value in the intensive care unit. Crit Care Med. 2014;42(11):2437–8.CrossRefPubMed Angus DC, Deutschman CS, Hall JB, Wilson KC, Munro CL, Hill NS. Choosing wisely in critical care: maximizing value in the intensive care unit. Crit Care Med. 2014;42(11):2437–8.CrossRefPubMed
7.
go back to reference Workgroup AGSCW. American Geriatrics Society identifies five things that healthcare providers and patients should question. J Am Geriatr Soc. 2013;61(4):622–31.CrossRef Workgroup AGSCW. American Geriatrics Society identifies five things that healthcare providers and patients should question. J Am Geriatr Soc. 2013;61(4):622–31.CrossRef
8.
go back to reference Colla CH, Morden NE, Sequist TD, Schpero WL, Rosenthal MB. Choosing wisely: prevalence and correlates of low-value health care services in the United States. J Gen Intern Med. 2015;30(2):221–8.CrossRefPubMed Colla CH, Morden NE, Sequist TD, Schpero WL, Rosenthal MB. Choosing wisely: prevalence and correlates of low-value health care services in the United States. J Gen Intern Med. 2015;30(2):221–8.CrossRefPubMed
9.
go back to reference Keyhani S, Falk R, Bishop T, Howell E, Korenstein D. The relationship between geographic variations and overuse of healthcare services: a systematic review. Med Care. 2012;50(3):257–61.CrossRefPubMed Keyhani S, Falk R, Bishop T, Howell E, Korenstein D. The relationship between geographic variations and overuse of healthcare services: a systematic review. Med Care. 2012;50(3):257–61.CrossRefPubMed
10.
go back to reference Mathias JS, Feinglass J, Baker DW. Variations in US hospital performance on imaging-use measures. Med Care. 2012;50(9):808–14.CrossRefPubMed Mathias JS, Feinglass J, Baker DW. Variations in US hospital performance on imaging-use measures. Med Care. 2012;50(9):808–14.CrossRefPubMed
11.
go back to reference Morden NE, Schpero WL, Zaha R, Sequist TD, Colla CH. Overuse of short-interval bone densitometry: assessing rates of low-value care. Osteoporos Int. 2014;25(9):2307–11.CrossRefPubMedPubMedCentral Morden NE, Schpero WL, Zaha R, Sequist TD, Colla CH. Overuse of short-interval bone densitometry: assessing rates of low-value care. Osteoporos Int. 2014;25(9):2307–11.CrossRefPubMedPubMedCentral
12.
go back to reference Morden NE, Colla CH, Sequist TD, Rosenthal MB. Choosing wisely--the politics and economics of labeling low-value services. N Engl J Med. 2014;370(7):589–92.CrossRefPubMedPubMedCentral Morden NE, Colla CH, Sequist TD, Rosenthal MB. Choosing wisely--the politics and economics of labeling low-value services. N Engl J Med. 2014;370(7):589–92.CrossRefPubMedPubMedCentral
14.
go back to reference Baker DW, Qaseem A, Reynolds PP, Gardner LA, Schneider EC. Design and use of performance measures to decrease low-value services and achieve cost-conscious care. Ann Intern Med. 2013;158(1):55–9.CrossRefPubMed Baker DW, Qaseem A, Reynolds PP, Gardner LA, Schneider EC. Design and use of performance measures to decrease low-value services and achieve cost-conscious care. Ann Intern Med. 2013;158(1):55–9.CrossRefPubMed
15.
go back to reference Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, Li C, DeVries A. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med 2015;175(12):1–9. doi:10.1001/jamainternmed.2015.5441. Rosenberg A, Agiro A, Gottlieb M, Barron J, Brady P, Liu Y, Li C, DeVries A. Early Trends Among Seven Recommendations From the Choosing Wisely Campaign. JAMA Intern Med 2015;175(12):1–9. doi:10.​1001/​jamainternmed.​2015.​5441.
16.
17.
18.
go back to reference Chan KS, Chang E, Nassery N, Chang HY, Segal JB. The state of overuse measurement: a critical review. Med Care Res Rev. 2013;70(5):473–96.CrossRefPubMed Chan KS, Chang E, Nassery N, Chang HY, Segal JB. The state of overuse measurement: a critical review. Med Care Res Rev. 2013;70(5):473–96.CrossRefPubMed
19.
go back to reference Segal JB, Bridges JF, Chang HY, Chang E, Nassery N, Weiner J, Chan KS. Identifying possible indicators of systematic overuse of health care procedures with claims data. Med Care. 2014;52(2):157–63.CrossRefPubMed Segal JB, Bridges JF, Chang HY, Chang E, Nassery N, Weiner J, Chan KS. Identifying possible indicators of systematic overuse of health care procedures with claims data. Med Care. 2014;52(2):157–63.CrossRefPubMed
20.
go back to reference Guidance on Using the AHRQ QI for Hospital-Level Comparative Reporting. In.: Agency for Healthcare Research and Quality, 2009. Guidance on Using the AHRQ QI for Hospital-Level Comparative Reporting. In.: Agency for Healthcare Research and Quality, 2009.
21.
go back to reference Fund TK. Better value in the NHS: The role of changes in clinical practice. London: The King’s Fund; 2015. Fund TK. Better value in the NHS: The role of changes in clinical practice. London: The King’s Fund; 2015.
22.
go back to reference Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Availablefrom http://handbook.cochrane.org. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Availablefrom http://​handbook.​cochrane.​org.
24.
go back to reference Kaplan RM, Bush JW, Berry CC. Health status: types of validity and the index of well-being. Health Serv Res. 1976;11(4):478–507.PubMedPubMedCentral Kaplan RM, Bush JW, Berry CC. Health status: types of validity and the index of well-being. Health Serv Res. 1976;11(4):478–507.PubMedPubMedCentral
25.
go back to reference Winters BD, Bharmal A, Wilson RF, Zhang A, Engineer L, Defoe D, Bass EB, Dy S, Pronovost PJ. Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-acquired Conditions: A Systematic Review and Meta-Analysis. Med Care. 2016; doi:10.1097/MLR.0000000000000550. Winters BD, Bharmal A, Wilson RF, Zhang A, Engineer L, Defoe D, Bass EB, Dy S, Pronovost PJ. Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the Centers for Medicare and Medicaid Hospital-acquired Conditions: A Systematic Review and Meta-Analysis. Med Care. 2016; doi:10.​1097/​MLR.​0000000000000550​.
26.
go back to reference Kale MS, Bishop TF, Federman AD, Keyhani S. Trends in the overuse of ambulatory health care services in the United States. JAMA Intern Med. 2013;173(2):142–8.CrossRefPubMedPubMedCentral Kale MS, Bishop TF, Federman AD, Keyhani S. Trends in the overuse of ambulatory health care services in the United States. JAMA Intern Med. 2013;173(2):142–8.CrossRefPubMedPubMedCentral
27.
go back to reference Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, Humphrey L, LeBlond R, Moyer D, Wiese JG, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med. 2012;156(2):147–9.CrossRefPubMed Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, Humphrey L, LeBlond R, Moyer D, Wiese JG, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med. 2012;156(2):147–9.CrossRefPubMed
29.
go back to reference McCarthy M. US Choosing Wisely campaign has had only modest success, study finds. BMJ (Clinical research ed). 2015;351:h5437. McCarthy M. US Choosing Wisely campaign has had only modest success, study finds. BMJ (Clinical research ed). 2015;351:h5437.
30.
go back to reference Chernew ME, Mechanic RE, Landon BE, Safran DG. Private-payer innovation in Massachusetts: the ‘alternative quality contract’. Health affairs (Project Hope). 2011;30(1):51–61.CrossRef Chernew ME, Mechanic RE, Landon BE, Safran DG. Private-payer innovation in Massachusetts: the ‘alternative quality contract’. Health affairs (Project Hope). 2011;30(1):51–61.CrossRef
31.
go back to reference Fendrick AM, Smith DG, Chernew ME. Applying value-based insurance design to low-value health services. Health Aff. 2010;29(11):2017–21.CrossRef Fendrick AM, Smith DG, Chernew ME. Applying value-based insurance design to low-value health services. Health Aff. 2010;29(11):2017–21.CrossRef
32.
33.
34.
go back to reference Workgroup AGSCW. American Geriatrics Society identifies another five things that healthcare providers and patients should question, 5. 2014. p. 950–60. Workgroup AGSCW. American Geriatrics Society identifies another five things that healthcare providers and patients should question, 5. 2014. p. 950–60.
35.
go back to reference Amos TB, Keith SW, Del Canale S, Orsi P, Maggio M, Baccarini S, Gonzi G, Liu M, Maio V. Inappropriate prescribing in a large community-dwelling older population: a focus on prevalence and how it relates to patient and physician characteristics. J Clin Pharm Ther. 2015;40(1):7–13.CrossRefPubMed Amos TB, Keith SW, Del Canale S, Orsi P, Maggio M, Baccarini S, Gonzi G, Liu M, Maio V. Inappropriate prescribing in a large community-dwelling older population: a focus on prevalence and how it relates to patient and physician characteristics. J Clin Pharm Ther. 2015;40(1):7–13.CrossRefPubMed
36.
go back to reference Bulger J, Nickel W, Messler J, Goldstein J, O’Callaghan J, Auron M, Gulati M. Choosing wisely in adult hospital medicine: five opportunities for improved healthcare value. J Hosp Med. 2013;8(9):486–92.CrossRefPubMed Bulger J, Nickel W, Messler J, Goldstein J, O’Callaghan J, Auron M, Gulati M. Choosing wisely in adult hospital medicine: five opportunities for improved healthcare value. J Hosp Med. 2013;8(9):486–92.CrossRefPubMed
37.
go back to reference Elshaug AG, Watt AM, Mundy L, Willis CD. Over 150 potentially low-value health care practices: an Australian study. Med J Aust. 2012;197(10):556–60.CrossRefPubMed Elshaug AG, Watt AM, Mundy L, Willis CD. Over 150 potentially low-value health care practices: an Australian study. Med J Aust. 2012;197(10):556–60.CrossRefPubMed
38.
go back to reference Halpern SD, Becker D, Curtis JR, Fowler R, Hyzy R, Kaplan LJ, Rawat N, Sessler CN, Wunsch H, Kahn JM, et al. An official American Thoracic Society/American Association of Critical-Care Nurses/American College of Chest Physicians/Society of Critical Care Medicine policy statement: the Choosing Wisely Top 5 list in Critical Care Medicine. Am J Respir Crit Care Med. 2014;190(7):818–26.CrossRefPubMed Halpern SD, Becker D, Curtis JR, Fowler R, Hyzy R, Kaplan LJ, Rawat N, Sessler CN, Wunsch H, Kahn JM, et al. An official American Thoracic Society/American Association of Critical-Care Nurses/American College of Chest Physicians/Society of Critical Care Medicine policy statement: the Choosing Wisely Top 5 list in Critical Care Medicine. Am J Respir Crit Care Med. 2014;190(7):818–26.CrossRefPubMed
39.
go back to reference Hicks LK, Bering H, Carson KR, Kleinerman J, Kukreti V, Ma A, Mueller BU, O’Brien SH, Pasquini M, Sarode R, et al. The ASH choosing wisely® campaign: Five hematologic tests and treatments to question. Blood. 2013;122(24):3879–83.CrossRefPubMed Hicks LK, Bering H, Carson KR, Kleinerman J, Kukreti V, Ma A, Mueller BU, O’Brien SH, Pasquini M, Sarode R, et al. The ASH choosing wisely® campaign: Five hematologic tests and treatments to question. Blood. 2013;122(24):3879–83.CrossRefPubMed
40.
go back to reference Keyhani S, Falk R, Howell EA, Bishop T, Korenstein D. Overuse and systems of care: a systematic review. Med Care. 2013;51(6):503–8.CrossRefPubMed Keyhani S, Falk R, Howell EA, Bishop T, Korenstein D. Overuse and systems of care: a systematic review. Med Care. 2013;51(6):503–8.CrossRefPubMed
41.
go back to reference Korenstein D, Falk R, Howell AE, Bishop T, Keyhani S. Overuse of health care services in the United States: an understudied problem. Arch Intern Med. 2012;172(2):171–8.CrossRefPubMed Korenstein D, Falk R, Howell AE, Bishop T, Keyhani S. Overuse of health care services in the United States: an understudied problem. Arch Intern Med. 2012;172(2):171–8.CrossRefPubMed
42.
go back to reference Onuoha OC, Arkoosh VA, Fleisher LA. Choosing wisely in anesthesiology: The gap between evidence and practice. JAMA Internal Medicine. 2014;174(8):1391–5.CrossRefPubMed Onuoha OC, Arkoosh VA, Fleisher LA. Choosing wisely in anesthesiology: The gap between evidence and practice. JAMA Internal Medicine. 2014;174(8):1391–5.CrossRefPubMed
43.
go back to reference Quinonez RA, Garber MD, Schroeder AR, Alverson BK, Nickel W, Goldstein J, Bennett JS, Fine BR, Hartzog TH, McLean HS, et al. Choosing wisely in pediatric hospital medicine: five opportunities for improved healthcare value. J Hosp Med. 2013;8(9):479–85.CrossRefPubMed Quinonez RA, Garber MD, Schroeder AR, Alverson BK, Nickel W, Goldstein J, Bennett JS, Fine BR, Hartzog TH, McLean HS, et al. Choosing wisely in pediatric hospital medicine: five opportunities for improved healthcare value. J Hosp Med. 2013;8(9):479–85.CrossRefPubMed
44.
go back to reference Rouster-Stevens KA, Ardoin SP, Cooper AM, Becker ML, Dragone LL, Huttenlocher A, Jones KB, Kolba KS, Moorthy LN, Nigrovic PA, et al. Choosing wisely: The american college of rheumatology’s top 5 for pediatric rheumatology. Arthritis Care Res. 2014;66(5):649–57.CrossRef Rouster-Stevens KA, Ardoin SP, Cooper AM, Becker ML, Dragone LL, Huttenlocher A, Jones KB, Kolba KS, Moorthy LN, Nigrovic PA, et al. Choosing wisely: The american college of rheumatology’s top 5 for pediatric rheumatology. Arthritis Care Res. 2014;66(5):649–57.CrossRef
45.
go back to reference Schuur JD, Carney DP, Lyn ET, Raja AS, Michael JA, Ross NG, Venkatesh AK. A top-five list for emergency medicine: a pilot project to improve the value of emergency care. JAMA Intern Med. 2014;174(4):509–15.CrossRefPubMed Schuur JD, Carney DP, Lyn ET, Raja AS, Michael JA, Ross NG, Venkatesh AK. A top-five list for emergency medicine: a pilot project to improve the value of emergency care. JAMA Intern Med. 2014;174(4):509–15.CrossRefPubMed
46.
go back to reference Wiener RS, Ouellette DR, Diamond E, Fan VS, Maurer JR, Mularski RA, Peters JI, Halpern SD, American Thoracic S, American College of Chest P. An official American Thoracic Society/American College of Chest Physicians policy statement: the Choosing Wisely top five list in adult pulmonary medicine. Chest. 2014;145(6):1383–91.CrossRefPubMedPubMedCentral Wiener RS, Ouellette DR, Diamond E, Fan VS, Maurer JR, Mularski RA, Peters JI, Halpern SD, American Thoracic S, American College of Chest P. An official American Thoracic Society/American College of Chest Physicians policy statement: the Choosing Wisely top five list in adult pulmonary medicine. Chest. 2014;145(6):1383–91.CrossRefPubMedPubMedCentral
47.
go back to reference Williams AW, Dwyer AC, Eddy AA, Fink JC, Jaber BL, Linas SL, Michael B, O’Hare AM, Schaefer HM, Shaffer RN, et al. Critical and honest conversations: the evidence behind the “Choosing Wisely” campaign recommendations by the American Society of Nephrology. Clin J Am Soc Nephrol. 2012;7(10):1664–72.CrossRefPubMed Williams AW, Dwyer AC, Eddy AA, Fink JC, Jaber BL, Linas SL, Michael B, O’Hare AM, Schaefer HM, Shaffer RN, et al. Critical and honest conversations: the evidence behind the “Choosing Wisely” campaign recommendations by the American Society of Nephrology. Clin J Am Soc Nephrol. 2012;7(10):1664–72.CrossRefPubMed
48.
go back to reference Wood DE, Mitchell JD, Schmitz DS, Grondin SC, Ikonomidis JS, Bakaeen FG, Merritt RE, Meyer DM, Moffatt-Bruce SD, Reece TB, et al. Choosing wisely: cardiothoracic surgeons partnering with patients to make good health care decisions. Ann Thorac Surg. 2013;95(3):1130–5.CrossRefPubMed Wood DE, Mitchell JD, Schmitz DS, Grondin SC, Ikonomidis JS, Bakaeen FG, Merritt RE, Meyer DM, Moffatt-Bruce SD, Reece TB, et al. Choosing wisely: cardiothoracic surgeons partnering with patients to make good health care decisions. Ann Thorac Surg. 2013;95(3):1130–5.CrossRefPubMed
Metadata
Title
Are low-value care measures up to the task? A systematic review of the literature
Authors
Eline F. de Vries
Jeroen N. Struijs
Richard Heijink
Roy J. P. Hendrikx
Caroline A. Baan
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1656-3

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue