Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Stroke | Research article

Value-based healthcare in ischemic stroke care: case-mix adjustment models for clinical and patient-reported outcomes

Authors: Arvind Oemrawsingh, Nikki van Leeuwen, Esmee Venema, Martien Limburg, Frank-Erik de Leeuw, Markus P. Wijffels, Aafke J. de Groot, Pieter H. E. Hilkens, Jan A. Hazelzet, Diederik W. J. Dippel, Carla H. Bakker, Helene R. Voogdt-Pruis, Hester F. Lingsma

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Patient-Reported Outcome Measures (PROMs) have been proposed for benchmarking health care quality across hospitals, which requires extensive case-mix adjustment. The current study’s aim was to develop and compare case-mix models for mortality, a functional outcome, and a patient-reported outcome measure (PROM) in ischemic stroke care.

Methods

Data from ischemic stroke patients, admitted to four stroke centers in the Netherlands between 2014 and 2016 with available outcome information (N = 1022), was analyzed. Case-mix adjustment models were developed for mortality, modified Rankin Scale (mRS) scores and EQ-5D index scores with respectively binary logistic, proportional odds and linear regression models with stepwise backward selection. Predictive ability of these models was determined with R-squared (R2) and area-under-the-receiver-operating-characteristic-curve (AUC) statistics.

Results

Age, NIHSS score on admission, and heart failure were the only common predictors across all three case-mix adjustment models. Specific predictors for the EQ-5D index score were sex (β = 0.041), socio-economic status (β = − 0.019) and nationality (β = − 0.074). R2-values for the regression models for mortality (5 predictors), mRS score (9 predictors) and EQ-5D utility score (12 predictors), were respectively R2 = 0.44, R2 = 0.42 and R2 = 0.37.

Conclusions

The set of case-mix adjustment variables for the EQ-5D at three months differed considerably from the set for clinical outcomes in stroke care. The case-mix adjustment variables that were specific to this PROM were sex, socio-economic status and nationality. These variables should be considered in future attempts to risk-adjust for PROMs during benchmarking of hospitals.
Literature
1.
go back to reference Lovaglio PG. Benchmarking strategies for measuring the quality of healthcare: problems and prospects. ScientificWorldJournal. 2012. Lovaglio PG. Benchmarking strategies for measuring the quality of healthcare: problems and prospects. ScientificWorldJournal. 2012.
2.
go back to reference Kuhrij LS, Wouters MW, van den Berg-Vos RM, de Leeuw FE, Nederkoorn PJ. The Dutch Acute Stroke Audit: Benchmarking acute stroke care in the Netherlands. Eur Stroke J. 2018;3(4):361–8.CrossRef Kuhrij LS, Wouters MW, van den Berg-Vos RM, de Leeuw FE, Nederkoorn PJ. The Dutch Acute Stroke Audit: Benchmarking acute stroke care in the Netherlands. Eur Stroke J. 2018;3(4):361–8.CrossRef
3.
go back to reference Fayanju OM, Mayo TL, Spinks TE, Lee S, Barcenas CH, Smith BD, et al. Value-based breast Cancer care: a multidisciplinary approach for defining patient-centered outcomes. Ann Surg Oncol. 2016;23(8):2385–90.CrossRef Fayanju OM, Mayo TL, Spinks TE, Lee S, Barcenas CH, Smith BD, et al. Value-based breast Cancer care: a multidisciplinary approach for defining patient-centered outcomes. Ann Surg Oncol. 2016;23(8):2385–90.CrossRef
4.
go back to reference Katzan IL, Spertus J, Bettger JP, Bravata DM, Reeves MJ, Smith EE, et al. Risk adjustment of ischemic stroke outcomes for comparing hospital performance: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(3):918–44.CrossRef Katzan IL, Spertus J, Bettger JP, Bravata DM, Reeves MJ, Smith EE, et al. Risk adjustment of ischemic stroke outcomes for comparing hospital performance: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2014;45(3):918–44.CrossRef
5.
go back to reference Kotronoulas G, Kearney N, Maguire R, Harrow A, Di Domenico D, Croy S, et al. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol. 2014;32(14):1480–501.CrossRef Kotronoulas G, Kearney N, Maguire R, Harrow A, Di Domenico D, Croy S, et al. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol. 2014;32(14):1480–501.CrossRef
6.
go back to reference Bredart A, Marrel A, Abetz-Webb L, Lasch K, Acquadro C. Interviewing to develop patient-reported outcome (PRO) measures for clinical research: eliciting patients' experience. Health Qual Life Outcomes. 2014;12:15.CrossRef Bredart A, Marrel A, Abetz-Webb L, Lasch K, Acquadro C. Interviewing to develop patient-reported outcome (PRO) measures for clinical research: eliciting patients' experience. Health Qual Life Outcomes. 2014;12:15.CrossRef
7.
go back to reference Cella D, Lai JS, Nowinski CJ, Victorson D, Peterman A, Miller D, et al. Neureo-QOL. Brief measures of health-related quality of life for clinical research in neurology. Neurology. 2012;78(23):1860–7.CrossRef Cella D, Lai JS, Nowinski CJ, Victorson D, Peterman A, Miller D, et al. Neureo-QOL. Brief measures of health-related quality of life for clinical research in neurology. Neurology. 2012;78(23):1860–7.CrossRef
8.
go back to reference EuroQol Group. EuroQol--a new facility for the measurement of health-related quality of life. Health policy. 1990;16(3):199–208.CrossRef EuroQol Group. EuroQol--a new facility for the measurement of health-related quality of life. Health policy. 1990;16(3):199–208.CrossRef
9.
go back to reference Goldstein H, Spiegelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J Royal Stat Society Series A (Statistics in Society). 1996;159(3):385–443.CrossRef Goldstein H, Spiegelhalter DJ. League tables and their limitations: statistical issues in comparisons of institutional performance. J Royal Stat Society Series A (Statistics in Society). 1996;159(3):385–443.CrossRef
10.
go back to reference van Dishoeck AM, Lingsma HF, Mackenbach JP, Steyerberg EW. Random variation and rankability of hospitals using outcome indicators. BMJ Qual Saf. 2011;20(10):869–74.CrossRef van Dishoeck AM, Lingsma HF, Mackenbach JP, Steyerberg EW. Random variation and rankability of hospitals using outcome indicators. BMJ Qual Saf. 2011;20(10):869–74.CrossRef
11.
go back to reference Teale EA, Forster A, Munyombwe T, Young JB. A systematic review of case-mix adjustment models for stroke. Clin Rehabil. 2012;26(9):771–86.CrossRef Teale EA, Forster A, Munyombwe T, Young JB. A systematic review of case-mix adjustment models for stroke. Clin Rehabil. 2012;26(9):771–86.CrossRef
12.
go back to reference Appleby J, Devlin N, Parkin D. Using patient reported outcomes to improve health care. Chichester: Wiley; 2015. Appleby J, Devlin N, Parkin D. Using patient reported outcomes to improve health care. Chichester: Wiley; 2015.
13.
go back to reference Wilson JT, Hareendran A, Grant M, Baird T, Schulz UG, Muir KW, et al. Improving the assessment of outcomes in stroke: use of a structured interview to assign grades on the modified Rankin scale. Stroke. 2002;33(9):2243–6.CrossRef Wilson JT, Hareendran A, Grant M, Baird T, Schulz UG, Muir KW, et al. Improving the assessment of outcomes in stroke: use of a structured interview to assign grades on the modified Rankin scale. Stroke. 2002;33(9):2243–6.CrossRef
14.
go back to reference Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ. Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005;149(28):1574–8.PubMed Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ. Measuring the quality of life in economic evaluations: the Dutch EQ-5D tariff. Ned Tijdschr Geneeskd. 2005;149(28):1574–8.PubMed
15.
go back to reference van Agt HM, Essink-Bot ML, Krabbe PF, Bonsel GJ. Test-retest reliability of health state valuations collected with the EuroQol questionnaire. Soc Sci Med. 1994;39(11):1537–44.CrossRef van Agt HM, Essink-Bot ML, Krabbe PF, Bonsel GJ. Test-retest reliability of health state valuations collected with the EuroQol questionnaire. Soc Sci Med. 1994;39(11):1537–44.CrossRef
16.
go back to reference Shaw JW, Johnson JA, Coons SJ. US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care. 2005;43(3):203–20.CrossRef Shaw JW, Johnson JA, Coons SJ. US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care. 2005;43(3):203–20.CrossRef
17.
go back to reference Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.CrossRef Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.CrossRef
18.
go back to reference MV M, MV K, MAAE S, de Wit GA, Prenger R, AS E. Dutch tariff for the five-level version of EQ-5D. Value Health. 2016;19(4):343–52.CrossRef MV M, MV K, MAAE S, de Wit GA, Prenger R, AS E. Dutch tariff for the five-level version of EQ-5D. Value Health. 2016;19(4):343–52.CrossRef
19.
go back to reference Cella D, Hahn EA, Jensen SE, Butt Z, Nowinski CJ, Rothrock N, et al. Patient-Reported Outcomes in Performance Measurement. Research Triangle Park (NC): RTI Press (c) 2015 Research Triangle Institute. All rights reserved. This book is protected by copyright. Credit must be provided to the author and source of the book when the content is quoted. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher.; 2015. Cella D, Hahn EA, Jensen SE, Butt Z, Nowinski CJ, Rothrock N, et al. Patient-Reported Outcomes in Performance Measurement. Research Triangle Park (NC): RTI Press (c) 2015 Research Triangle Institute. All rights reserved. This book is protected by copyright. Credit must be provided to the author and source of the book when the content is quoted. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher.; 2015.
20.
go back to reference Chen P, Lin K-C, Liing R-J, Wu C-Y, Chen C-L, Chang K-C. Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation. Qual Life Res. 2016;25(6):1585–96.CrossRef Chen P, Lin K-C, Liing R-J, Wu C-Y, Chen C-L, Chang K-C. Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation. Qual Life Res. 2016;25(6):1585–96.CrossRef
21.
go back to reference Steyerberg EW. Clinical prediction models : a practical approach to development, validation and updating. New York: Springer; 2010. Steyerberg EW. Clinical prediction models : a practical approach to development, validation and updating. New York: Springer; 2010.
22.
go back to reference Schaake K, Burgers J, Mulder CH. Ethnicity at the individual and neighborhood level as an explanation for moving out of the neighborhood. Popul Res Policy Rev. 2010;29(4):593–608.CrossRef Schaake K, Burgers J, Mulder CH. Ethnicity at the individual and neighborhood level as an explanation for moving out of the neighborhood. Popul Res Policy Rev. 2010;29(4):593–608.CrossRef
23.
go back to reference Taphoorn MJ, Sizoo EM, Bottomley A. Review on quality of life issues in patients with primary brain tumors. Oncologist. 2010;15(6):618–26.CrossRef Taphoorn MJ, Sizoo EM, Bottomley A. Review on quality of life issues in patients with primary brain tumors. Oncologist. 2010;15(6):618–26.CrossRef
24.
go back to reference Akaike H. Information theory and an extension of the maximum likelihood principle. In: Parzen E, Tanabe K, Kitagawa G, editors. Selected papers of Hirotugu Akaike. New York, NY: Springer New York; 1998. p. 199–213.CrossRef Akaike H. Information theory and an extension of the maximum likelihood principle. In: Parzen E, Tanabe K, Kitagawa G, editors. Selected papers of Hirotugu Akaike. New York, NY: Springer New York; 1998. p. 199–213.CrossRef
25.
go back to reference Colin Cameron A, Windmeijer FAG. An R-squared measure of goodness of fit for some common nonlinear regression models. J Econ. 1997;77(2):329–42.CrossRef Colin Cameron A, Windmeijer FAG. An R-squared measure of goodness of fit for some common nonlinear regression models. J Econ. 1997;77(2):329–42.CrossRef
26.
go back to reference Bray BD, Campbell J, Cloud GC, Hoffman A, James M, Tyrrell PJ, et al. Derivation and external validation of a case mix model for the standardized reporting of 30-day stroke mortality rates. Stroke. 2014;45(11):3374–80.CrossRef Bray BD, Campbell J, Cloud GC, Hoffman A, James M, Tyrrell PJ, et al. Derivation and external validation of a case mix model for the standardized reporting of 30-day stroke mortality rates. Stroke. 2014;45(11):3374–80.CrossRef
27.
go back to reference Teale E, Young J, Dennis M, Sheldon T. Predicting patient-reported stroke outcomes: a validation of the six simple variable prognostic model. Cerebrovasc Dis Extra. 2013;3(1):97–102.CrossRef Teale E, Young J, Dennis M, Sheldon T. Predicting patient-reported stroke outcomes: a validation of the six simple variable prognostic model. Cerebrovasc Dis Extra. 2013;3(1):97–102.CrossRef
28.
go back to reference Wang R, Langhammer B. Predictors of quality of life for chronic stroke survivors in relation to cultural differences: a literature review. Scand J Caring Sci. 2018;32(2):502–14.CrossRef Wang R, Langhammer B. Predictors of quality of life for chronic stroke survivors in relation to cultural differences: a literature review. Scand J Caring Sci. 2018;32(2):502–14.CrossRef
29.
go back to reference Carod-Artal FJ, Egido JA. Quality of Life after Stroke: The Importance of a Good Recovery. Cerebrovasc Dis. 2009;27(suppl 1):204–14.CrossRef Carod-Artal FJ, Egido JA. Quality of Life after Stroke: The Importance of a Good Recovery. Cerebrovasc Dis. 2009;27(suppl 1):204–14.CrossRef
30.
go back to reference Mar J, Masjuan J, Oliva-Moreno J, Gonzalez-Rojas N, Becerra V, Casado MÁ, et al. Outcomes measured by mortality rates, quality of life and degree of autonomy in the first year in stroke units in Spain. Health Qual Life Outcomes. 2015;13:36.CrossRef Mar J, Masjuan J, Oliva-Moreno J, Gonzalez-Rojas N, Becerra V, Casado MÁ, et al. Outcomes measured by mortality rates, quality of life and degree of autonomy in the first year in stroke units in Spain. Health Qual Life Outcomes. 2015;13:36.CrossRef
31.
go back to reference Reyes-Gibby CC, Anderson KO, Morrow PK, Shete S, Hassan S. Depressive symptoms and health-related quality of life in breast cancer survivors. J Women's Health (Larchmt). 2012;21(3):311–8.CrossRef Reyes-Gibby CC, Anderson KO, Morrow PK, Shete S, Hassan S. Depressive symptoms and health-related quality of life in breast cancer survivors. J Women's Health (Larchmt). 2012;21(3):311–8.CrossRef
32.
go back to reference Wenzel L, DeAlba I, Habbal R, Kluhsman BC, Fairclough D, Krebs LU, et al. Quality of life in long-term cervical cancer survivors. Gynecol Oncol. 2005;97(2):310–7.CrossRef Wenzel L, DeAlba I, Habbal R, Kluhsman BC, Fairclough D, Krebs LU, et al. Quality of life in long-term cervical cancer survivors. Gynecol Oncol. 2005;97(2):310–7.CrossRef
33.
go back to reference Toni D, Lorenzano S, Puca E, Prencipe M. The SITS-MOST registry. Neurol Sci. 2006;27(3):s260–s2.CrossRef Toni D, Lorenzano S, Puca E, Prencipe M. The SITS-MOST registry. Neurol Sci. 2006;27(3):s260–s2.CrossRef
35.
go back to reference Bernhardt J, Zorowitz RD, Becker KJ, Keller E, Saposnik G, Strbian D, et al. Advances in stroke 2017. Stroke. 2018;49(5):e174–e99.CrossRef Bernhardt J, Zorowitz RD, Becker KJ, Keller E, Saposnik G, Strbian D, et al. Advances in stroke 2017. Stroke. 2018;49(5):e174–e99.CrossRef
36.
go back to reference Porter ME, Teisberg EO. Redefining health care: creating value-based competition on results: Harvard business press; 2006. Porter ME, Teisberg EO. Redefining health care: creating value-based competition on results: Harvard business press; 2006.
Metadata
Title
Value-based healthcare in ischemic stroke care: case-mix adjustment models for clinical and patient-reported outcomes
Authors
Arvind Oemrawsingh
Nikki van Leeuwen
Esmee Venema
Martien Limburg
Frank-Erik de Leeuw
Markus P. Wijffels
Aafke J. de Groot
Pieter H. E. Hilkens
Jan A. Hazelzet
Diederik W. J. Dippel
Carla H. Bakker
Helene R. Voogdt-Pruis
Hester F. Lingsma
Publication date
01-12-2019
Publisher
BioMed Central
Keywords
Stroke
Care
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0864-z

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue