Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Stroke | Research article

Developing an adapted Charlson comorbidity index for ischemic stroke outcome studies

Authors: Ruth E. Hall, Joan Porter, Hude Quan, Mathew J. Reeves

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

The Charlson comorbidity index (CCI) is commonly used to adjust for patient casemix. We reevaluated the CCI in an ischemic stroke (IS) cohort to determine whether the original seventeen comorbidities and their weights are relevant.

Methods

We identified an IS cohort (N = 6988) from the Ontario Stroke Registry (OSR) who were discharged from acute hospitals (N = 100) between April 1, 2012 and March 31, 2013. We used hospital discharge ICD-10-CA data to identify Charlson comorbidities. We developed a multivariable Cox model to predict one-year mortality retaining statistically significant (P < 0.05) comorbidities with hazard ratios ≥1.2. Hazard ratios were used to generate revised weights (1–6) for the comorbid conditions. The performance of the IS adapted Charlson comorbidity index (ISCCI) mortality model was compared to the original CCI using the c-statistic and continuous Net Reclassification Index (cNRI).

Results

Ten of the 17 Charlson comorbid conditions were retained in the ISCCI model and 7 had reassigned weights when compared to the original CCI model . The ISCCI model showed a small but significant increase in the c-statistic compared to the CCI for 30-day mortality (c-statistic 0.746 vs. 0.732, p = 0.009), but no significant increase in c-statistic for in-hospital or one-year mortality. There was also no improvement in the cNRI when the ISCCI model was compared to the CCI.

Conclusions

The ISCCI model had similar performance to the original CCI model. The key advantage of the ISCCI model is it includes seven fewer comorbidities and therefore easier to implement in situations where coded data is unavailable.
Appendix
Available only for authorised users
Literature
1.
go back to reference DeGroot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity: a critical review of available methods. J Clin Epi. 2003;56(3):221–9.CrossRef DeGroot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity: a critical review of available methods. J Clin Epi. 2003;56(3):221–9.CrossRef
2.
go back to reference Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004 Dec;57(12):1288–94.PubMedCrossRef Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004 Dec;57(12):1288–94.PubMedCrossRef
3.
go back to reference Quan H, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82.PubMedCrossRef Quan H, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82.PubMedCrossRef
4.
go back to reference Goldstein LB, Samsa GP, Matchar DB, Horner RD. Charlson index comorbidity adjustment for ischemic stroke outcome studies. Stroke. 2004;35:1941–5.PubMedCrossRef Goldstein LB, Samsa GP, Matchar DB, Horner RD. Charlson index comorbidity adjustment for ischemic stroke outcome studies. Stroke. 2004;35:1941–5.PubMedCrossRef
5.
go back to reference Radley DC, Gottlieb DJ, Fisher ES, Tosteson AN. Comorbidity risk-adjustment strategies are comparable among persons with hip fracture. J Clin Epidemiol. 2008;61(6):580–7.PubMedPubMedCentralCrossRef Radley DC, Gottlieb DJ, Fisher ES, Tosteson AN. Comorbidity risk-adjustment strategies are comparable among persons with hip fracture. J Clin Epidemiol. 2008;61(6):580–7.PubMedPubMedCentralCrossRef
6.
go back to reference Lui J, Huang Z, Gibertson DT, Foley RN, Collins AJ. An improved comorbidity index for outcome analyses among dialysis patients. Kidney Int. 2010;77:141–51.CrossRef Lui J, Huang Z, Gibertson DT, Foley RN, Collins AJ. An improved comorbidity index for outcome analyses among dialysis patients. Kidney Int. 2010;77:141–51.CrossRef
7.
go back to reference Quail JM, Lix LM, Osman BA, Teare GF. Comparing comorbidity measures for predicting mortality and hospitalization in three population-based cohorts. BMC Health Serv Res. 2011;11:146.PubMedPubMedCentralCrossRef Quail JM, Lix LM, Osman BA, Teare GF. Comparing comorbidity measures for predicting mortality and hospitalization in three population-based cohorts. BMC Health Serv Res. 2011;11:146.PubMedPubMedCentralCrossRef
8.
go back to reference Sharabiani MTA, Aylin P, Bottle A. Systematic review of comorbidity indices for administrative data. Med Care. 2012;50(12):1109–18.PubMedCrossRef Sharabiani MTA, Aylin P, Bottle A. Systematic review of comorbidity indices for administrative data. Med Care. 2012;50(12):1109–18.PubMedCrossRef
10.
go back to reference Austin SR, Wong YN, Uzzo RG, Beck R, Egleston BL. Why summary comorbidity measures such as the Charlson comorbidity index and the Elixhauser score work? Med Care. 2015;53(9):e65–e72.9.PubMedPubMedCentralCrossRef Austin SR, Wong YN, Uzzo RG, Beck R, Egleston BL. Why summary comorbidity measures such as the Charlson comorbidity index and the Elixhauser score work? Med Care. 2015;53(9):e65–e72.9.PubMedPubMedCentralCrossRef
11.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987;40(5):373–83.PubMedCrossRef Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chron Dis. 1987;40(5):373–83.PubMedCrossRef
12.
go back to reference Lu M, Sajobi T, Lucyk K, Lorenzetti D, Quan H. Systematic review of risk adjustment models of hospital length of stay (LOS). Med Care. 2015;53(4):355–65.PubMedCrossRef Lu M, Sajobi T, Lucyk K, Lorenzetti D, Quan H. Systematic review of risk adjustment models of hospital length of stay (LOS). Med Care. 2015;53(4):355–65.PubMedCrossRef
13.
go back to reference Schmidt M, Jacobsen JB, Johnsen SP, Botker HE, Sorenson HT. Eighteen-year trends in stroke mortality and the prognostic influence of comorbidity. Neurology. 2014;82:340–50.PubMedCrossRef Schmidt M, Jacobsen JB, Johnsen SP, Botker HE, Sorenson HT. Eighteen-year trends in stroke mortality and the prognostic influence of comorbidity. Neurology. 2014;82:340–50.PubMedCrossRef
14.
15.
go back to reference Kamal N, Lindsay MP, Côté R, Fang J, Kapral MK, Hill MD. Ten-year trends in stroke admissions and outcomes in Canada. Can J Neurol Sci. 2015;42(3):168–75.PubMedCrossRef Kamal N, Lindsay MP, Côté R, Fang J, Kapral MK, Hill MD. Ten-year trends in stroke admissions and outcomes in Canada. Can J Neurol Sci. 2015;42(3):168–75.PubMedCrossRef
16.
go back to reference Hall RE, Khan F, Levi J, Ma H, Fang J, Martin C, Morrison K, Fearn J, Brown G, Kelloway L, Kapral MK, O’Callaghan C, Bayley M, Linkewich B. Ontario and LHIN 2015/16 stroke report cards and Progress reports: setting the Bar higher. Institute for Clinical Evaluative Sciences: Toronto; 2017. Hall RE, Khan F, Levi J, Ma H, Fang J, Martin C, Morrison K, Fearn J, Brown G, Kelloway L, Kapral MK, O’Callaghan C, Bayley M, Linkewich B. Ontario and LHIN 2015/16 stroke report cards and Progress reports: setting the Bar higher. Institute for Clinical Evaluative Sciences: Toronto; 2017.
17.
go back to reference Fonarow G, Reeves M, Smith EE, Saver JL, Zhao X, Olson DW, et al. Characteristics, performance measures and in-hospital outcomes of the first one million stroke transient ischemic attack admissions in get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2010;3:291–302.PubMedCrossRef Fonarow G, Reeves M, Smith EE, Saver JL, Zhao X, Olson DW, et al. Characteristics, performance measures and in-hospital outcomes of the first one million stroke transient ischemic attack admissions in get with the guidelines-stroke. Circ Cardiovasc Qual Outcomes. 2010;3:291–302.PubMedCrossRef
18.
go back to reference Hall R, Khan F, O’Callaghan C, Kapral MK, Levi J, Cullen A, Wu J, Fang J, Bayley MB. Ontario stroke evaluation report 2014: on target for stroke prevention and care. Institute for Clinical Evaluative Sciences: Toronto; 2014. Hall R, Khan F, O’Callaghan C, Kapral MK, Levi J, Cullen A, Wu J, Fang J, Bayley MB. Ontario stroke evaluation report 2014: on target for stroke prevention and care. Institute for Clinical Evaluative Sciences: Toronto; 2014.
19.
go back to reference Otite FO, Khandelwal P, Chaturvedi S, Romano JG, Sacco RL, Malik AM. Increasing atrial fibrillation prevalence in acute ischemic stroke and TIA. Neurology. 2016;87:1–8.CrossRef Otite FO, Khandelwal P, Chaturvedi S, Romano JG, Sacco RL, Malik AM. Increasing atrial fibrillation prevalence in acute ischemic stroke and TIA. Neurology. 2016;87:1–8.CrossRef
20.
go back to reference Benjamin EJ, Wolf PA, D’Agostino RB, Silbershatz H, Kannel WB, Levy D. Impact of atrial fibrillation on the risk of death. Circulation. 1998;98:946–52.PubMedCrossRef Benjamin EJ, Wolf PA, D’Agostino RB, Silbershatz H, Kannel WB, Levy D. Impact of atrial fibrillation on the risk of death. Circulation. 1998;98:946–52.PubMedCrossRef
21.
go back to reference Schwamm LH, Ali SF, Reeves MJ, Smith EE, Saver JL, Messe S, et al. Temporal trends in patient characteristics and treatment with intravenous thrombolysis among ischemic stroke patients at get with guidelines – stroke hospitals. Circ Cardiovascular Quality Outcomes. 2013;6:543–9.PubMedCrossRef Schwamm LH, Ali SF, Reeves MJ, Smith EE, Saver JL, Messe S, et al. Temporal trends in patient characteristics and treatment with intravenous thrombolysis among ischemic stroke patients at get with guidelines – stroke hospitals. Circ Cardiovascular Quality Outcomes. 2013;6:543–9.PubMedCrossRef
24.
go back to reference Kapral MK, Fang J, Alibhai SMH, et al. Risk of fractures after stroke. Results from the Ontario stroke registry. Neurology. 2017;88:1–8.CrossRef Kapral MK, Fang J, Alibhai SMH, et al. Risk of fractures after stroke. Results from the Ontario stroke registry. Neurology. 2017;88:1–8.CrossRef
25.
go back to reference Quan H, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005 Nov;43(11):1130–9.PubMedCrossRef Quan H, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005 Nov;43(11):1130–9.PubMedCrossRef
27.
go back to reference Canadian Institute for Health Information. CIHI data quality study of the 2008–2009 discharge abstract database. Ottawa: CIHI; 2010. Canadian Institute for Health Information. CIHI data quality study of the 2008–2009 discharge abstract database. Ottawa: CIHI; 2010.
28.
go back to reference Steyerberg E. Clinical prediction models: a practical approach to development, validation and updating. Springer Science & Business Media; 208:508. Steyerberg E. Clinical prediction models: a practical approach to development, validation and updating. Springer Science & Business Media; 208:508.
29.
go back to reference Pencina MJ, D'Agostino RB Sr, D’Agostino RB Jr. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.PubMedCrossRef Pencina MJ, D'Agostino RB Sr, D’Agostino RB Jr. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.PubMedCrossRef
30.
go back to reference Cote R, Battista RN, Wolfson C, Boucher J, Adam J, Hachinski V. The Canadian neurological scale: validation and reliability assessment. Neurology. 1989;39:638–43.PubMedCrossRef Cote R, Battista RN, Wolfson C, Boucher J, Adam J, Hachinski V. The Canadian neurological scale: validation and reliability assessment. Neurology. 1989;39:638–43.PubMedCrossRef
32.
go back to reference Hemmelgarn BR, Manns BJ, Quan H, Ghali WA. Adapting the charlson comorbidity index for use in patients with ESRD. Am J Kidney Dis. 2003;42(1):125–32.PubMedCrossRef Hemmelgarn BR, Manns BJ, Quan H, Ghali WA. Adapting the charlson comorbidity index for use in patients with ESRD. Am J Kidney Dis. 2003;42(1):125–32.PubMedCrossRef
33.
go back to reference Ghali WA, Hall RE, Rosen AK, Ash AS, Moskowitz MA. Choosing a measure of comorbidity for comparing outcomes of care for patients undergoing coronary artery bypass surgery. J Clin Epidem. 1995;49(3):273–8.CrossRef Ghali WA, Hall RE, Rosen AK, Ash AS, Moskowitz MA. Choosing a measure of comorbidity for comparing outcomes of care for patients undergoing coronary artery bypass surgery. J Clin Epidem. 1995;49(3):273–8.CrossRef
34.
go back to reference Quan H, Parsons GA, Ghali WA. Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J of Clin Epi. 2004;57:366–72.CrossRef Quan H, Parsons GA, Ghali WA. Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J of Clin Epi. 2004;57:366–72.CrossRef
35.
go back to reference Canadian Institute for Health Information. Canadian Coding Standards for Version 2015 ICD-10-CA and CCI. Canadian Institute for Health Information. Ottawa: ON; 2015. Canadian Institute for Health Information. Canadian Coding Standards for Version 2015 ICD-10-CA and CCI. Canadian Institute for Health Information. Ottawa: ON; 2015.
37.
go back to reference Fonarow GC, Wenqin P, Saver JL, Smith EE, Reeves MJ, Boderick JP, Kleindorfer DO, Sacco RL, Olson DWM, Hernandez AF, Peterson ED, Schwamm LH. Comparison of 30-day mortality models for profiling hospital performance in acute ischemic stroke with vs without adjustment for stroke severity. JAMA. 2012;308(3):257–64. https://doi.org/10.1001/jama.2012.7870.CrossRefPubMed Fonarow GC, Wenqin P, Saver JL, Smith EE, Reeves MJ, Boderick JP, Kleindorfer DO, Sacco RL, Olson DWM, Hernandez AF, Peterson ED, Schwamm LH. Comparison of 30-day mortality models for profiling hospital performance in acute ischemic stroke with vs without adjustment for stroke severity. JAMA. 2012;308(3):257–64. https://​doi.​org/​10.​1001/​jama.​2012.​7870.CrossRefPubMed
38.
go back to reference Luengo-Fernandez R, ST PNLMGAMP, Bull LM, SJV W, Cuthertson FC, Rothwell PM, on behalf of the Oxford Vascular Study. Population-based study of disability and institutionalization after transient ischemic attack and stroke: 10-year results of the Oxford vascular study. Stroke. 2013;44:2854–61.PubMedPubMedCentralCrossRef Luengo-Fernandez R, ST PNLMGAMP, Bull LM, SJV W, Cuthertson FC, Rothwell PM, on behalf of the Oxford Vascular Study. Population-based study of disability and institutionalization after transient ischemic attack and stroke: 10-year results of the Oxford vascular study. Stroke. 2013;44:2854–61.PubMedPubMedCentralCrossRef
39.
go back to reference Castro HHG, Alencar AP, Benseñor IM, Lotufo PA, Goulart AC. Multimorbidities are associated to lower survival in Ischaemic stroke: results from a Brazilian stroke cohort (EMMA study). Cerebrovasc Dis. 2017;44:232–9.PubMedCrossRef Castro HHG, Alencar AP, Benseñor IM, Lotufo PA, Goulart AC. Multimorbidities are associated to lower survival in Ischaemic stroke: results from a Brazilian stroke cohort (EMMA study). Cerebrovasc Dis. 2017;44:232–9.PubMedCrossRef
40.
go back to reference Willeit J, Geley T, Schoch J, et al. Thrombolysis and clinical outcome in patients with stroke after implementation of the Tyrol stroke pathway: a retrospective observational study. Lancet Neurol. 2015;14:48–56.PubMedCrossRef Willeit J, Geley T, Schoch J, et al. Thrombolysis and clinical outcome in patients with stroke after implementation of the Tyrol stroke pathway: a retrospective observational study. Lancet Neurol. 2015;14:48–56.PubMedCrossRef
41.
go back to reference Thygesen SK, Christiansen CF, Christensen S, Lash TL, Sorensen HT. The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of patients. BMC Med Res Methodol. 2011;11:83.PubMedPubMedCentralCrossRef Thygesen SK, Christiansen CF, Christensen S, Lash TL, Sorensen HT. The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of patients. BMC Med Res Methodol. 2011;11:83.PubMedPubMedCentralCrossRef
43.
go back to reference Lee DS, Donovan L, Austin PC, Gong Y, Liu P, Rouleau JL, Tu JV. Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005;43(2):182–8.PubMedCrossRef Lee DS, Donovan L, Austin PC, Gong Y, Liu P, Rouleau JL, Tu JV. Comparison of coding of heart failure and comorbidities in administrative and clinical data for use in outcomes research. Med Care. 2005;43(2):182–8.PubMedCrossRef
44.
go back to reference Hux J, Ivis V, Flintoft V, Bica A. Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;25(3):512–6.PubMedCrossRef Hux J, Ivis V, Flintoft V, Bica A. Diabetes in Ontario: determination of prevalence and incidence using a validated administrative data algorithm. Diabetes Care. 2002;25(3):512–6.PubMedCrossRef
45.
go back to reference Gershon AS, Wang C, Guan J, Vasilevska-Ristovska J, Cicutto L, To T. Identifying individuals with physician-diagnosed COPD in health administrative databases. J Chron Obstruct Pulmon Dis. 2009;6(5):388–94.CrossRef Gershon AS, Wang C, Guan J, Vasilevska-Ristovska J, Cicutto L, To T. Identifying individuals with physician-diagnosed COPD in health administrative databases. J Chron Obstruct Pulmon Dis. 2009;6(5):388–94.CrossRef
46.
go back to reference Hall R, Mondor L, Porter J, Fang J, Kapral MK. Accuracy of administrative data for the coding of acute stroke and TIAs. Can J Neurol Sci. 2016;22(7):765–73.CrossRef Hall R, Mondor L, Porter J, Fang J, Kapral MK. Accuracy of administrative data for the coding of acute stroke and TIAs. Can J Neurol Sci. 2016;22(7):765–73.CrossRef
47.
go back to reference Huo J, Yang M, Shih YT. Sensitivity of claims-based algorithms to ascertain smoking status more than doubled with meaningful use. Value Health. 2018;21(3):334–40.PubMedCrossRef Huo J, Yang M, Shih YT. Sensitivity of claims-based algorithms to ascertain smoking status more than doubled with meaningful use. Value Health. 2018;21(3):334–40.PubMedCrossRef
49.
go back to reference Martin BJ, Chen G, Graham M, Quan H. Coding obesity in administrative hospital discharge abstract data: accuracy and impact for future research. BMC Health Serv Res. 2014;14:70.PubMedPubMedCentralCrossRef Martin BJ, Chen G, Graham M, Quan H. Coding obesity in administrative hospital discharge abstract data: accuracy and impact for future research. BMC Health Serv Res. 2014;14:70.PubMedPubMedCentralCrossRef
50.
go back to reference Crooks CJ, West J, Card TR. A comparison of the recording of comorbidity in primary and secondary care by using the Charlson index to predict short-term and long-term survival in a routine linked data cohort. BMJ Open. 2015;5:e007974.PubMedPubMedCentralCrossRef Crooks CJ, West J, Card TR. A comparison of the recording of comorbidity in primary and secondary care by using the Charlson index to predict short-term and long-term survival in a routine linked data cohort. BMJ Open. 2015;5:e007974.PubMedPubMedCentralCrossRef
Metadata
Title
Developing an adapted Charlson comorbidity index for ischemic stroke outcome studies
Authors
Ruth E. Hall
Joan Porter
Hude Quan
Mathew J. Reeves
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-4720-y

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue