Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Research

The ability of comorbidity indices to predict mortality in an orthopedic setting: a systematic review

Authors: Per Hviid Gundtoft, Mari Jørstad, Julie Ladeby Erichsen, Hagen Schmal, Bjarke Viberg

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

Background

Several comorbidity indices have been created to estimate and adjust for the burden of comorbidity. The objective of this systematic review was to evaluate and compare the ability of different comorbidity indices to predict mortality in an orthopedic setting.

Methods

A systematic search was conducted in Embase, MEDLINE, and Cochrane Library. The search were constructed around two primary focal points: a comorbidity index and orthopedics. The last search were performed on 13 June 2019. Eligibility criteria were participants with orthopedic conditions or who underwent an orthopedic procedure, a comparison between comorbidity indices that used administrative data, and reported mortality as outcome. Two independent reviewers screened the studies using Covidence. The area under the curve (AUC) was chosen as the primary effect estimate.

Results

Of the 5338 studies identified, 16 met the eligibility criteria. The predictive ability of the different comorbidity indices ranged from poor (AUC < 0.70) to excellent (AUC ≥ 0.90). The majority of the included studies compared the Elixhauser Comorbidity Index (ECI) and the Charlson Comorbidity Index (CCI). In-hospital mortality was reported in eight studies reporting AUC values ranging from 0.70 to 0.92 for ECI and 0.68 to 0.89 for CCI. AUC values were generally lower for all other time points ranging from 0.67 to 0.78. For 1-year mortality the overall effect size ranging from 0.67 to 0.77 for ECI and 0.69 to 0.77 for CCI.

Conclusion

The results of this review indicate that the ECI and CCI can equally be used to adjust for comorbidities when analyzing mortality in an orthopedic setting.

Trial registration

The protocol for this systematic review was registered on PROSPERO, the International Prospective Register of Systematic Reviews on 13 June 2019 and can be accessed through record ID 133,871.
Appendix
Available only for authorised users
Literature
1.
go back to reference Austin SR, Wong YN, Uzzo RG, Beck JR, Egleston BL. Why summary comorbidity measures such as the Charlson Comorbidity Index and Elixhauser Score Work. Med Care. 2015;53(9):e65-72.CrossRef Austin SR, Wong YN, Uzzo RG, Beck JR, Egleston BL. Why summary comorbidity measures such as the Charlson Comorbidity Index and Elixhauser Score Work. Med Care. 2015;53(9):e65-72.CrossRef
2.
go back to reference Molto A, Dougados M. Comorbidity indices. Clin Exp Rheumatol. 2014;32(5 Suppl 85):S-131-4. Molto A, Dougados M. Comorbidity indices. Clin Exp Rheumatol. 2014;32(5 Suppl 85):S-131-4.
3.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.CrossRef Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.CrossRef
4.
go back to reference Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173(6):676–82.CrossRef Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173(6):676–82.CrossRef
5.
go back to reference Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45(6):613–9.CrossRef Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45(6):613–9.CrossRef
6.
go back to reference Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46(10):1075–9. discussion 81-90.CrossRef Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46(10):1075–9. discussion 81-90.CrossRef
7.
go back to reference Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8–27.CrossRef Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8–27.CrossRef
8.
go back to reference Yurkovich M, Avina-Zubieta JA, Thomas J, Gorenchtein M, Lacaille D. A systematic review identifies valid comorbidity indices derived from administrative health data. J Clin Epidemiol. 2015;68(1):3–14.CrossRef Yurkovich M, Avina-Zubieta JA, Thomas J, Gorenchtein M, Lacaille D. A systematic review identifies valid comorbidity indices derived from administrative health data. J Clin Epidemiol. 2015;68(1):3–14.CrossRef
9.
go back to reference Sharabiani MT, Aylin P, Bottle A. Systematic review of comorbidity indices for administrative data. Med Care. 2012;50(12):1109–18.CrossRef Sharabiani MT, Aylin P, Bottle A. Systematic review of comorbidity indices for administrative data. Med Care. 2012;50(12):1109–18.CrossRef
11.
go back to reference Azzalini L, Chabot-Blanchet M, Southern DA, Nozza A, Wilton SB, Graham MM, et al. A disease-specific comorbidity index for predicting mortality in patients admitted to hospital with a cardiac condition. CMAJ. 2019;191(11):E299-e307.CrossRef Azzalini L, Chabot-Blanchet M, Southern DA, Nozza A, Wilton SB, Graham MM, et al. A disease-specific comorbidity index for predicting mortality in patients admitted to hospital with a cardiac condition. CMAJ. 2019;191(11):E299-e307.CrossRef
16.
go back to reference Bulow E, Cnudde P, Rogmark C, Rolfson O, Nemes S. Low predictive power of comorbidity indices identified for mortality after acute arthroplasty surgery undertaken for femoral neck fracture. Bone Joint J. 2019;101B(1):104–12.CrossRef Bulow E, Cnudde P, Rogmark C, Rolfson O, Nemes S. Low predictive power of comorbidity indices identified for mortality after acute arthroplasty surgery undertaken for femoral neck fracture. Bone Joint J. 2019;101B(1):104–12.CrossRef
17.
go back to reference Inacio MCS, Pratt NL, Roughead EE, Graves SE. Evaluation of three co-morbidity measures to predict mortality in patients undergoing total joint arthroplasty. Osteoarthritis Cartilage. 2016;24(10):1718–26.CrossRef Inacio MCS, Pratt NL, Roughead EE, Graves SE. Evaluation of three co-morbidity measures to predict mortality in patients undergoing total joint arthroplasty. Osteoarthritis Cartilage. 2016;24(10):1718–26.CrossRef
18.
go back to reference Kurichi JE, Stineman MG, Kwong PL, Bates BE, Reker DM. Assessing and using comorbidity measures in elderly veterans with lower extremity amputations. Gerontology. 2007;53(5):255–9.CrossRef Kurichi JE, Stineman MG, Kwong PL, Bates BE, Reker DM. Assessing and using comorbidity measures in elderly veterans with lower extremity amputations. Gerontology. 2007;53(5):255–9.CrossRef
19.
go back to reference Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.CrossRef Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.CrossRef
21.
go back to reference Steyerberg EW, Harrell FE Jr. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. 2016;69:245–7.CrossRef Steyerberg EW, Harrell FE Jr. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. 2016;69:245–7.CrossRef
22.
go back to reference Boddaert J, Na N, Le Manach Y, Raux M, Cohen-Bittan J, Vallet H, et al. Prediction of postoperative mortality in elderly patients with hip fracture: Are specific and geriatric scores better than general scores? Br J Anaesth. 2017;118(6):952–4.CrossRef Boddaert J, Na N, Le Manach Y, Raux M, Cohen-Bittan J, Vallet H, et al. Prediction of postoperative mortality in elderly patients with hip fracture: Are specific and geriatric scores better than general scores? Br J Anaesth. 2017;118(6):952–4.CrossRef
23.
go back to reference Bulow E, Rolfson O, Cnudde P, Rogmark C, Garellick G, Nemes S. Comorbidity does not predict long-term mortality after total hip arthroplasty. Acta Orthop. 2017;88(5):472–7.CrossRef Bulow E, Rolfson O, Cnudde P, Rogmark C, Garellick G, Nemes S. Comorbidity does not predict long-term mortality after total hip arthroplasty. Acta Orthop. 2017;88(5):472–7.CrossRef
24.
go back to reference Kim CY, Sivasundaram L, LaBelle MW, Trivedi NN, Liu RW, Gillespie RJ. Predicting adverse events, length of stay, and discharge disposition following shoulder arthroplasty: a comparison of the Elixhauser Comorbidity Measure and Charlson Comorbidity Index. J Shoulder Elbow Surg. 2018;27(10):1748–55.CrossRef Kim CY, Sivasundaram L, LaBelle MW, Trivedi NN, Liu RW, Gillespie RJ. Predicting adverse events, length of stay, and discharge disposition following shoulder arthroplasty: a comparison of the Elixhauser Comorbidity Measure and Charlson Comorbidity Index. J Shoulder Elbow Surg. 2018;27(10):1748–55.CrossRef
25.
go back to reference Lopez-de-Andres A, Hernandez-Barrera V, Lopez R, Martin-Junco P, Jimenez-Trujillo I, Alvaro-Meca A, et al. Predictors of in-hospital mortality following major lower extremity amputations in type 2 diabetic patients using artificial neural networks. BMC Med Res Methodol. 2016;16(1):160.CrossRef Lopez-de-Andres A, Hernandez-Barrera V, Lopez R, Martin-Junco P, Jimenez-Trujillo I, Alvaro-Meca A, et al. Predictors of in-hospital mortality following major lower extremity amputations in type 2 diabetic patients using artificial neural networks. BMC Med Res Methodol. 2016;16(1):160.CrossRef
26.
go back to reference Menendez ME, Neuhaus V, van Dijk CN, Ring D. The Elixhauser comorbidity method outperforms the Charlson Index in predicting inpatient death after orthopaedic surgery. Clin Orthop Relat Res. 2014;472(9):2878–86.CrossRef Menendez ME, Neuhaus V, van Dijk CN, Ring D. The Elixhauser comorbidity method outperforms the Charlson Index in predicting inpatient death after orthopaedic surgery. Clin Orthop Relat Res. 2014;472(9):2878–86.CrossRef
27.
go back to reference Menendez ME, Ring D. A comparison of the Charlson and Elixhauser comorbidity measures to predict inpatient mortality after proximal humerus fracture. J Orthop Trauma. 2015;29(11):488–93.CrossRef Menendez ME, Ring D. A comparison of the Charlson and Elixhauser comorbidity measures to predict inpatient mortality after proximal humerus fracture. J Orthop Trauma. 2015;29(11):488–93.CrossRef
28.
go back to reference Menendez ME, Ring D, Harris MB, Cha TD. Predicting in-hospital mortality in elderly patients with cervical spine fractures: a comparison of the charlson and elixhauser comorbidity measures. Spine. 2015;40(11):809–15.CrossRef Menendez ME, Ring D, Harris MB, Cha TD. Predicting in-hospital mortality in elderly patients with cervical spine fractures: a comparison of the charlson and elixhauser comorbidity measures. Spine. 2015;40(11):809–15.CrossRef
29.
go back to reference Menendez ME, Neuhaus V, Ring D. Inpatient mortality after orthopaedic surgery. International Orthopaedics. 2015;39(7):1307–14.CrossRef Menendez ME, Neuhaus V, Ring D. Inpatient mortality after orthopaedic surgery. International Orthopaedics. 2015;39(7):1307–14.CrossRef
30.
go back to reference Neuhaus V, King J, Hageman MG, Ring DC. Charlson comorbidity indices and in-hospital deaths in patients with hip fractures. Clin Orthop Relat Res. 2013;471(5):1712–9. Neuhaus V, King J, Hageman MG, Ring DC. Charlson comorbidity indices and in-hospital deaths in patients with hip fractures. Clin Orthop Relat Res. 2013;471(5):1712–9.
31.
go back to reference Ondeck NT, Bohl DD, Bovonratwet P, McLynn RP, Cui JJ, Grauer JN. Discriminative ability of Elixhauser’s comorbidity measure is superior to other comorbidity scores for inpatient adverse outcomes after total hip arthroplasty. J Arthroplasty. 2018;33(1):250–7.CrossRef Ondeck NT, Bohl DD, Bovonratwet P, McLynn RP, Cui JJ, Grauer JN. Discriminative ability of Elixhauser’s comorbidity measure is superior to other comorbidity scores for inpatient adverse outcomes after total hip arthroplasty. J Arthroplasty. 2018;33(1):250–7.CrossRef
32.
go back to reference Radley DC, Gottlieb DJ, Fisher ES, Tosteson AN. Comorbidity risk-adjustment strategies are comparable among persons with hip fracture. J Clin Epidemiol. 2008;61:580–7. Radley DC, Gottlieb DJ, Fisher ES, Tosteson AN. Comorbidity risk-adjustment strategies are comparable among persons with hip fracture. J Clin Epidemiol. 2008;61:580–7.
33.
go back to reference Toson B, Harvey LA, Close JC. New ICD-10 version of the multipurpose Australian comorbidity scoring system outperformed Charlson and Elixhauser comorbidities in an older population. J Clin Epidemiol. 2016;79:62–9. Toson B, Harvey LA, Close JC. New ICD-10 version of the multipurpose Australian comorbidity scoring system outperformed Charlson and Elixhauser comorbidities in an older population. J Clin Epidemiol. 2016;79:62–9.
34.
go back to reference Hua-Gen Li M, Hutchinson A, Tacey M, Duke G. Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Healthc Inform. 2019;26(1):16. Hua-Gen Li M, Hutchinson A, Tacey M, Duke G. Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Healthc Inform. 2019;26(1):16.
35.
go back to reference Powell H, Lim LL, Heller RF. Accuracy of administrative data to assess comorbidity in patients with heart disease. an Australian perspective. J Clin Epidemiol. 2001;54(7):687–93.CrossRef Powell H, Lim LL, Heller RF. Accuracy of administrative data to assess comorbidity in patients with heart disease. an Australian perspective. J Clin Epidemiol. 2001;54(7):687–93.CrossRef
Metadata
Title
The ability of comorbidity indices to predict mortality in an orthopedic setting: a systematic review
Authors
Per Hviid Gundtoft
Mari Jørstad
Julie Ladeby Erichsen
Hagen Schmal
Bjarke Viberg
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-021-01785-4

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue