Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2015

Open Access 01-12-2015 | Research article

Assessing measures of comorbidity and functional status for risk adjustment to compare hospital performance for colorectal cancer surgery: a retrospective data-linkage study

Authors: Timothy A Dobbins, Tim Badgery-Parker, David C Currow, Jane M Young

Published in: BMC Medical Informatics and Decision Making | Issue 1/2015

Login to get access

Abstract

Background

Comparing outcomes between hospitals requires consideration of patient factors that could account for any observed differences. Adjusting for comorbid conditions is common when studying outcomes following cancer surgery, and a commonly used measure is the Charlson comorbidity index. Other measures of patient health include the ECOG performance status and the ASA physical status score. This study aimed to ascertain how frequently ECOG and ASA scores are recorded in population-based administrative data collections in New South Wales, Australia and to assess the contribution each makes in addition to the Charlson comorbidity index in risk adjustment models for comparative assessment of colorectal cancer surgery outcomes between hospitals.

Methods

We used linked administrative data to identify 6964 patients receiving surgery for colorectal cancer in 2007 and 2008. We summarised the frequency of missing data for Charlson comorbidity index, ECOG and ASA scores, and compared patient characteristics between those with and without these measures. The performance of ASA and ECOG in risk adjustment models that also included Charlson index was assessed for three binary outcomes: 12-month mortality, extended length of stay and 28-day readmission. Patient outcomes were compared between hospital peer groups using multilevel logistic regression analysis.

Results

The Charlson comorbidity index could be derived for all patients, ASA score was recorded for 78 % of patients and ECOG performance status recorded for only 24 % of eligible patients. Including ASA or ECOG improved the predictive ability of models, but there was no consistently best combination. The addition of ASA or ECOG did not substantially change parameter estimates for hospital peer group after adjusting for Charlson comorbidity index.

Conclusions

While predictive ability of regression models is maximised by inclusion of one or both of ASA score and ECOG performance status, there is little to be gained by adding ASA or ECOG to models containing the Charlson comorbidity index to address confounding. The Charlson comorbidity index has good performance and is an appropriate measure to use in risk adjustment to compare outcomes between hospitals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sarfati D, Hill S, Blakely T, Robson B, Purdie G, Dennett E, et al. The effect of comorbidity on the use of adjuvant chemotherapy and survival from colon cancer: a retrospective cohort study. BMC Cancer. 2009;9:116. Sarfati D, Hill S, Blakely T, Robson B, Purdie G, Dennett E, et al. The effect of comorbidity on the use of adjuvant chemotherapy and survival from colon cancer: a retrospective cohort study. BMC Cancer. 2009;9:116.
2.
go back to reference Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.CrossRefPubMed Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.CrossRefPubMed
3.
go back to reference Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613–9.CrossRefPubMed Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613–9.CrossRefPubMed
4.
go back to reference Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46:1075–9.CrossRefPubMed Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46:1075–9.CrossRefPubMed
5.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed
6.
go back to reference Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004;57:1288–94.CrossRefPubMed Sundararajan V, Henderson T, Perry C, Muggivan A, Quan H, Ghali WA. New ICD-10 version of the Charlson comorbidity index predicted in-hospital mortality. J Clin Epidemiol. 2004;57:1288–94.CrossRefPubMed
7.
go back to reference Quan H, Li B, Couris C, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82. Quan H, Li B, Couris C, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82.
8.
go back to reference Oken M, Creech R, Tormey D, Horton J, Davis T, McFadden E, et al. Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol. 1982;5:649–55. Oken M, Creech R, Tormey D, Horton J, Davis T, McFadden E, et al. Toxicity and response criteria of the Eastern Cooperative Oncology Group. Am J Clin Oncol. 1982;5:649–55.
9.
go back to reference Owens WD, Felts JA, Spitznagel Jr EL. ASA physical status classifications: a study of consistency of ratings. Anesthesiology. 1978;49:239–43.CrossRefPubMed Owens WD, Felts JA, Spitznagel Jr EL. ASA physical status classifications: a study of consistency of ratings. Anesthesiology. 1978;49:239–43.CrossRefPubMed
10.
go back to reference Dekker J, Gooiker G, van der Geest L, Kolfschoten N, Struikmans H, Putter H, et al. Use of different comorbidity scores for risk-adjustment in the evaluation of quality of colorectal cancer surgery: does it matter? Eur J Surg Oncol. 2012;38:1071–8. Dekker J, Gooiker G, van der Geest L, Kolfschoten N, Struikmans H, Putter H, et al. Use of different comorbidity scores for risk-adjustment in the evaluation of quality of colorectal cancer surgery: does it matter? Eur J Surg Oncol. 2012;38:1071–8.
11.
go back to reference Hines RB, Chatla C, Bumpers HL, Waterbor JW, McGwin G, Funkhouser E, et al. Predictive capacity of three comorbidity indices in estimating mortality after surgery for colon cancer. J Clin Oncol. 2009;27:4339–45.CrossRefPubMedPubMedCentral Hines RB, Chatla C, Bumpers HL, Waterbor JW, McGwin G, Funkhouser E, et al. Predictive capacity of three comorbidity indices in estimating mortality after surgery for colon cancer. J Clin Oncol. 2009;27:4339–45.CrossRefPubMedPubMedCentral
12.
go back to reference Mayr R, May M, Martini T, Lodde M, Pycha A, Comploj E, et al. Predictive capacity of four comorbidity indices estimating perioperative mortality after radical cystectomy for urothelial carcinoma of the bladder. BJU Int. 2012;6 Pt B:E222–7.CrossRef Mayr R, May M, Martini T, Lodde M, Pycha A, Comploj E, et al. Predictive capacity of four comorbidity indices estimating perioperative mortality after radical cystectomy for urothelial carcinoma of the bladder. BJU Int. 2012;6 Pt B:E222–7.CrossRef
13.
go back to reference Young J, Badgery-Parker T, Dobbins T, Jorgensen M, Gibbs P, Faragher I, et al. Comparison of ECOG/WHO Performance Status and ASA Score as a Measure of Functional Status. J Pain Symptom Manage. 2015;49:258–64. Young J, Badgery-Parker T, Dobbins T, Jorgensen M, Gibbs P, Faragher I, et al. Comparison of ECOG/WHO Performance Status and ASA Score as a Measure of Functional Status. J Pain Symptom Manage. 2015;49:258–64.
14.
go back to reference Population and Public Health Division. New South Wales Admitted Patient Report. Sydney: NSW Ministry of Health; 2012. Population and Public Health Division. New South Wales Admitted Patient Report. Sydney: NSW Ministry of Health; 2012.
15.
go back to reference Young JM, Jorgensen M, Dobbins T, Solomon MJ: CESR Technical Report 1: the Quality and Usefulness of the NSW Clinical Cancer Registry Minimum Dataset and Colorectal Dataset Extension for Colorectal Cancer Services Research. 2012 28 October 2013]; Available from: http://hdl.handle.net/2123/8936. Young JM, Jorgensen M, Dobbins T, Solomon MJ: CESR Technical Report 1: the Quality and Usefulness of the NSW Clinical Cancer Registry Minimum Dataset and Colorectal Dataset Extension for Colorectal Cancer Services Research. 2012 28 October 2013]; Available from: http://​hdl.​handle.​net/​2123/​8936.
16.
go back to reference Semmens JB, Platell C, Threlfall TJ, Holman CD. A population-based study of the incidence, mortality and outcomes in patients following surgery for colorectal cancer in Western Australia. Aust N Z J Surg. 2000;70:11–8.CrossRefPubMed Semmens JB, Platell C, Threlfall TJ, Holman CD. A population-based study of the incidence, mortality and outcomes in patients following surgery for colorectal cancer in Western Australia. Aust N Z J Surg. 2000;70:11–8.CrossRefPubMed
17.
go back to reference Thompson BS, Coory MD, Lumley JW. National trends in the uptake of laparoscopic resection for colorectal cancer, 2000–2008. Med J Aust. 2011;194:443–7.PubMed Thompson BS, Coory MD, Lumley JW. National trends in the uptake of laparoscopic resection for colorectal cancer, 2000–2008. Med J Aust. 2011;194:443–7.PubMed
19.
go back to reference Demand and Performance Evaluation Branch. NSW Health: NSW Health Services Comparison Data Book 2008/2009. Australia: NSW Health: NSW; 2010. Demand and Performance Evaluation Branch. NSW Health: NSW Health Services Comparison Data Book 2008/2009. Australia: NSW Health: NSW; 2010.
20.
go back to reference Barraclough H, Morrell S, Arcorace M, McElroy HJ, Baker DF. Degree-of-spread artefact in the New South Wales Central Cancer Registry. Aust N Z J Public Health. 2008;32:414–6.CrossRefPubMed Barraclough H, Morrell S, Arcorace M, McElroy HJ, Baker DF. Degree-of-spread artefact in the New South Wales Central Cancer Registry. Aust N Z J Public Health. 2008;32:414–6.CrossRefPubMed
21.
go back to reference Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed
22.
go back to reference Goldsbury DE, Armstrong K, Simonella L, Armstrong BK, O'Connell DL. Using administrative health data to describe colorectal and lung cancer care in New South Wales, Australia: a validation study. BMC Health Serv Res. 2012;12:387.CrossRefPubMedPubMedCentral Goldsbury DE, Armstrong K, Simonella L, Armstrong BK, O'Connell DL. Using administrative health data to describe colorectal and lung cancer care in New South Wales, Australia: a validation study. BMC Health Serv Res. 2012;12:387.CrossRefPubMedPubMedCentral
23.
go back to reference Sarfati D, Gurney J, Stanley J, Salmond C, Crampton P, Dennett E, et al. Cancer-specific administrative data-based comorbidity indices provided valid alternative to Charlson and NHI indices. J Clin Epidemiol. 2014;67:586–95.CrossRefPubMed Sarfati D, Gurney J, Stanley J, Salmond C, Crampton P, Dennett E, et al. Cancer-specific administrative data-based comorbidity indices provided valid alternative to Charlson and NHI indices. J Clin Epidemiol. 2014;67:586–95.CrossRefPubMed
24.
go back to reference Sterne JA, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393. Sterne JA, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393.
Metadata
Title
Assessing measures of comorbidity and functional status for risk adjustment to compare hospital performance for colorectal cancer surgery: a retrospective data-linkage study
Authors
Timothy A Dobbins
Tim Badgery-Parker
David C Currow
Jane M Young
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2015
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-015-0175-1

Other articles of this Issue 1/2015

BMC Medical Informatics and Decision Making 1/2015 Go to the issue