Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Using clinical variables and drug prescription data to control for confounding in outcome comparisons between hospitals

Authors: Paola Colais, Mirko Di Martino, Danilo Fusco, Marina Davoli, Paul Aylin, Carlo Alberto Perucci

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Hospital discharge records are an essential source of information when comparing health outcomes among hospitals; however, they contain limited information on acute clinical conditions. Doubts remain as to whether the addition of clinical and drug consumption information would improve the prediction of health outcomes and reduce confounding in inter-hospital comparisons. The objective of the study is to compare the performance of two multivariate risk adjustment models, with and without clinical data and drug prescription information, in terms of their capability to a) predict short-term outcome rates and b) compare hospitals’ risk-adjusted outcome rates using two risk-adjustment procedures.

Methods

Observational, retrospective study based on hospital data collected at the regional level.
Two cohorts of patients discharged in 2010 from hospitals located in the Lazio Region, Italy: acute myocardial infarction (AMI) and hip fracture (HF). Multivariate logistic regression models were implemented to predict 30-day mortality (AMI) or 48-hour surgery (HF), adjusting for demographic characteristics and comorbidities plus clinical data and drug prescription information. Risk-adjusted outcome rates were derived at the hospital level.

Results

The addition of clinical data and drug prescription information improved the capability of the models to predict the study outcomes for the two conditions investigated. The discriminatory power of the AMI model increases when the clinical data and drug prescription information are included (c-statistic increases from 0.761 to 0.797); for the HF model the increase was more slight (c-statistic increases from 0.555 to 0.574). Some differences were observed between the hospital-adjusted proportion estimated using the two different models. However, the estimated hospital outcome rates were weakly affected by the introduction of clinical data and drug prescription information.

Conclusions

The results show that the available clinical variables and drug prescription information were important complements to the hospital discharge data for characterising the acute severity of the patients. However, when these variables were used for adjustment purposes their contribution was negligible. This conclusion might not apply at other locations, in other time periods and for other health conditions if there is heterogeneity in the clinical conditions between hospitals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Groene O, Skau JKH, Frolich A: An international review of projects on hospital performance assessment. Int J Qual Health Care. 2008, 20: 162-171. 10.1093/intqhc/mzn008.CrossRefPubMed Groene O, Skau JKH, Frolich A: An international review of projects on hospital performance assessment. Int J Qual Health Care. 2008, 20: 162-171. 10.1093/intqhc/mzn008.CrossRefPubMed
2.
go back to reference Gibberd R, Hancock S, Howley P, Richards K: Using indicators to quantify the potential to improve the quality of health care. Int J Qual Health Care. 2004, 16: i37-i43. 10.1093/intqhc/mzh019.CrossRefPubMed Gibberd R, Hancock S, Howley P, Richards K: Using indicators to quantify the potential to improve the quality of health care. Int J Qual Health Care. 2004, 16: i37-i43. 10.1093/intqhc/mzh019.CrossRefPubMed
3.
go back to reference Berwick DM, James B, Coye MJ: Connections between quality measurement and improvement. Med Care. 2003, 41: I30-I38. 10.1097/00005650-200301001-00004.CrossRefPubMed Berwick DM, James B, Coye MJ: Connections between quality measurement and improvement. Med Care. 2003, 41: I30-I38. 10.1097/00005650-200301001-00004.CrossRefPubMed
4.
go back to reference Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, Roman S, Normand SL: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006, 113 (13): 1683-1692. 10.1161/CIRCULATIONAHA.105.611186.CrossRefPubMed Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, Roman S, Normand SL: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006, 113 (13): 1683-1692. 10.1161/CIRCULATIONAHA.105.611186.CrossRefPubMed
5.
go back to reference Johnston TC, Coory MD, Scott I, Duckett S: Should we add clinical variables to administrative data?: The case of risk-adjusted case fatality rates after admission for acute myocardial infarction. Med Care. 2007, 45 (12): 1180-1185. 10.1097/MLR.0b013e318148477c.CrossRefPubMed Johnston TC, Coory MD, Scott I, Duckett S: Should we add clinical variables to administrative data?: The case of risk-adjusted case fatality rates after admission for acute myocardial infarction. Med Care. 2007, 45 (12): 1180-1185. 10.1097/MLR.0b013e318148477c.CrossRefPubMed
6.
go back to reference Parker JP, Li Z, Damberg CL, Danielsen B, Carlisle DM: Administrative versus clinical data for coronary artery bypass graft surgery report cards: the view from California. Med Care. 2006, 44 (7): 687-695. 10.1097/01.mlr.0000215815.70506.b6.CrossRefPubMed Parker JP, Li Z, Damberg CL, Danielsen B, Carlisle DM: Administrative versus clinical data for coronary artery bypass graft surgery report cards: the view from California. Med Care. 2006, 44 (7): 687-695. 10.1097/01.mlr.0000215815.70506.b6.CrossRefPubMed
7.
go back to reference Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, Meimban R, Warner D, Gonzales J: Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007, 297 (1): 71-76. 10.1001/jama.297.1.71.CrossRefPubMed Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, Meimban R, Warner D, Gonzales J: Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007, 297 (1): 71-76. 10.1001/jama.297.1.71.CrossRefPubMed
8.
go back to reference Pine M, Norusis M, Jones B, Rosenthal GE: Predictions of hospital mortality rates: a comparison of data sources. Ann Intern Med. 1997, 126 (5): 347-354. 10.7326/0003-4819-126-5-199703010-00002.CrossRefPubMed Pine M, Norusis M, Jones B, Rosenthal GE: Predictions of hospital mortality rates: a comparison of data sources. Ann Intern Med. 1997, 126 (5): 347-354. 10.7326/0003-4819-126-5-199703010-00002.CrossRefPubMed
9.
go back to reference Iezzoni L: Assessing quality using administrative data. Ann Intern Med. 1997, 127: 666-674. 10.7326/0003-4819-127-8_Part_2-199710151-00048.CrossRefPubMed Iezzoni L: Assessing quality using administrative data. Ann Intern Med. 1997, 127: 666-674. 10.7326/0003-4819-127-8_Part_2-199710151-00048.CrossRefPubMed
10.
go back to reference Park HK, Yoon SJ, Ahn HS, Ahn LS, Seo HJ, Lee SI, Lee KS: Comparison of risk-adjustment models using administrative or clinical data for outcome prediction in patients after myocardial infarction or coronary bypass surgery in Korea. Int J Clin Pract. 2007, 61 (7): 1086-1090. 10.1111/j.1742-1241.2007.01345.x.CrossRefPubMed Park HK, Yoon SJ, Ahn HS, Ahn LS, Seo HJ, Lee SI, Lee KS: Comparison of risk-adjustment models using administrative or clinical data for outcome prediction in patients after myocardial infarction or coronary bypass surgery in Korea. Int J Clin Pract. 2007, 61 (7): 1086-1090. 10.1111/j.1742-1241.2007.01345.x.CrossRefPubMed
11.
go back to reference Pine M, Jones B, Lou Y-B: Laboratory values improve predictions of hospital mortality. Int J Qual Health Care. 1998, 10: 491-501. 10.1093/intqhc/10.6.491.CrossRefPubMed Pine M, Jones B, Lou Y-B: Laboratory values improve predictions of hospital mortality. Int J Qual Health Care. 1998, 10: 491-501. 10.1093/intqhc/10.6.491.CrossRefPubMed
14.
go back to reference Kuo RN, Dong YH, Liu JP, Chang CH, Shau WY, Lai MS: Predicting healthcare utilization using a pharmacy-based metric with the WHO’s anatomic therapeutic chemical algorithm. Med Care. 2011, 49 (11): 1031-1039. 10.1097/MLR.0b013e31822ebe11.CrossRefPubMed Kuo RN, Dong YH, Liu JP, Chang CH, Shau WY, Lai MS: Predicting healthcare utilization using a pharmacy-based metric with the WHO’s anatomic therapeutic chemical algorithm. Med Care. 2011, 49 (11): 1031-1039. 10.1097/MLR.0b013e31822ebe11.CrossRefPubMed
15.
go back to reference Maio V, Yuen E, Rabinowitz C, Louis D, Jimbo M, Donatini A, Mall S, Taroni F: Using pharmacy data to identify those with chronic conditions in Emilia Romagna, Italy. J Health Serv Res Policy. 2005, 10 (4): 232-238. 10.1258/135581905774414259.CrossRefPubMed Maio V, Yuen E, Rabinowitz C, Louis D, Jimbo M, Donatini A, Mall S, Taroni F: Using pharmacy data to identify those with chronic conditions in Emilia Romagna, Italy. J Health Serv Res Policy. 2005, 10 (4): 232-238. 10.1258/135581905774414259.CrossRefPubMed
16.
go back to reference Schneeweiss S, Maclure M: Use of comorbidity scores for control of confounding in studies using administrative databases. Int J Epidemiol. 2000, 29 (5): 891-898. 10.1093/ije/29.5.891.CrossRefPubMed Schneeweiss S, Maclure M: Use of comorbidity scores for control of confounding in studies using administrative databases. Int J Epidemiol. 2000, 29 (5): 891-898. 10.1093/ije/29.5.891.CrossRefPubMed
17.
go back to reference Schneeweiss S, Seeger JD, Maclure M, Wang PS, Avorn J, Glynn RJ: Performance of comorbidity scores to control for confounding in epidemiologic studies using claims data. Am J Epidemiol. 2001, 154 (9): 854-864. 10.1093/aje/154.9.854.CrossRefPubMed Schneeweiss S, Seeger JD, Maclure M, Wang PS, Avorn J, Glynn RJ: Performance of comorbidity scores to control for confounding in epidemiologic studies using claims data. Am J Epidemiol. 2001, 154 (9): 854-864. 10.1093/aje/154.9.854.CrossRefPubMed
18.
go back to reference Schneeweiss S, Wang PS, Avorn J, Glynn RJ: Improved comorbidity adjustment for predicting mortality in Medicare populations. Health Serv Res. 2003, 38 (4): 1103-1120. 10.1111/1475-6773.00165.CrossRefPubMedPubMedCentral Schneeweiss S, Wang PS, Avorn J, Glynn RJ: Improved comorbidity adjustment for predicting mortality in Medicare populations. Health Serv Res. 2003, 38 (4): 1103-1120. 10.1111/1475-6773.00165.CrossRefPubMedPubMedCentral
20.
go back to reference AHRQ Quality Indicators. Guide to Inpatient Quality Indicators: Quality of Care in Hospitals - Volume, Mortality, and Utilization [Version 3.1]. 2007, Agency for Healthcare Research and Quality, Rockville (MD) AHRQ Quality Indicators. Guide to Inpatient Quality Indicators: Quality of Care in Hospitals - Volume, Mortality, and Utilization [Version 3.1]. 2007, Agency for Healthcare Research and Quality, Rockville (MD)
21.
go back to reference Tu JV, Khalid L, Donovan LR, Ko DT: Indicators of quality of care for patients with acute myocardial infarction. CMAJ. 2008, 179 (9): 909-915. 10.1503/cmaj.080749.CrossRefPubMedPubMedCentral Tu JV, Khalid L, Donovan LR, Ko DT: Indicators of quality of care for patients with acute myocardial infarction. CMAJ. 2008, 179 (9): 909-915. 10.1503/cmaj.080749.CrossRefPubMedPubMedCentral
22.
go back to reference L’fvendahl S, Eckerlund I, Hansagi H, Malmqvist B, Resch S, Hanning M: Waiting for orthopaedic surgery: factors associated with waiting times and patients’ opinion. Int J Qual Health Care. 2005, 17 (2): 133-140. 10.1093/intqhc/mzi012.CrossRef L’fvendahl S, Eckerlund I, Hansagi H, Malmqvist B, Resch S, Hanning M: Waiting for orthopaedic surgery: factors associated with waiting times and patients’ opinion. Int J Qual Health Care. 2005, 17 (2): 133-140. 10.1093/intqhc/mzi012.CrossRef
23.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143 (1): 29-36. 10.1148/radiology.143.1.7063747.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982, 143 (1): 29-36. 10.1148/radiology.143.1.7063747.CrossRefPubMed
24.
go back to reference Dingyi Z: Poisson Regression Adjustment of Event Rates And Its Macro Procedure ADJ_POIS. SAS Conference Proceedings: SAS Users Group International 24 April 11-14. 1999, SUGI24, Miami Beach, Florida Dingyi Z: Poisson Regression Adjustment of Event Rates And Its Macro Procedure ADJ_POIS. SAS Conference Proceedings: SAS Users Group International 24 April 11-14. 1999, SUGI24, Miami Beach, Florida
25.
go back to reference SAS/STAT software, version 8. 1999, Cary, NC, SAS Institute, Inc SAS/STAT software, version 8. 1999, Cary, NC, SAS Institute, Inc
26.
go back to reference Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, Roman S, Normand SL: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with heart failure. Circulation. 2006, 113: 1693-1701. 10.1161/CIRCULATIONAHA.105.611194.CrossRefPubMed Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, Roman S, Normand SL: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with heart failure. Circulation. 2006, 113: 1693-1701. 10.1161/CIRCULATIONAHA.105.611194.CrossRefPubMed
27.
go back to reference Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008, 46 (3): 232-239. 10.1097/MLR.0b013e3181589bb6.CrossRefPubMed Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008, 46 (3): 232-239. 10.1097/MLR.0b013e3181589bb6.CrossRefPubMed
28.
go back to reference Liu V, Kipnis P, Gould MK, Escobar GJ: Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables. Med Care. 2010, 48 (8): 739-744. 10.1097/MLR.0b013e3181e359f3.CrossRefPubMed Liu V, Kipnis P, Gould MK, Escobar GJ: Length of stay predictions: improvements through the use of automated laboratory and comorbidity variables. Med Care. 2010, 48 (8): 739-744. 10.1097/MLR.0b013e3181e359f3.CrossRefPubMed
29.
go back to reference Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009, 338: b780-10.1136/bmj.b780.CrossRefPubMedPubMedCentral Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009, 338: b780-10.1136/bmj.b780.CrossRefPubMedPubMedCentral
31.
go back to reference Fusco D, Barone AP, Sorge C, D'Ovidio M, Stafoggia M, Lallo A, Davoli M, Perucci CA: P. Re.Val.E.: outcome research program for the evaluation of health care quality in Lazio, Italy. BMC Health Serv Res. 2012, 12: 25-10.1186/1472-6963-12-25.CrossRefPubMedPubMedCentral Fusco D, Barone AP, Sorge C, D'Ovidio M, Stafoggia M, Lallo A, Davoli M, Perucci CA: P. Re.Val.E.: outcome research program for the evaluation of health care quality in Lazio, Italy. BMC Health Serv Res. 2012, 12: 25-10.1186/1472-6963-12-25.CrossRefPubMedPubMedCentral
32.
go back to reference Iezzoni LI: Risk Adjustment for Measuring Healthcare Outcomes. 1997, Health Administration Press Ann Arbor, Michigan Iezzoni LI: Risk Adjustment for Measuring Healthcare Outcomes. 1997, Health Administration Press Ann Arbor, Michigan
Metadata
Title
Using clinical variables and drug prescription data to control for confounding in outcome comparisons between hospitals
Authors
Paola Colais
Mirko Di Martino
Danilo Fusco
Marina Davoli
Paul Aylin
Carlo Alberto Perucci
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0495-3

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue