Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Variations in hospital standardised mortality ratios (HSMR) as a result of frequent readmissions

Authors: Wim F van den Bosch, Peter Spreeuwenberg, Cordula Wagner

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

We investigated the impact that variations in the frequency of readmissions had upon a hospital's standardised mortality ratio (HSMR). An adapted HSMR model was used in the study. Our calculations were based on the admissions of 70 hospitals in the Netherlands during the years 2005 to 2009.

Methods

Through a retrospective analysis of routinely collected hospital data, we calculated standardised in-hospital mortality ratios both by hospital and by diagnostic group (H/SMRs) using two different models. The first was the Dutch 2010 model while the second was the same model but with an additional adjustment for the readmission frequency. We compared H/SMR outcomes and the corresponding quality metrics in order to test discrimination (c-statistics), calibration (Hosmer-Lemeshow) and explanatory power (pseudo-R2 statistic) for both models.

Results

The SMR outcomes for model 2 compared to model 1, varied between -39% and +110%. On the HSMR level these variations ranged from -12% to +11%. There was a substantial disagreement between the models with respect to significant death on the SMR level as well as the HSMR level (~ 20%). All quality metrics comparing both models were in favour of model 2. The susceptibility to adjustment for readmission increased for longer review periods.

Conclusions

The 2010 HSMR model for the Netherlands was sensitive to adjustment for the frequency of readmissions. A model without this adjustment, as opposed to a model with the adjustment, produced substantially different HSMR outcomes. The uncertainty introduced by these differences exceeded the uncertainty indicated by the 95% confidence intervals. Therefore an adjustment for the frequency of readmissions should be considered in the Netherlands, since such a model showed more favourable quality metric characteristics compared to a model without such an adjustment. Other countries could well benefit from a similar adjustment to their models. A review period of the data collected over the last three years, at least, is advisable.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jarman B, Pieter D, van der Veen AA, et al: The hospital standardised mortality ratio: a powerful tool for Dutch hospitals to assess their quality of care?. Qual Saf Health Care. 2010, 19: 9-13.CrossRefPubMedPubMedCentral Jarman B, Pieter D, van der Veen AA, et al: The hospital standardised mortality ratio: a powerful tool for Dutch hospitals to assess their quality of care?. Qual Saf Health Care. 2010, 19: 9-13.CrossRefPubMedPubMedCentral
3.
go back to reference Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away. BMJ. 2010, 340: c2016.CrossRefPubMed Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won't go away. BMJ. 2010, 340: c2016.CrossRefPubMed
5.
go back to reference Penfold RB, et al: Do hospital standardised mortality ratios measure patient safety? HSMRs in the Winnipeg Regional Health Authority. Healthcare Papers. 2008, 8 (4): 8-23.CrossRefPubMed Penfold RB, et al: Do hospital standardised mortality ratios measure patient safety? HSMRs in the Winnipeg Regional Health Authority. Healthcare Papers. 2008, 8 (4): 8-23.CrossRefPubMed
6.
go back to reference Van den Bosch WF, Roozendaal KJ, Silberbusch J, Wagner J: Variation in coding patient data impacts hospital standardised mortality ratios (HSMR). Ned Tijdschr Geneeskd. 2010, 154: A1189-in DutchPubMed Van den Bosch WF, Roozendaal KJ, Silberbusch J, Wagner J: Variation in coding patient data impacts hospital standardised mortality ratios (HSMR). Ned Tijdschr Geneeskd. 2010, 154: A1189-in DutchPubMed
7.
go back to reference Van den Bosch WF, Graafmans WC, Pieter D, Westert GP: Cardiac centres and the HSMR. The impact of special medical procedures upon the hospital standardised mortality ratio. Ned Tijdschr Geneeskd. 2008, in Dutch: 1221-7. in Dutch Van den Bosch WF, Graafmans WC, Pieter D, Westert GP: Cardiac centres and the HSMR. The impact of special medical procedures upon the hospital standardised mortality ratio. Ned Tijdschr Geneeskd. 2008, in Dutch: 1221-7. in Dutch
8.
go back to reference Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009, 338: b780.CrossRefPubMedPubMedCentral Mohammed MA, Deeks JJ, Girling A, Rudge G, Carmalt M, Stevens AJ, Lilford RJ: Evidence of methodological bias in hospital standardised mortality ratios: retrospective database study of English hospitals. BMJ. 2009, 338: b780.CrossRefPubMedPubMedCentral
9.
go back to reference Lilford R, Mohammed MA, Spiegelhalter D, Thomson R: Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004, 363: 1147-1154.CrossRefPubMed Lilford R, Mohammed MA, Spiegelhalter D, Thomson R: Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet. 2004, 363: 1147-1154.CrossRefPubMed
10.
go back to reference Van den Bosch WF, Kelder HC, Wagner C: Predicting hospital mortality among frequently readmitted patients: HSMR biased by readmission. BMC Health Serv Res. 2011, 11: 57.CrossRefPubMedPubMedCentral Van den Bosch WF, Kelder HC, Wagner C: Predicting hospital mortality among frequently readmitted patients: HSMR biased by readmission. BMC Health Serv Res. 2011, 11: 57.CrossRefPubMedPubMedCentral
11.
go back to reference Bottle A, Jarman B, Aylin P: Hospital standardized mortality ratios: sensitivity analysis on the impact of coding. Heal Serv Res. doi:10.1111/j.1475-6773.2011.01295.x Bottle A, Jarman B, Aylin P: Hospital standardized mortality ratios: sensitivity analysis on the impact of coding. Heal Serv Res. doi:10.1111/j.1475-6773.2011.01295.x
13.
go back to reference Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, New York: Wiley, ISBN 0471615536CrossRef Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, New York: Wiley, ISBN 0471615536CrossRef
14.
go back to reference Drye EE, Normand SLT, Wang Y, et al: Comparison of hospital risk-standardized mortality rates calculated by using in-hospital and 30-day models: an observational study with implications for hospital profiling. Ann Intern Med. 2012, 156 (no. 1 Part 1): 19-26.CrossRefPubMedPubMedCentral Drye EE, Normand SLT, Wang Y, et al: Comparison of hospital risk-standardized mortality rates calculated by using in-hospital and 30-day models: an observational study with implications for hospital profiling. Ann Intern Med. 2012, 156 (no. 1 Part 1): 19-26.CrossRefPubMedPubMedCentral
Metadata
Title
Variations in hospital standardised mortality ratios (HSMR) as a result of frequent readmissions
Authors
Wim F van den Bosch
Peter Spreeuwenberg
Cordula Wagner
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-91

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue