Skip to main content
Top
Published in: BMC Health Services Research 1/2012

Open Access 01-12-2012 | Research article

Comparing hospital mortality – how to count does matter for patients hospitalized for acute myocardial infarction (AMI), stroke and hip fracture

Authors: Doris T Kristoffersen, Jon Helgeland, Jocelyne Clench-Aas, Petter Laake, Marit B Veierød

Published in: BMC Health Services Research | Issue 1/2012

Login to get access

Abstract

Background

Mortality is a widely used, but often criticised, quality indicator for hospitals. In many countries, mortality is calculated from in-hospital deaths, due to limited access to follow-up data on patients transferred between hospitals and on discharged patients. The objectives were to: i) summarize time, place and cause of death for first time acute myocardial infarction (AMI), stroke and hip fracture, ii) compare case-mix adjusted 30-day mortality measures based on in-hospital deaths and in-and-out-of hospital deaths, with and without patients transferred to other hospitals.

Methods

Norwegian hospital data within a 5-year period were merged with information from official registers. Mortality based on in-and-out-of-hospital deaths, weighted according to length of stay at each hospital for transferred patients (W30D), was compared to a) mortality based on in-and-out-of-hospital deaths excluding patients treated at two or more hospitals (S30D), and b) mortality based on in-hospital deaths (IH30D). Adjusted mortalities were estimated by logistic regression which, in addition to hospital, included age, sex and stage of disease. The hospitals were assigned outlier status according to the Z-values for hospitals in the models; low mortality: Z-values below the 5-percentile, high mortality: Z-values above the 95-percentile, medium mortality: remaining hospitals.

Results

The data included 48 048 AMI patients, 47 854 stroke patients and 40 142 hip fracture patients from 55, 59 and 58 hospitals, respectively. The overall relative frequencies of deaths within 30 days were 19.1% (AMI), 17.6% (stroke) and 7.8% (hip fracture). The cause of death diagnoses included the referral diagnosis for 73.8-89.6% of the deaths within 30 days. When comparing S30D versus W30D outlier status changed for 14.6% (AMI), 15.3% (stroke) and 36.2% (hip fracture) of the hospitals. For IH30D compared to W30D outlier status changed for 18.2% (AMI), 25.4% (stroke) and 27.6% (hip fracture) of the hospitals.

Conclusions

Mortality measures based on in-hospital deaths alone, or measures excluding admissions for transferred patients, can be misleading as indicators of hospital performance. We propose to attribute the outcome to all hospitals by fraction of time spent in each hospital for patients transferred between hospitals to reduce bias due to double counting or exclusion of hospital stays.
Appendix
Available only for authorised users
Literature
1.
go back to reference De Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G: Using quality indicators to improve hospital care: a review of the literature. International Journal for Quality in Health Care. 2009, 21: 119-129. 10.1093/intqhc/mzn059.CrossRefPubMed De Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G: Using quality indicators to improve hospital care: a review of the literature. International Journal for Quality in Health Care. 2009, 21: 119-129. 10.1093/intqhc/mzn059.CrossRefPubMed
2.
go back to reference Mattke S, Epstein AM, Leatherman S: The OECD Health Care Quality Indicators Project: History and background. International Journal for Quality in Health Care. 2006, 18: 1-4.CrossRefPubMed Mattke S, Epstein AM, Leatherman S: The OECD Health Care Quality Indicators Project: History and background. International Journal for Quality in Health Care. 2006, 18: 1-4.CrossRefPubMed
4.
go back to reference Normand SLT, Shahian DM: Statistical and clinical aspects of hospital outcomes profilling. Stat Sci. 2007, 22: 206-226. 10.1214/088342307000000096.CrossRef Normand SLT, Shahian DM: Statistical and clinical aspects of hospital outcomes profilling. Stat Sci. 2007, 22: 206-226. 10.1214/088342307000000096.CrossRef
5.
go back to reference Goldstein H, Spiegelhalter DJ: League tables and their limitations: Statistical issues in comparisons of institutional performance. Journal of the Royal Statistical Society Series A-Statistics in Society. 1996, 159: 385-409. 10.2307/2983325.CrossRef Goldstein H, Spiegelhalter DJ: League tables and their limitations: Statistical issues in comparisons of institutional performance. Journal of the Royal Statistical Society Series A-Statistics in Society. 1996, 159: 385-409. 10.2307/2983325.CrossRef
6.
go back to reference Shahian DM, Wolf RE, Iezzoni LI, Kirle L, Normand SLT: Variability in the Measurement of Hospital-wide Mortality Rates. N Engl J Med. 2010, 363: 2530-2539. 10.1056/NEJMsa1006396.CrossRefPubMed Shahian DM, Wolf RE, Iezzoni LI, Kirle L, Normand SLT: Variability in the Measurement of Hospital-wide Mortality Rates. N Engl J Med. 2010, 363: 2530-2539. 10.1056/NEJMsa1006396.CrossRefPubMed
7.
go back to reference Jarman B, Gault S, Alves B, Hider A, Dolan S, Cook A, et al: Explaining differences in English hospital death rates using routinely collected data. British Medical Journal. 1999, 318: 1515-1520. 10.1136/bmj.318.7197.1515.CrossRefPubMedPubMedCentral Jarman B, Gault S, Alves B, Hider A, Dolan S, Cook A, et al: Explaining differences in English hospital death rates using routinely collected data. British Medical Journal. 1999, 318: 1515-1520. 10.1136/bmj.318.7197.1515.CrossRefPubMedPubMedCentral
8.
go back to reference Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. British Medical Journal. 2010, 340: 955-957. 10.1136/bmj.c955.CrossRef Lilford R, Pronovost P: Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. British Medical Journal. 2010, 340: 955-957. 10.1136/bmj.c955.CrossRef
9.
go back to reference Borzecki AM, Christiansen CL, Chew P, Loveland S, Rosen AK: Comparison of In-Hospital Versus 30-Day Mortality Assessments for Selected Medical Conditions. Medical Care. 2010, 48: 1117-1121. 10.1097/MLR.0b013e3181ef9d53.CrossRefPubMed Borzecki AM, Christiansen CL, Chew P, Loveland S, Rosen AK: Comparison of In-Hospital Versus 30-Day Mortality Assessments for Selected Medical Conditions. Medical Care. 2010, 48: 1117-1121. 10.1097/MLR.0b013e3181ef9d53.CrossRefPubMed
10.
go back to reference Rosenthal GE, Shah A, Way LE, Harper DL: Variations in standardized hospital mortality rates for six common medical diagnoses - Implications for profiling hospital quality. Medical Care. 1998, 36: 955-964. 10.1097/00005650-199807000-00003.CrossRefPubMed Rosenthal GE, Shah A, Way LE, Harper DL: Variations in standardized hospital mortality rates for six common medical diagnoses - Implications for profiling hospital quality. Medical Care. 1998, 36: 955-964. 10.1097/00005650-199807000-00003.CrossRefPubMed
11.
go back to reference Thomas JW, Hofer TP: Research evidence on the validity of risk-adjusted mortality rate as a measure of hospital quality of care. Medical Care Research and Review. 1998, 55: 371-404. 10.1177/107755879805500401.CrossRefPubMed Thomas JW, Hofer TP: Research evidence on the validity of risk-adjusted mortality rate as a measure of hospital quality of care. Medical Care Research and Review. 1998, 55: 371-404. 10.1177/107755879805500401.CrossRefPubMed
12.
go back to reference Slobbe LCJ, Arah OA, de Bruin A, Westert GP: Mortality in Dutch hospitals: Trends in time, place and cause of death after admission for myocardial infarction and stroke. An observational study. BMC Health Services Research. 2008, 8: 52-10.1186/1472-6963-8-52.CrossRefPubMedPubMedCentral Slobbe LCJ, Arah OA, de Bruin A, Westert GP: Mortality in Dutch hospitals: Trends in time, place and cause of death after admission for myocardial infarction and stroke. An observational study. BMC Health Services Research. 2008, 8: 52-10.1186/1472-6963-8-52.CrossRefPubMedPubMedCentral
13.
go back to reference Jollis JG, Romano PS: Sounding board - Pennsylvania’s Focus on Heart Attack - Grading the scorecard. N Engl J Med. 1998, 338: 983-987. 10.1056/NEJM199804023381410.CrossRefPubMed Jollis JG, Romano PS: Sounding board - Pennsylvania’s Focus on Heart Attack - Grading the scorecard. N Engl J Med. 1998, 338: 983-987. 10.1056/NEJM199804023381410.CrossRefPubMed
14.
go back to reference Iezzoni LI, Ash AS, Shwartz M, Landon BE, Mackiernan YD: Predicting in-hospital deaths from coronary artery bypass graft surgery - Do different severity measures give different predictions?. Medical Care. 1998, 36: 28-39. 10.1097/00005650-199801000-00005.CrossRefPubMed Iezzoni LI, Ash AS, Shwartz M, Landon BE, Mackiernan YD: Predicting in-hospital deaths from coronary artery bypass graft surgery - Do different severity measures give different predictions?. Medical Care. 1998, 36: 28-39. 10.1097/00005650-199801000-00005.CrossRefPubMed
15.
go back to reference Kosseim M, Mayo NE, Scott S, Hanley JA, Brophy J, Gagnon B, et al: Ranking hospitals according to acute myocardial infarction mortality - Should transfers be included?. Medical Care. 2006, 44: 664-670. 10.1097/01.mlr.0000215848.87202.c7.CrossRefPubMed Kosseim M, Mayo NE, Scott S, Hanley JA, Brophy J, Gagnon B, et al: Ranking hospitals according to acute myocardial infarction mortality - Should transfers be included?. Medical Care. 2006, 44: 664-670. 10.1097/01.mlr.0000215848.87202.c7.CrossRefPubMed
16.
go back to reference Drye EE, Normand SLT, Wang Y, Ross JS, Schreine GC, Han L, Rapp M, Krumholz HM: Comparison of Hospital Risk-Standardized Mortality Rates Calculated by Using In-Hospital and 30-Day Models: An Observational Study With Implications for Hospital Profiling. Ann Intern Med. 2012, 156: 19-26.CrossRefPubMedPubMedCentral Drye EE, Normand SLT, Wang Y, Ross JS, Schreine GC, Han L, Rapp M, Krumholz HM: Comparison of Hospital Risk-Standardized Mortality Rates Calculated by Using In-Hospital and 30-Day Models: An Observational Study With Implications for Hospital Profiling. Ann Intern Med. 2012, 156: 19-26.CrossRefPubMedPubMedCentral
17.
go back to reference Rosenthal GE, Baker DW, Norris DG, Way LE, Harper DL, Snow RJ: Relationships between in-hospital and 30-day standardized hospital mortality: Implications for profiling hospitals. Heal Serv Res. 2000, 34: 1449-1468. Rosenthal GE, Baker DW, Norris DG, Way LE, Harper DL, Snow RJ: Relationships between in-hospital and 30-day standardized hospital mortality: Implications for profiling hospitals. Heal Serv Res. 2000, 34: 1449-1468.
18.
go back to reference Johnson ML, Gordon HS, Petersen NJ, Wray NP, Shroyer AL, Grover FL, et al: Effect of definition of mortality on hospital profiles. Medical Care. 2002, 40: 7-16. 10.1097/00005650-200201000-00003.CrossRefPubMed Johnson ML, Gordon HS, Petersen NJ, Wray NP, Shroyer AL, Grover FL, et al: Effect of definition of mortality on hospital profiles. Medical Care. 2002, 40: 7-16. 10.1097/00005650-200201000-00003.CrossRefPubMed
19.
go back to reference Goldacre MJ, Roberts SE, Yeates D: Mortality after admission to hospital with fractured neck of femur: database study. British Medical Journal. 2002, 325: 868-869. 10.1136/bmj.325.7369.868.CrossRefPubMedPubMedCentral Goldacre MJ, Roberts SE, Yeates D: Mortality after admission to hospital with fractured neck of femur: database study. British Medical Journal. 2002, 325: 868-869. 10.1136/bmj.325.7369.868.CrossRefPubMedPubMedCentral
20.
go back to reference Westfall JM, Kiefe CI, Weissman NW, Goudie A, Centor RM, Williams OD, et al: Does interhospital transfer improve outcome of acute myocardial infarction? A propensity score analysis from the Cardiovascular Cooperative Project. BMC Cardiovasc Disord. 2008, 8: 22-10.1186/1471-2261-8-22.CrossRefPubMedPubMedCentral Westfall JM, Kiefe CI, Weissman NW, Goudie A, Centor RM, Williams OD, et al: Does interhospital transfer improve outcome of acute myocardial infarction? A propensity score analysis from the Cardiovascular Cooperative Project. BMC Cardiovasc Disord. 2008, 8: 22-10.1186/1471-2261-8-22.CrossRefPubMedPubMedCentral
23.
go back to reference Gonnella JS, Louis DZ, Mccord JJ: Staging Concept - Approach to Assessment of Outcome of Ambulatory Care. Medical Care. 1976, 14: 13-21. 10.1097/00005650-197601000-00002.CrossRefPubMed Gonnella JS, Louis DZ, Mccord JJ: Staging Concept - Approach to Assessment of Outcome of Ambulatory Care. Medical Care. 1976, 14: 13-21. 10.1097/00005650-197601000-00002.CrossRefPubMed
24.
go back to reference de Boor C: A Practical Guide to Splines. 2001, New York: Springer de Boor C: A Practical Guide to Splines. 2001, New York: Springer
25.
go back to reference Hosmer WD, Lemeshow S: Interpretation of the Fitted Logistic Regression Model. Applied Lostistic Regression. 2000, New York: John Wiley & Sons Inc, 2CrossRef Hosmer WD, Lemeshow S: Interpretation of the Fitted Logistic Regression Model. Applied Lostistic Regression. 2000, New York: John Wiley & Sons Inc, 2CrossRef
26.
go back to reference Goldacre MJ, Roberts SE, Griffith M: Place, time and certified cause of death in people who die after hospital admission for myocardial infarction or stroke. European Journal of Public Health. 2004, 14: 338-342. 10.1093/eurpub/14.4.338.CrossRefPubMed Goldacre MJ, Roberts SE, Griffith M: Place, time and certified cause of death in people who die after hospital admission for myocardial infarction or stroke. European Journal of Public Health. 2004, 14: 338-342. 10.1093/eurpub/14.4.338.CrossRefPubMed
27.
go back to reference Vidal EIO, Coeli CM, Pinheiro RS, Camargo KR: Mortality within 1 year after hip fracture surgical repair in the elderly according to postoperative period: a probabilistic record linkage study in Brazil. Osteoporos Int. 2006, 17: 1569-1576. 10.1007/s00198-006-0173-3.CrossRefPubMed Vidal EIO, Coeli CM, Pinheiro RS, Camargo KR: Mortality within 1 year after hip fracture surgical repair in the elderly according to postoperative period: a probabilistic record linkage study in Brazil. Osteoporos Int. 2006, 17: 1569-1576. 10.1007/s00198-006-0173-3.CrossRefPubMed
28.
go back to reference Nielsen KA, Jensen NC, Jensen CM, Thomsen M, Pedersen L, Johnsen SP, et al: Quality of care and 30 day mortality among patients with hip fractures: a nationwide cohort study. BMC Heal Serv Res. 2009, 9: 186-10.1186/1472-6963-9-186.CrossRef Nielsen KA, Jensen NC, Jensen CM, Thomsen M, Pedersen L, Johnsen SP, et al: Quality of care and 30 day mortality among patients with hip fractures: a nationwide cohort study. BMC Heal Serv Res. 2009, 9: 186-10.1186/1472-6963-9-186.CrossRef
29.
go back to reference Ingeman A, Pedersen L, Hundborg HH, Petersen P, Zielke S, Mainz J, et al: Quality of care and mortality among patients with stroke - A nationwide follow-up study. Medical Care. 2008, 46: 63-69. 10.1097/MLR.0b013e3181484b91.CrossRefPubMed Ingeman A, Pedersen L, Hundborg HH, Petersen P, Zielke S, Mainz J, et al: Quality of care and mortality among patients with stroke - A nationwide follow-up study. Medical Care. 2008, 46: 63-69. 10.1097/MLR.0b013e3181484b91.CrossRefPubMed
30.
go back to reference Iwashyna TJ, Kahn JM, Hayward RA, Nallamothu BK: Interhospital Transfers Among Medicare Beneficiaries Admitted for Acute Myocardial Infarction at Nonrevascularization Hospitals. Circulation-Cardiovascular Quality and Outcomes. 2010, 3: 468-475. 10.1161/CIRCOUTCOMES.110.957993.CrossRefPubMedPubMedCentral Iwashyna TJ, Kahn JM, Hayward RA, Nallamothu BK: Interhospital Transfers Among Medicare Beneficiaries Admitted for Acute Myocardial Infarction at Nonrevascularization Hospitals. Circulation-Cardiovascular Quality and Outcomes. 2010, 3: 468-475. 10.1161/CIRCOUTCOMES.110.957993.CrossRefPubMedPubMedCentral
31.
go back to reference Bosk EA, Veinot T, Iwashyna TJ: Which Patients and Where A Qualitative Study of Patient Transfers from Community Hospitals. Medical Care. 2011, 49: 592-598. 10.1097/MLR.0b013e31820fb71b.CrossRefPubMedPubMedCentral Bosk EA, Veinot T, Iwashyna TJ: Which Patients and Where A Qualitative Study of Patient Transfers from Community Hospitals. Medical Care. 2011, 49: 592-598. 10.1097/MLR.0b013e31820fb71b.CrossRefPubMedPubMedCentral
32.
go back to reference Zaslavsky AM: Statistical issues in reporting quality data: small samples and casemix variation. International Journal for Quality in Health Care. 2001, 13: 481-488. 10.1093/intqhc/13.6.481.CrossRefPubMed Zaslavsky AM: Statistical issues in reporting quality data: small samples and casemix variation. International Journal for Quality in Health Care. 2001, 13: 481-488. 10.1093/intqhc/13.6.481.CrossRefPubMed
Metadata
Title
Comparing hospital mortality – how to count does matter for patients hospitalized for acute myocardial infarction (AMI), stroke and hip fracture
Authors
Doris T Kristoffersen
Jon Helgeland
Jocelyne Clench-Aas
Petter Laake
Marit B Veierød
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2012
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-12-364

Other articles of this Issue 1/2012

BMC Health Services Research 1/2012 Go to the issue