Skip to main content
Top
Published in: BMC Health Services Research 1/2008

Open Access 01-12-2008 | Research article

Performance of in-hospital mortality prediction models for acute hospitalization: Hospital Standardized Mortality Ratio in Japan

Authors: Hiroaki Miyata, Hideki Hashimoto, Hiromasa Horiguchi, Shinya Matsuda, Noboru Motomura, Shinichi Takamoto

Published in: BMC Health Services Research | Issue 1/2008

Login to get access

Abstract

Objective

In-hospital mortality is an important performance measure for quality improvement, although it requires proper risk adjustment. We set out to develop in-hospital mortality prediction models for acute hospitalization using a nation-wide electronic administrative record system in Japan.

Methods

Administrative records of 224,207 patients (patients discharged from 82 hospitals in Japan between July 1, 2002 and October 31, 2002) were randomly split into preliminary (179,156 records) and test (45,051 records) groups. Study variables included Major Diagnostic Category, age, gender, ambulance use, admission status, length of hospital stay, comorbidity, and in-hospital mortality. ICD-10 codes were converted to calculate comorbidity scores based on Quan's methodology. Multivariate logistic regression analysis was then performed using in-hospital mortality as a dependent variable. C-indexes were calculated across risk groups in order to evaluate model performances.

Results

In-hospital mortality rates were 2.68% and 2.76% for the preliminary and test datasets, respectively. C-index values were 0.869 for the model that excluded length of stay and 0.841 for the model that included length of stay.

Conclusion

Risk models developed in this study included a set of variables easily accessible from administrative data, and still successfully exhibited a high degree of prediction accuracy. These models can be used to estimate in-hospital mortality rates of various diagnoses and procedures.
Appendix
Available only for authorised users
Literature
1.
go back to reference Jencks SF, Huff ED, Cuerdon T: Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003, 289: 305-12. 10.1001/jama.289.3.305.CrossRefPubMed Jencks SF, Huff ED, Cuerdon T: Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003, 289: 305-12. 10.1001/jama.289.3.305.CrossRefPubMed
2.
go back to reference McGlynn EA, Asch SM, Adams J, et al: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-45. 10.1056/NEJMsa022615.CrossRefPubMed McGlynn EA, Asch SM, Adams J, et al: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-45. 10.1056/NEJMsa022615.CrossRefPubMed
3.
go back to reference Institute of Medicine: Crossing the quality chasm: a new health system for the 21st century. 2001, Washington, D.C.: National Academies Press Institute of Medicine: Crossing the quality chasm: a new health system for the 21st century. 2001, Washington, D.C.: National Academies Press
4.
go back to reference Galvin R, Milstein A: Large employers' new strategies in health care. N Engl J Med. 2002, 347: 939-42. 10.1056/NEJMsb012850.CrossRefPubMed Galvin R, Milstein A: Large employers' new strategies in health care. N Engl J Med. 2002, 347: 939-42. 10.1056/NEJMsb012850.CrossRefPubMed
5.
go back to reference Donabedian A: Explorations in Quality Assessment and Monitoring. The Definition of Quality and Approaches to Its Assessment. Ann Arbor. 1980, MI: Health Administration Press, 1. Donabedian A: Explorations in Quality Assessment and Monitoring. The Definition of Quality and Approaches to Its Assessment. Ann Arbor. 1980, MI: Health Administration Press, 1.
6.
go back to reference Iezzoni LI: Risk adjustment for measuring health care outcomes. 2003, Chicago, IL: Health Administration Press Iezzoni LI: Risk adjustment for measuring health care outcomes. 2003, Chicago, IL: Health Administration Press
7.
go back to reference Bradley EH, Herrin J, Elbel B, et al: Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality. JAMA. 2006, 296 (1): 72-78. 10.1001/jama.296.1.72.CrossRefPubMed Bradley EH, Herrin J, Elbel B, et al: Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality. JAMA. 2006, 296 (1): 72-78. 10.1001/jama.296.1.72.CrossRefPubMed
8.
go back to reference Krumholz HM, Wang Y, Mattera JA, et al: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006, 113 (13): 1683-1692. 10.1161/CIRCULATIONAHA.105.611186.CrossRefPubMed Krumholz HM, Wang Y, Mattera JA, et al: An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation. 2006, 113 (13): 1683-1692. 10.1161/CIRCULATIONAHA.105.611186.CrossRefPubMed
9.
go back to reference Motomura N, Miyata H, Tsukihara H, Takamoto S: Risk Model of Thoracic Aortic Surgery in 4707 Cases from a Nationwide Single-race Population, via a Web-based Data Entry System: The First Report of 30-day and 30-dayOperative Outcome Risk Models for Thoracic Aortic Surgery. Circulation. 2008, 118: S153-S159. 10.1161/CIRCULATIONAHA.107.756684.CrossRefPubMed Motomura N, Miyata H, Tsukihara H, Takamoto S: Risk Model of Thoracic Aortic Surgery in 4707 Cases from a Nationwide Single-race Population, via a Web-based Data Entry System: The First Report of 30-day and 30-dayOperative Outcome Risk Models for Thoracic Aortic Surgery. Circulation. 2008, 118: S153-S159. 10.1161/CIRCULATIONAHA.107.756684.CrossRefPubMed
10.
go back to reference Miyata H, Motomura N, Ueda U, Mastuda H, Takamoto S: Effect of procedural volume on outcome of CABG surgery in Japan: Implication toward minimal volume standards and public reporting. Journal of Thoracic and Cardiovascular Surgery. 2008, 135: 1306-12. 10.1016/j.jtcvs.2007.10.079.CrossRefPubMed Miyata H, Motomura N, Ueda U, Mastuda H, Takamoto S: Effect of procedural volume on outcome of CABG surgery in Japan: Implication toward minimal volume standards and public reporting. Journal of Thoracic and Cardiovascular Surgery. 2008, 135: 1306-12. 10.1016/j.jtcvs.2007.10.079.CrossRefPubMed
11.
go back to reference Rosen Ak, Loveland S, Anderson JJ, Rothendler JA, Hankin CS, Rakavski CC, Moskowitz MA, Berlowitsz DR: Evaluating diagnosis-based case-mix measures: how well do they apply to the VA population?. Medical Care. 2001, 39 (7): 692-704. 10.1097/00005650-200107000-00006.CrossRefPubMed Rosen Ak, Loveland S, Anderson JJ, Rothendler JA, Hankin CS, Rakavski CC, Moskowitz MA, Berlowitsz DR: Evaluating diagnosis-based case-mix measures: how well do they apply to the VA population?. Medical Care. 2001, 39 (7): 692-704. 10.1097/00005650-200107000-00006.CrossRefPubMed
12.
go back to reference Starfield B, Weiner J, Mumford L, et al: Ambulatory Care Groups: a categorization of diagnoses for research and management. Health Serv Res. 1991, 26: 53-74.PubMedPubMedCentral Starfield B, Weiner J, Mumford L, et al: Ambulatory Care Groups: a categorization of diagnoses for research and management. Health Serv Res. 1991, 26: 53-74.PubMedPubMedCentral
13.
go back to reference Ellis RP, Ash A: Refinements to the diagnostic cost group (DCG) model. Inquiry. 1995, 32: 418-429.PubMed Ellis RP, Ash A: Refinements to the diagnostic cost group (DCG) model. Inquiry. 1995, 32: 418-429.PubMed
14.
go back to reference Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, Rosetti MCO: Risk adjustment using automated ambulatory pharmacy data: The RxRisk Model. Medical Care. 2003, 41 (1): 84-99. 10.1097/00005650-200301000-00011.CrossRefPubMed Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, Rosetti MCO: Risk adjustment using automated ambulatory pharmacy data: The RxRisk Model. Medical Care. 2003, 41 (1): 84-99. 10.1097/00005650-200301000-00011.CrossRefPubMed
15.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Medica Care. 2005, 43: 1130-39. 10.1097/01.mlr.0000182534.19832.83.CrossRef Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Medica Care. 2005, 43: 1130-39. 10.1097/01.mlr.0000182534.19832.83.CrossRef
16.
go back to reference Charlson ME, Pompei P, Ales KL, et al: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, et al: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
17.
go back to reference Sundararajan V, Quan H, Halfon P, Fushimi K, Luthi JC, Burnand B, Ghali W: Cross-national comparative performance of three versions of the ICD-10 Charlson Index. Med Care. 2007, 45: 1210-1215.CrossRefPubMed Sundararajan V, Quan H, Halfon P, Fushimi K, Luthi JC, Burnand B, Ghali W: Cross-national comparative performance of three versions of the ICD-10 Charlson Index. Med Care. 2007, 45: 1210-1215.CrossRefPubMed
18.
go back to reference Matsuda S, Fushimi K, Hashimoto H, Kuwabara K, Imanaka Y, Horiguchi H, Ishikawa KB, Anan M, Ueda K: The Japanese Case-Mix Project: Diagnosis Procedure Combination (DPC). Proceedings of the 19th International Case Mix Conference PCS/E; 8–11 October 2003; Washington, DC. 2003, 121-124. Matsuda S, Fushimi K, Hashimoto H, Kuwabara K, Imanaka Y, Horiguchi H, Ishikawa KB, Anan M, Ueda K: The Japanese Case-Mix Project: Diagnosis Procedure Combination (DPC). Proceedings of the 19th International Case Mix Conference PCS/E; 8–11 October 2003; Washington, DC. 2003, 121-124.
19.
go back to reference Okamura S, Kobayashi R, Sakamaki T: Case-mix payment in Japanese medical care. Health Policy. 2005, 74: 282-286. 10.1016/j.healthpol.2005.01.009.CrossRefPubMed Okamura S, Kobayashi R, Sakamaki T: Case-mix payment in Japanese medical care. Health Policy. 2005, 74: 282-286. 10.1016/j.healthpol.2005.01.009.CrossRefPubMed
20.
go back to reference Fushimi K, Hashimoto H, Imanaka Y, Kuwabara K, Horiguchi H, Ishikawa KB, Matsuda S: Functional mapping of hospitals by diagnosis-dominant case-mix analysis. BMC Health Serv Res. 7: 5013-2007 Apr 10; Fushimi K, Hashimoto H, Imanaka Y, Kuwabara K, Horiguchi H, Ishikawa KB, Matsuda S: Functional mapping of hospitals by diagnosis-dominant case-mix analysis. BMC Health Serv Res. 7: 5013-2007 Apr 10;
21.
go back to reference Canadian Institute for Health Information: HSMR: A New Approach for Measuring Hospital Mortality Trends in Canada. 2007, Ottawa: CIHI Canadian Institute for Health Information: HSMR: A New Approach for Measuring Hospital Mortality Trends in Canada. 2007, Ottawa: CIHI
22.
go back to reference Heijink R, Koolman X, Pieter D, Veen A, Jarman B, Westert G: Measuring and explaining mortality in Dutch hospitals; The hospital standardized mortality rate between 2003 and 2005. BMC Health Services Research. 2008, 8: 73-10.1186/1472-6963-8-73.CrossRefPubMedPubMedCentral Heijink R, Koolman X, Pieter D, Veen A, Jarman B, Westert G: Measuring and explaining mortality in Dutch hospitals; The hospital standardized mortality rate between 2003 and 2005. BMC Health Services Research. 2008, 8: 73-10.1186/1472-6963-8-73.CrossRefPubMedPubMedCentral
23.
go back to reference Anderson HV, Shaw ES, Brindis RG, McKay CR, Klein LW, Krone RJ, Ho KKL, Rumsfeld JS, Smith SC, Weintraub WS: Risk-adjusted mortality analysis of percutaneous coronary interventions by American College of Cardiology/American Heart Association guidelines recommendations. Am J Cardiol. 2007, 99: 189-196. 10.1016/j.amjcard.2006.07.083.CrossRefPubMed Anderson HV, Shaw ES, Brindis RG, McKay CR, Klein LW, Krone RJ, Ho KKL, Rumsfeld JS, Smith SC, Weintraub WS: Risk-adjusted mortality analysis of percutaneous coronary interventions by American College of Cardiology/American Heart Association guidelines recommendations. Am J Cardiol. 2007, 99: 189-196. 10.1016/j.amjcard.2006.07.083.CrossRefPubMed
24.
go back to reference Shroyer AL, Coombs LP, Peterson ED, et al: The Society of Thoracic Surgeons: 30-day operative mortality and morbidity risk models. Ann Thorac Surg. 2003, 75 (6): 1856-1864. 10.1016/S0003-4975(03)00179-6.CrossRefPubMed Shroyer AL, Coombs LP, Peterson ED, et al: The Society of Thoracic Surgeons: 30-day operative mortality and morbidity risk models. Ann Thorac Surg. 2003, 75 (6): 1856-1864. 10.1016/S0003-4975(03)00179-6.CrossRefPubMed
25.
go back to reference Ash A, Schwartz M: Evaluating the performance of risk-adjustment methods: dichotomous variables. Risk adjustment for measureing health care outcomes. Ann Arbor. Edited by: Iezzoni L. 1994, MI: Health Administration Press, 313-46. Ash A, Schwartz M: Evaluating the performance of risk-adjustment methods: dichotomous variables. Risk adjustment for measureing health care outcomes. Ann Arbor. Edited by: Iezzoni L. 1994, MI: Health Administration Press, 313-46.
26.
27.
go back to reference Jarman B, Gault S, Alves B, Hider A, Dolan S, Cook A, Hurwitz B, Iezzoni L: Explanining differences in English hospital death rates using routinely collected data. BMJ. 1999, 318: 1515-20.CrossRefPubMedPubMedCentral Jarman B, Gault S, Alves B, Hider A, Dolan S, Cook A, Hurwitz B, Iezzoni L: Explanining differences in English hospital death rates using routinely collected data. BMJ. 1999, 318: 1515-20.CrossRefPubMedPubMedCentral
28.
go back to reference Lakhani A, Coles J, Eayres D, Spence C, Rachet B: Creative use of existing clinical and health outcomes data to assess NHS performance in England: Part1 – performance indicators closely linked to clinical care. BMJ. 2005, 330: 1426-1431. 10.1136/bmj.330.7505.1426.CrossRefPubMedPubMedCentral Lakhani A, Coles J, Eayres D, Spence C, Rachet B: Creative use of existing clinical and health outcomes data to assess NHS performance in England: Part1 – performance indicators closely linked to clinical care. BMJ. 2005, 330: 1426-1431. 10.1136/bmj.330.7505.1426.CrossRefPubMedPubMedCentral
29.
go back to reference Aylin P, Bottle A, Majeed A: Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models. BMJ. 2007, 334: 1044-10.1136/bmj.39168.496366.55.CrossRefPubMedPubMedCentral Aylin P, Bottle A, Majeed A: Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models. BMJ. 2007, 334: 1044-10.1136/bmj.39168.496366.55.CrossRefPubMedPubMedCentral
30.
go back to reference Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and loboratory databases. Medical Care. 2008, 46: 232-39.CrossRefPubMed Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and loboratory databases. Medical Care. 2008, 46: 232-39.CrossRefPubMed
31.
go back to reference Tabak YP, Johannes RS, Silber JH: Using automated clinical data for risk adjustment: Development and validation of six disease-specific mortality predictive models for pay-for-performance. Medical Care. 2008, 45: 789-805. 10.1097/MLR.0b013e31803d3b41.CrossRef Tabak YP, Johannes RS, Silber JH: Using automated clinical data for risk adjustment: Development and validation of six disease-specific mortality predictive models for pay-for-performance. Medical Care. 2008, 45: 789-805. 10.1097/MLR.0b013e31803d3b41.CrossRef
Metadata
Title
Performance of in-hospital mortality prediction models for acute hospitalization: Hospital Standardized Mortality Ratio in Japan
Authors
Hiroaki Miyata
Hideki Hashimoto
Hiromasa Horiguchi
Shinya Matsuda
Noboru Motomura
Shinichi Takamoto
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2008
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-8-229

Other articles of this Issue 1/2008

BMC Health Services Research 1/2008 Go to the issue