Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Procedure-based severity index for inpatients: development and validation using administrative database

Authors: Hayato Yamana, Hiroki Matsui, Kiyohide Fushimi, Hideo Yasunaga

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Risk adjustment is important in studies using administrative databases. Although utilization of diagnostic and therapeutic procedures can represent patient severity, the usability of procedure records in risk adjustment is not well-documented. Therefore, we aimed to develop and validate a severity index calculable from procedure records.

Methods

Using the Japanese nationwide Diagnosis Procedure Combination database of acute-care hospitals, we identified patients discharged between 1 April 2012 and 31 March 2013 with an admission-precipitating diagnosis of acute myocardial infarction, congestive heart failure, acute cerebrovascular disease, gastrointestinal hemorrhage, pneumonia, or septicemia. Subjects were randomly assigned to the derivation cohort or the validation cohort. In the derivation cohort, we used multivariable logistic regression analysis to identify procedures performed on admission day which were significantly associated with in-hospital death, and a point corresponding to regression coefficient was assigned to each procedure. An index was then calculated in the validation cohort as sum of points for performed procedures, and performance of mortality-predicting model using the index and other patient characteristics was evaluated.

Results

Of the 539 385 hospitalizations included, 270 054 and 269 331 were assigned to the derivation and validation cohorts, respectively. Nineteen significant procedures were identified from the derivation cohort with points ranging from −3 to 23, producing a severity index with possible range of −13 to 69. In the validation cohort, c-statistic of mortality-predicting model was 0.767 (95 % confidence interval: 0.764–0.770). The ω-statistic representing contribution of the index relative to other variables was 1.09 (95 % confidence interval: 1.03–1.17).

Conclusions

Procedure-based severity index predicted mortality well, suggesting that procedure records in administrative database are useful for risk adjustment.
Appendix
Available only for authorised users
Literature
3.
go back to reference Lee TH, Meyer GS, Brennan TA. A middle ground on public accountability. N Engl J Med. 2004;350:2409–12.CrossRefPubMed Lee TH, Meyer GS, Brennan TA. A middle ground on public accountability. N Engl J Med. 2004;350:2409–12.CrossRefPubMed
4.
go back to reference Bufalino V, Peterson ED, Burke GL, LaBresh KA, Jones DW, Faxon DP, et al. Payment for quality: guiding principles and recommendations: principles and recommendations from the American Heart Association’s Reimbursement, Coverage, and Access Policy Development Workgroup. Circulation. 2006;113:1151–4.CrossRefPubMed Bufalino V, Peterson ED, Burke GL, LaBresh KA, Jones DW, Faxon DP, et al. Payment for quality: guiding principles and recommendations: principles and recommendations from the American Heart Association’s Reimbursement, Coverage, and Access Policy Development Workgroup. Circulation. 2006;113:1151–4.CrossRefPubMed
5.
go back to reference Jollis JG, Ancukiewicz M, DeLong ER, Pryor DB, Muhlbaier LH, Mark DB. Discordance of databases designed for claims payment versus clinical information systems. Implications for outcomes research. Ann Intern Med. 1993;119:844–50.CrossRefPubMed Jollis JG, Ancukiewicz M, DeLong ER, Pryor DB, Muhlbaier LH, Mark DB. Discordance of databases designed for claims payment versus clinical information systems. Implications for outcomes research. Ann Intern Med. 1993;119:844–50.CrossRefPubMed
6.
go back to reference Hannan EL, Kilburn Jr H, Lindsey ML, Lewis R. Clinical versus administrative data bases for CABG surgery. Does it matter? Med Care. 1992;30:892–907.CrossRefPubMed Hannan EL, Kilburn Jr H, Lindsey ML, Lewis R. Clinical versus administrative data bases for CABG surgery. Does it matter? Med Care. 1992;30:892–907.CrossRefPubMed
7.
go back to reference Hannan EL, Racz MJ, Jollis JG, Peterson ED. Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? Health Serv Res. 1997;31:659–78.PubMedPubMedCentral Hannan EL, Racz MJ, Jollis JG, Peterson ED. Using Medicare claims data to assess provider quality for CABG surgery: does it work well enough? Health Serv Res. 1997;31:659–78.PubMedPubMedCentral
8.
go back to reference Pine M, Norusis M, Jones B, Rosenthal GE. Predictions of hospital mortality rates: a comparison of data sources. Ann Intern Med. 1997;126:347–54.CrossRefPubMed Pine M, Norusis M, Jones B, Rosenthal GE. Predictions of hospital mortality rates: a comparison of data sources. Ann Intern Med. 1997;126:347–54.CrossRefPubMed
9.
go back to reference Southern DA, Quan H, Ghali WA. Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data. Med Care. 2004;42:355–60.CrossRefPubMed Southern DA, Quan H, Ghali WA. Comparison of the Elixhauser and Charlson/Deyo methods of comorbidity measurement in administrative data. Med Care. 2004;42:355–60.CrossRefPubMed
10.
11.
go back to reference Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613–9.CrossRefPubMed Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613–9.CrossRefPubMed
12.
go back to reference Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, et al. Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007;297:71–6.CrossRefPubMed Pine M, Jordan HS, Elixhauser A, Fry DE, Hoaglin DC, Jones B, et al. Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007;297:71–6.CrossRefPubMed
13.
go back to reference Tabak YP, Johannes RS, Silber JH. Using automated clinical data for risk adjustment: development and validation of six disease-specific mortality predictive models for pay-for-performance. Med Care. 2007;45:789–805.CrossRefPubMed Tabak YP, Johannes RS, Silber JH. Using automated clinical data for risk adjustment: development and validation of six disease-specific mortality predictive models for pay-for-performance. Med Care. 2007;45:789–805.CrossRefPubMed
14.
go back to reference Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P. Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008;46:232–9.CrossRefPubMed Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P. Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008;46:232–9.CrossRefPubMed
15.
go back to reference Tabak YP, Sun X, Nunez CM, Johannes RS. Using electronic health record data to develop inpatient mortality predictive model: Acute Laboratory Risk of Mortality Score (ALaRMS). J Am Med Inform Assoc. 2014;21:455–63.CrossRefPubMed Tabak YP, Sun X, Nunez CM, Johannes RS. Using electronic health record data to develop inpatient mortality predictive model: Acute Laboratory Risk of Mortality Score (ALaRMS). J Am Med Inform Assoc. 2014;21:455–63.CrossRefPubMed
16.
go back to reference Tabak YP, Sun X, Johannes RS, Hyde L, Shorr AF, Lindenauer PK. Development and validation of a mortality risk-adjustment model for patients hospitalized for exacerbations of chronic obstructive pulmonary disease. Med Care. 2013;51:597–605.CrossRefPubMed Tabak YP, Sun X, Johannes RS, Hyde L, Shorr AF, Lindenauer PK. Development and validation of a mortality risk-adjustment model for patients hospitalized for exacerbations of chronic obstructive pulmonary disease. Med Care. 2013;51:597–605.CrossRefPubMed
17.
go back to reference Lagu T, Lindenauer PK, Rothberg MB, Nathanson BH, Pekow PS, Steingrub JS, et al. Development and validation of a model that uses enhanced administrative data to predict mortality in patients with sepsis. Crit Care Med. 2011;39:2425–30.CrossRefPubMed Lagu T, Lindenauer PK, Rothberg MB, Nathanson BH, Pekow PS, Steingrub JS, et al. Development and validation of a model that uses enhanced administrative data to predict mortality in patients with sepsis. Crit Care Med. 2011;39:2425–30.CrossRefPubMed
18.
go back to reference Lee J, Morishima T, Kunisawa S, Sasaki N, Otsubo T, Ikai H, et al. Derivation and validation of in-hospital mortality prediction models in ischaemic stroke patients using administrative data. Cerebrovasc Dis. 2013;35:73–80.CrossRefPubMed Lee J, Morishima T, Kunisawa S, Sasaki N, Otsubo T, Ikai H, et al. Derivation and validation of in-hospital mortality prediction models in ischaemic stroke patients using administrative data. Cerebrovasc Dis. 2013;35:73–80.CrossRefPubMed
19.
go back to reference Rothberg MB, Pekow PS, Priya A, Zilberberg MD, Belforti R, Skiest D, et al. Using highly detailed administrative data to predict pneumonia mortality. PLoS ONE. 2014;9, e87382.CrossRefPubMedPubMedCentral Rothberg MB, Pekow PS, Priya A, Zilberberg MD, Belforti R, Skiest D, et al. Using highly detailed administrative data to predict pneumonia mortality. PLoS ONE. 2014;9, e87382.CrossRefPubMedPubMedCentral
20.
go back to reference van Walraven C, Wong J, Bennet C, Forster AJ. The Procedural Index for Mortality Risk (PIMR): an index calculated using administrative data to quantify the independent influence of procedures on risk of hospital death. BMC Health Serv Res. 2011;11:258.CrossRefPubMedPubMedCentral van Walraven C, Wong J, Bennet C, Forster AJ. The Procedural Index for Mortality Risk (PIMR): an index calculated using administrative data to quantify the independent influence of procedures on risk of hospital death. BMC Health Serv Res. 2011;11:258.CrossRefPubMedPubMedCentral
21.
go back to reference Hashimoto H, Ikegami N, Shibuya K, Izumida N, Noguchi H, Yasunaga H, et al. Cost containment and quality of care in Japan: is there a trade-off? Lancet. 2011;378:1174–82.CrossRefPubMed Hashimoto H, Ikegami N, Shibuya K, Izumida N, Noguchi H, Yasunaga H, et al. Cost containment and quality of care in Japan: is there a trade-off? Lancet. 2011;378:1174–82.CrossRefPubMed
23.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J-C, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi J-C, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed
24.
go back to reference Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82.CrossRefPubMed Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–82.CrossRefPubMed
25.
go back to reference Sullivan LM, Massaro JM, D’Agostino Sr RB. Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med. 2004;23:1631–60.CrossRefPubMed Sullivan LM, Massaro JM, D’Agostino Sr RB. Presentation of multivariate data for clinical use: the Framingham Study risk score functions. Stat Med. 2004;23:1631–60.CrossRefPubMed
26.
go back to reference Pencina MJ, D’Agostino Sr RB, D’Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.CrossRefPubMed Pencina MJ, D’Agostino Sr RB, D’Agostino Jr RB, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27:157–72.CrossRefPubMed
27.
go back to reference Silber JH, Rosenbaum PR, Ross RN. Comparing the contributions of groups of predictors: which outcomes vary with hospital rather than patient characteristics. J Am Stat Assoc. 1995;90:7–18. Silber JH, Rosenbaum PR, Ross RN. Comparing the contributions of groups of predictors: which outcomes vary with hospital rather than patient characteristics. J Am Stat Assoc. 1995;90:7–18.
28.
go back to reference Glance LG, Osler TM, Mukamel DB, Dick AW. Impact of the present-on-admission indicator on hospital quality measurement: experience with the Agency for Healthcare Research and Quality (AHRQ) Inpatient Quality Indicators. Med Care. 2008;46:112–9.CrossRefPubMed Glance LG, Osler TM, Mukamel DB, Dick AW. Impact of the present-on-admission indicator on hospital quality measurement: experience with the Agency for Healthcare Research and Quality (AHRQ) Inpatient Quality Indicators. Med Care. 2008;46:112–9.CrossRefPubMed
29.
30.
go back to reference Miyaji T, Sha M, Hirose M. Nationwide study of ventilator management and maintenance in Japan. Jpn J Respir Care. 2006;23:92–7 [in Japanese]. Miyaji T, Sha M, Hirose M. Nationwide study of ventilator management and maintenance in Japan. Jpn J Respir Care. 2006;23:92–7 [in Japanese].
31.
go back to reference Takinami M, Uchino S, Kase Y, Iwai K, Saito K, Iwaya R, et al. Current management for clinically ill patients with mechanical ventilation on the ward. J Jpn Soc Intensive Care Med. 2011;18:417–8 [in Japanese].CrossRef Takinami M, Uchino S, Kase Y, Iwai K, Saito K, Iwaya R, et al. Current management for clinically ill patients with mechanical ventilation on the ward. J Jpn Soc Intensive Care Med. 2011;18:417–8 [in Japanese].CrossRef
Metadata
Title
Procedure-based severity index for inpatients: development and validation using administrative database
Authors
Hayato Yamana
Hiroki Matsui
Kiyohide Fushimi
Hideo Yasunaga
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0889-x

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue