Skip to main content
Top
Published in: BMC Health Services Research 1/2011

Open Access 01-12-2011 | Research article

Does adding risk-trends to survival models improve in-hospital mortality predictions? A cohort study

Authors: Jenna Wong, Monica Taljaard, Alan J Forster, Carl van Walraven

Published in: BMC Health Services Research | Issue 1/2011

Login to get access

Abstract

Background

Clinicians informally assess changes in patients' status over time to prognosticate their outcomes. The incorporation of trends in patient status into regression models could improve their ability to predict outcomes. In this study, we used a unique approach to measure trends in patient hospital death risk and determined whether the incorporation of these trend measures into a survival model improved the accuracy of its risk predictions.

Methods

We included all adult inpatient hospitalizations between 1 April 2004 and 31 March 2009 at our institution. We used the daily mortality risk scores from an existing time-dependent survival model to create five trend indicators: absolute and relative percent change in the risk score from the previous day; absolute and relative percent change in the risk score from the start of the trend; and number of days with a trend in the risk score. In the derivation set, we determined which trend indicators were associated with time to death in hospital, independent of the existing covariates. In the validation set, we compared the predictive performance of the existing model with and without the trend indicators.

Results

Three trend indicators were independently associated with time to hospital mortality: the absolute change in the risk score from the previous day; the absolute change in the risk score from the start of the trend; and the number of consecutive days with a trend in the risk score. However, adding these trend indicators to the existing model resulted in only small improvements in model discrimination and calibration.

Conclusions

We produced several indicators of trend in patient risk that were significantly associated with time to hospital death independent of the model used to create them. In other survival models, our approach of incorporating risk trends could be explored to improve their performance without the collection of additional data.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sadetsky N, Hubbard A, Carroll PR, Satariano W: Predictive value of serial measurements of quality of life on all-cause mortality in prostate cancer patients: data from CaPSURE (cancer of the prostate strategic urologic research endeavor) database. Qual Life Res. 2009, 18: 1019-1027. 10.1007/s11136-009-9526-7.CrossRefPubMedPubMedCentral Sadetsky N, Hubbard A, Carroll PR, Satariano W: Predictive value of serial measurements of quality of life on all-cause mortality in prostate cancer patients: data from CaPSURE (cancer of the prostate strategic urologic research endeavor) database. Qual Life Res. 2009, 18: 1019-1027. 10.1007/s11136-009-9526-7.CrossRefPubMedPubMedCentral
2.
go back to reference Sullivan PW, Nelson JB, Mulani PM, Sleep D: Quality of life as a potential predictor for morbidity and mortality in patients with metastatic hormone-refractory prostate cancer. Qual Life Res. 2006, 15: 1297-1306. 10.1007/s11136-006-0003-2.CrossRefPubMed Sullivan PW, Nelson JB, Mulani PM, Sleep D: Quality of life as a potential predictor for morbidity and mortality in patients with metastatic hormone-refractory prostate cancer. Qual Life Res. 2006, 15: 1297-1306. 10.1007/s11136-006-0003-2.CrossRefPubMed
3.
go back to reference Masson S, Latini R, Anand IS, Barlera S, Angelici L, Vago T, Tognoni G, Cohn JN: Prognostic value of changes in N-terminal pro-brain natriuretic peptide in Val-HeFT (Valsartan Heart Failure Trial). J Am Coll Cardiol. 2008, 52: 997-1003. 10.1016/j.jacc.2008.04.069.CrossRefPubMed Masson S, Latini R, Anand IS, Barlera S, Angelici L, Vago T, Tognoni G, Cohn JN: Prognostic value of changes in N-terminal pro-brain natriuretic peptide in Val-HeFT (Valsartan Heart Failure Trial). J Am Coll Cardiol. 2008, 52: 997-1003. 10.1016/j.jacc.2008.04.069.CrossRefPubMed
4.
go back to reference Florea VG, Henein MY, Anker SD, Francis DP, Chambers JS, Ponikowski P, Coats AJ: Prognostic value of changes over time in exercise capacity and echocardiographic measurements in patients with chronic heart failure. Eur Heart J. 2000, 21: 146-153. 10.1053/euhj.2000.1737.CrossRefPubMed Florea VG, Henein MY, Anker SD, Francis DP, Chambers JS, Ponikowski P, Coats AJ: Prognostic value of changes over time in exercise capacity and echocardiographic measurements in patients with chronic heart failure. Eur Heart J. 2000, 21: 146-153. 10.1053/euhj.2000.1737.CrossRefPubMed
5.
go back to reference Lassnigg A, Schmidlin D, Mouhieddine M, Bachmann LM, Druml W, Bauer P, Hiesmayr M: Minimal changes of serum creatinine predict prognosis in patients after cardiothoracic surgery: a prospective cohort study. J Am Soc Nephrol. 2004, 15: 1597-1605. 10.1097/01.ASN.0000130340.93930.DD.CrossRefPubMed Lassnigg A, Schmidlin D, Mouhieddine M, Bachmann LM, Druml W, Bauer P, Hiesmayr M: Minimal changes of serum creatinine predict prognosis in patients after cardiothoracic surgery: a prospective cohort study. J Am Soc Nephrol. 2004, 15: 1597-1605. 10.1097/01.ASN.0000130340.93930.DD.CrossRefPubMed
6.
go back to reference Wong J, Taljaard M, Forster AJ, Escobar GJ, van Walraven C: Derivation and validation of a model to predict daily risk of death in hospital. Medical Care. 2011. Wong J, Taljaard M, Forster AJ, Escobar GJ, van Walraven C: Derivation and validation of a model to predict daily risk of death in hospital. Medical Care. 2011.
7.
go back to reference Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008, 46: 232-239. 10.1097/MLR.0b013e3181589bb6.CrossRefPubMed Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P: Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008, 46: 232-239. 10.1097/MLR.0b013e3181589bb6.CrossRefPubMed
8.
go back to reference van Walraven C, Austin PC, Jennings A, Quan H, Forster AJ: A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med Care. 2009, 47: 626-633. 10.1097/MLR.0b013e31819432e5.CrossRefPubMed van Walraven C, Austin PC, Jennings A, Quan H, Forster AJ: A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data. Med Care. 2009, 47: 626-633. 10.1097/MLR.0b013e31819432e5.CrossRefPubMed
9.
go back to reference Sauerbrei W, Meier-Hirmer C, Benner A, Royston P: Multivariable regression model building by using fractional polynomials: Description of SAS, STATA and R programs. Computational Statistics & Data Analysis. 2006, 50: 3464-3485. 10.1016/j.csda.2005.07.015.CrossRef Sauerbrei W, Meier-Hirmer C, Benner A, Royston P: Multivariable regression model building by using fractional polynomials: Description of SAS, STATA and R programs. Computational Statistics & Data Analysis. 2006, 50: 3464-3485. 10.1016/j.csda.2005.07.015.CrossRef
10.
go back to reference Kremers WK: Concordance for Survival Time Data: Fixed and Time-dependent Covariates and Possible Ties in Predictor and Time. 2007, Mayo Foundation Kremers WK: Concordance for Survival Time Data: Fixed and Time-dependent Covariates and Possible Ties in Predictor and Time. 2007, Mayo Foundation
11.
go back to reference May S, Hosmer DW: A simplified method of calculating an overall goodness-of-fit test for the Cox proportional hazards model. Lifetime Data Anal. 1998, 4: 109-120. 10.1023/A:1009612305785.CrossRefPubMed May S, Hosmer DW: A simplified method of calculating an overall goodness-of-fit test for the Cox proportional hazards model. Lifetime Data Anal. 1998, 4: 109-120. 10.1023/A:1009612305785.CrossRefPubMed
12.
go back to reference Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS: Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008, 27: 157-172. 10.1002/sim.2929.CrossRefPubMed Pencina MJ, D'Agostino RB, D'Agostino RB, Vasan RS: Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008, 27: 157-172. 10.1002/sim.2929.CrossRefPubMed
13.
go back to reference Pencina MJ, D'Agostino RB, Steyerberg EW: Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011, 30: 11-21. 10.1002/sim.4085.CrossRefPubMed Pencina MJ, D'Agostino RB, Steyerberg EW: Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011, 30: 11-21. 10.1002/sim.4085.CrossRefPubMed
Metadata
Title
Does adding risk-trends to survival models improve in-hospital mortality predictions? A cohort study
Authors
Jenna Wong
Monica Taljaard
Alan J Forster
Carl van Walraven
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2011
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-171

Other articles of this Issue 1/2011

BMC Health Services Research 1/2011 Go to the issue