Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Predicting the cumulative risk of death during hospitalization by modeling weekend, weekday and diurnal mortality risks

Authors: Enrico Coiera, Ying Wang, Farah Magrabi, Oscar Perez Concha, Blanca Gallego, William Runciman

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Current prognostic models factor in patient and disease specific variables but do not consider cumulative risks of hospitalization over time. We developed risk models of the likelihood of death associated with cumulative exposure to hospitalization, based on time-varying risks of hospitalization over any given day, as well as day of the week. Model performance was evaluated alone, and in combination with simple disease-specific models.

Method

Patients admitted between 2000 and 2006 from 501 public and private hospitals in NSW, Australia were used for training and 2007 data for evaluation. The impact of hospital care delivered over different days of the week and or times of the day was modeled by separating hospitalization risk into 21 separate time periods (morning, day, night across the days of the week). Three models were developed to predict death up to 7-days post-discharge: 1/a simple background risk model using age, gender; 2/a time-varying risk model for exposure to hospitalization (admission time, days in hospital); 3/disease specific models (Charlson co-morbidity index, DRG). Combining these three generated a full model. Models were evaluated by accuracy, AUC, Akaike and Bayesian information criteria.

Results

There was a clear diurnal rhythm to hospital mortality in the data set, peaking in the evening, as well as the well-known ‘weekend-effect’ where mortality peaks with weekend admissions. Individual models had modest performance on the test data set (AUC 0.71, 0.79 and 0.79 respectively). The combined model which included time-varying risk however yielded an average AUC of 0.92. This model performed best for stays up to 7-days (93% of admissions), peaking at days 3 to 5 (AUC 0.94).

Conclusions

Risks of hospitalization vary not just with the day of the week but also time of the day, and can be used to make predictions about the cumulative risk of death associated with an individual’s hospitalization. Combining disease specific models with such time varying- estimates appears to result in robust predictive performance. Such risk exposure models should find utility both in enhancing standard prognostic models as well as estimating the risk of continuation of hospitalization.
Appendix
Available only for authorised users
Literature
1.
go back to reference Altman DG, Vergouwe Y, Royston P, Moons KG: Prognosis and prognostic research: validating a prognostic model. Bmj. 2009, 338: b605-10.1136/bmj.b605.CrossRefPubMed Altman DG, Vergouwe Y, Royston P, Moons KG: Prognosis and prognostic research: validating a prognostic model. Bmj. 2009, 338: b605-10.1136/bmj.b605.CrossRefPubMed
2.
go back to reference Donze J, Aujesky D, Williams D, Schnipper JL: Potentially Avoidable 30-Day Hospital Readmissions in Medical Patients Derivation and Validation of a Prediction Model. Jama Intern Med. 2013, 173 (8): 632-638. 10.1001/jamainternmed.2013.3023.CrossRefPubMed Donze J, Aujesky D, Williams D, Schnipper JL: Potentially Avoidable 30-Day Hospital Readmissions in Medical Patients Derivation and Validation of a Prediction Model. Jama Intern Med. 2013, 173 (8): 632-638. 10.1001/jamainternmed.2013.3023.CrossRefPubMed
3.
go back to reference Toll DB, Janssen KJM, Vergouwe Y, Moons KGM: Validation, updating and impact of clinical prediction rules: A review. J Clin Epidemiol. 2008, 61 (11): 1085-1094. 10.1016/j.jclinepi.2008.04.008.CrossRefPubMed Toll DB, Janssen KJM, Vergouwe Y, Moons KGM: Validation, updating and impact of clinical prediction rules: A review. J Clin Epidemiol. 2008, 61 (11): 1085-1094. 10.1016/j.jclinepi.2008.04.008.CrossRefPubMed
4.
go back to reference Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ: Temporal Trends in Rates of Patient Harm Resulting from Medical Care. New Engl J Med. 2010, 363 (22): 2124-2134. 10.1056/NEJMsa1004404.CrossRefPubMed Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ: Temporal Trends in Rates of Patient Harm Resulting from Medical Care. New Engl J Med. 2010, 363 (22): 2124-2134. 10.1056/NEJMsa1004404.CrossRefPubMed
5.
go back to reference Saposnik G, Baibergenova A, Bayer NH, Hachinski V: Weekends: A dangerous time for having a stroke?. Neurology. 2007, 68 (12): A228-A. Saposnik G, Baibergenova A, Bayer NH, Hachinski V: Weekends: A dangerous time for having a stroke?. Neurology. 2007, 68 (12): A228-A.
6.
go back to reference Kostis WJ, Demissie K, Marcella SW, Shao YH, Wilson AC, Moreyra AE: Weekend versus weekday admission and mortality from myocardial infarction. New Engl J Med. 2007, 356 (11): 1099-1109. 10.1056/NEJMoa063355.CrossRefPubMed Kostis WJ, Demissie K, Marcella SW, Shao YH, Wilson AC, Moreyra AE: Weekend versus weekday admission and mortality from myocardial infarction. New Engl J Med. 2007, 356 (11): 1099-1109. 10.1056/NEJMoa063355.CrossRefPubMed
7.
go back to reference Hauck K, Zhao XY, Jackson T: Adverse event rates as measures of hospital performance. Health Policy. 2012, 104 (2): 146-154. 10.1016/j.healthpol.2011.06.010.CrossRefPubMed Hauck K, Zhao XY, Jackson T: Adverse event rates as measures of hospital performance. Health Policy. 2012, 104 (2): 146-154. 10.1016/j.healthpol.2011.06.010.CrossRefPubMed
8.
go back to reference Cram P, Hillis SL, Barnett M, Rosenthal GE: Effects of weekend admission and hospital teaching status on in-hospital mortality. Am J Med. 2004, 117 (3): 151-157. 10.1016/j.amjmed.2004.02.035.CrossRefPubMed Cram P, Hillis SL, Barnett M, Rosenthal GE: Effects of weekend admission and hospital teaching status on in-hospital mortality. Am J Med. 2004, 117 (3): 151-157. 10.1016/j.amjmed.2004.02.035.CrossRefPubMed
9.
go back to reference Campbell MJ, Jacques RM, Fotheringham J, Maheswaran R, Nicholl J: Developing a summary hospital mortality index: retrospective analysis in English hospitals over five years. Bmj. 2012, 344: e1001-10.1136/bmj.e1001.CrossRefPubMedPubMedCentral Campbell MJ, Jacques RM, Fotheringham J, Maheswaran R, Nicholl J: Developing a summary hospital mortality index: retrospective analysis in English hospitals over five years. Bmj. 2012, 344: e1001-10.1136/bmj.e1001.CrossRefPubMedPubMedCentral
10.
go back to reference Freemantle N, Richardson M, Wood J, Ray D, Khosla S, Shahian D, Roche WR, Stephens I, Keogh B, Pagano D: Weekend hospitalization and additional risk of death: An analysis of inpatient data. J Roy Soc Med. 2012, 105 (2): 74-84. 10.1258/jrsm.2012.120009.CrossRefPubMedPubMedCentral Freemantle N, Richardson M, Wood J, Ray D, Khosla S, Shahian D, Roche WR, Stephens I, Keogh B, Pagano D: Weekend hospitalization and additional risk of death: An analysis of inpatient data. J Roy Soc Med. 2012, 105 (2): 74-84. 10.1258/jrsm.2012.120009.CrossRefPubMedPubMedCentral
11.
12.
go back to reference Becker D: Weekend hospitalisation and mortality: a critical review. Expert rev pharmacoecon outcomes res. 2008, 8 (1): 23-26. 10.1586/14737167.8.1.23.CrossRefPubMed Becker D: Weekend hospitalisation and mortality: a critical review. Expert rev pharmacoecon outcomes res. 2008, 8 (1): 23-26. 10.1586/14737167.8.1.23.CrossRefPubMed
13.
go back to reference Schmulewitz L, Proudfoot A, Bell D: The impact of weekends on outcome for emergency patients. Clin Med. 2005, 5 (6): 621-625. 10.7861/clinmedicine.5-6-621.CrossRef Schmulewitz L, Proudfoot A, Bell D: The impact of weekends on outcome for emergency patients. Clin Med. 2005, 5 (6): 621-625. 10.7861/clinmedicine.5-6-621.CrossRef
14.
go back to reference Mohammed MA, Sidhu KS, Rudge G, Stevens AJ: Weekend admission to hospital has a higher risk of death in the elective setting than in the emergency setting: a retrospective database study of national health service hospitals in England. Bmc Health Serv Res. 2012, 12: 87-10.1186/1472-6963-12-87.CrossRefPubMedPubMedCentral Mohammed MA, Sidhu KS, Rudge G, Stevens AJ: Weekend admission to hospital has a higher risk of death in the elective setting than in the emergency setting: a retrospective database study of national health service hospitals in England. Bmc Health Serv Res. 2012, 12: 87-10.1186/1472-6963-12-87.CrossRefPubMedPubMedCentral
15.
go back to reference Barnett MJ, Kaboli PJ, Sirio CA, Rosenthal GE: Day of the week of intensive care admission and patient outcomes - A multisite regional evaluation. Med Care. 2002, 40 (6): 530-539. 10.1097/00005650-200206000-00010.CrossRefPubMed Barnett MJ, Kaboli PJ, Sirio CA, Rosenthal GE: Day of the week of intensive care admission and patient outcomes - A multisite regional evaluation. Med Care. 2002, 40 (6): 530-539. 10.1097/00005650-200206000-00010.CrossRefPubMed
16.
go back to reference Bhonagiri D, Pilcher DV, Bailey MJ: Increased mortality associated with after-hours and weekend admission to the intensive care unit: a retrospective analysis. Med J Australia. 2011, 194 (6): 287-292.PubMed Bhonagiri D, Pilcher DV, Bailey MJ: Increased mortality associated with after-hours and weekend admission to the intensive care unit: a retrospective analysis. Med J Australia. 2011, 194 (6): 287-292.PubMed
17.
go back to reference Miyata H, Hashimoto H, Horiguchi H, Matsuda S, Motomura N, Takamoto S: Performance of in-hospital mortality prediction models for acute hospitalization: hospital standardized mortality ratio in Japan. Bmc Health Serv Res. 2008, 8: 229-10.1186/1472-6963-8-229.CrossRefPubMedPubMedCentral Miyata H, Hashimoto H, Horiguchi H, Matsuda S, Motomura N, Takamoto S: Performance of in-hospital mortality prediction models for acute hospitalization: hospital standardized mortality ratio in Japan. Bmc Health Serv Res. 2008, 8: 229-10.1186/1472-6963-8-229.CrossRefPubMedPubMedCentral
18.
go back to reference Hauck K, Zhao XY: How Dangerous is a Day in Hospital? A Model of Adverse Events and Length of Stay for Medical Inpatients. Med Care. 2011, 49 (12): 1068-1075. 10.1097/MLR.0b013e31822efb09.CrossRefPubMed Hauck K, Zhao XY: How Dangerous is a Day in Hospital? A Model of Adverse Events and Length of Stay for Medical Inpatients. Med Care. 2011, 49 (12): 1068-1075. 10.1097/MLR.0b013e31822efb09.CrossRefPubMed
19.
go back to reference Roberts RF, Innes KC, Walker SM: Introducing ICD-10-AM in Australian hospitals. The Medical Journal of Australia. 1998, 169: S32-S35.PubMed Roberts RF, Innes KC, Walker SM: Introducing ICD-10-AM in Australian hospitals. The Medical Journal of Australia. 1998, 169: S32-S35.PubMed
20.
go back to reference Charlson ME, Pompei P, Ales KL, Mackenzie CR: A New Method of Classifying Prognostic Co-Morbidity in Longitudinal-Studies - Development and Validation. J Chron Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed Charlson ME, Pompei P, Ales KL, Mackenzie CR: A New Method of Classifying Prognostic Co-Morbidity in Longitudinal-Studies - Development and Validation. J Chron Dis. 1987, 40 (5): 373-383. 10.1016/0021-9681(87)90171-8.CrossRefPubMed
21.
go back to reference Pouw ME, Peelen LM, Moons KG, Kalkman CJ, Lingsma HF: Including post-discharge mortality in calculation of hospital standardised mortality ratios: retrospective analysis of hospital episode statistics. Bmj. 2013, 347: f5913-10.1136/bmj.f5913. 2013-10-21 12:00:26.CrossRefPubMedPubMedCentral Pouw ME, Peelen LM, Moons KG, Kalkman CJ, Lingsma HF: Including post-discharge mortality in calculation of hospital standardised mortality ratios: retrospective analysis of hospital episode statistics. Bmj. 2013, 347: f5913-10.1136/bmj.f5913. 2013-10-21 12:00:26.CrossRefPubMedPubMedCentral
22.
go back to reference Lawrence G, Dinh I, Taylor L: The Centre for Health Record Linkage: a new resource for health services research and evaluation. Health Inf Manag J. 2008, 37 (2): 60-62. Lawrence G, Dinh I, Taylor L: The Centre for Health Record Linkage: a new resource for health services research and evaluation. Health Inf Manag J. 2008, 37 (2): 60-62.
23.
go back to reference Borthwick A, Buechi M, Goldberg A: Key Concepts in the ChoiceMaker 2 Record Matching System. 2003, Washington, DC: Proc. KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, 28-30. Borthwick A, Buechi M, Goldberg A: Key Concepts in the ChoiceMaker 2 Record Matching System. 2003, Washington, DC: Proc. KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, 28-30.
24.
25.
go back to reference Concha OP, Gallego B, Hillman K, Delaney GP, Coiera E: Do variations in hospital mortality patterns after weekend admission reflect reduced quality of care or different patient cohorts? A population-based study. BMJ Quality & Safety. 2014, 2013 (23): 215-222.CrossRef Concha OP, Gallego B, Hillman K, Delaney GP, Coiera E: Do variations in hospital mortality patterns after weekend admission reflect reduced quality of care or different patient cohorts? A population-based study. BMJ Quality & Safety. 2014, 2013 (23): 215-222.CrossRef
26.
go back to reference Horne JH, Baliunas SL: A Prescription for Period Analysis of Unevenly Sampled Time-Series. Astrophys J. 1986, 302 (2): 757-763.CrossRef Horne JH, Baliunas SL: A Prescription for Period Analysis of Unevenly Sampled Time-Series. Astrophys J. 1986, 302 (2): 757-763.CrossRef
27.
go back to reference Burnham KP, Anderson DR: Multimodel inference - understanding AIC and BIC in model selection. Sociol Method Res. 2004, 33 (2): 261-304. 10.1177/0049124104268644.CrossRef Burnham KP, Anderson DR: Multimodel inference - understanding AIC and BIC in model selection. Sociol Method Res. 2004, 33 (2): 261-304. 10.1177/0049124104268644.CrossRef
28.
go back to reference Laird N, Olivier D: Covariance analysis of censored survival data using log-linear analysis techniques. J Am Stat Assoc. 1981, 76 (374): 231-240. 10.1080/01621459.1981.10477634.CrossRef Laird N, Olivier D: Covariance analysis of censored survival data using log-linear analysis techniques. J Am Stat Assoc. 1981, 76 (374): 231-240. 10.1080/01621459.1981.10477634.CrossRef
Metadata
Title
Predicting the cumulative risk of death during hospitalization by modeling weekend, weekday and diurnal mortality risks
Authors
Enrico Coiera
Ying Wang
Farah Magrabi
Oscar Perez Concha
Blanca Gallego
William Runciman
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-226

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue