Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2007

Open Access 01-12-2007 | Research article

A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery – Part I: model planning

Authors: Emanuela Barbini, Gabriele Cevenini, Sabino Scolletta, Bonizella Biagioli, Pierpaolo Giomarelli, Paolo Barbini

Published in: BMC Medical Informatics and Decision Making | Issue 1/2007

Login to get access

Abstract

Background

Different methods have recently been proposed for predicting morbidity in intensive care units (ICU). The aim of the present study was to critically review a number of approaches for developing models capable of estimating the probability of morbidity in ICU after heart surgery. The study is divided into two parts. In this first part, popular models used to estimate the probability of class membership are grouped into distinct categories according to their underlying mathematical principles. Modelling techniques and intrinsic strengths and weaknesses of each model are analysed and discussed from a theoretical point of view, in consideration of clinical applications.

Methods

Models based on Bayes rule, k- nearest neighbour algorithm, logistic regression, scoring systems and artificial neural networks are investigated. Key issues for model design are described. The mathematical treatment of some aspects of model structure is also included for readers interested in developing models, though a full understanding of mathematical relationships is not necessary if the reader is only interested in perceiving the practical meaning of model assumptions, weaknesses and strengths from a user point of view.

Results

Scoring systems are very attractive due to their simplicity of use, although this may undermine their predictive capacity. Logistic regression models are trustworthy tools, although they suffer from the principal limitations of most regression procedures. Bayesian models seem to be a good compromise between complexity and predictive performance, but model recalibration is generally necessary. k-nearest neighbour may be a valid non parametric technique, though computational cost and the need for large data storage are major weaknesses of this approach. Artificial neural networks have intrinsic advantages with respect to common statistical models, though the training process may be problematical.

Conclusion

Knowledge of model assumptions and the theoretical strengths and weaknesses of different approaches are fundamental for designing models for estimating the probability of morbidity after heart surgery. However, a rational choice also requires evaluation and comparison of actual performances of locally-developed competitive models in the clinical scenario to obtain satisfactory agreement between local needs and model response. In the second part of this study the above predictive models will therefore be tested on real data acquired in a specialized ICU.
Appendix
Available only for authorised users
Literature
1.
go back to reference den Boer S, de Keizer NF, de Jonge E: Performance of prognostic models in critically ill cancer patients – a review. Critical Care. 2005, 9: R458-R463. 10.1186/cc3765.CrossRefPubMedPubMedCentral den Boer S, de Keizer NF, de Jonge E: Performance of prognostic models in critically ill cancer patients – a review. Critical Care. 2005, 9: R458-R463. 10.1186/cc3765.CrossRefPubMedPubMedCentral
2.
go back to reference Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002, 35: 352-359. 10.1016/S1532-0464(03)00034-0.CrossRefPubMed Dreiseitl S, Ohno-Machado L: Logistic regression and artificial neural network classification models: a methodology review. J Biomed Inform. 2002, 35: 352-359. 10.1016/S1532-0464(03)00034-0.CrossRefPubMed
3.
go back to reference Jaimes F, Fabiarz J, Alvarez D, Martinez C: Comparison between logistic regression and neural networks to predict death in patients with suspected sepsis in the emergency room. Crit Care. 2005, 9: R150-156. 10.1186/cc3054.CrossRefPubMedPubMedCentral Jaimes F, Fabiarz J, Alvarez D, Martinez C: Comparison between logistic regression and neural networks to predict death in patients with suspected sepsis in the emergency room. Crit Care. 2005, 9: R150-156. 10.1186/cc3054.CrossRefPubMedPubMedCentral
4.
go back to reference Shahian DM, Blackstone EH, Edwards FH, Grover FL, Grunkemeier GL, Naftel DC, Nashef SA, Nugent WC, Peterson ED: Cardiac surgery risk models: a position article. Ann Thorac Surg. 2004, 78: 1868-1877. 10.1016/j.athoracsur.2004.05.054.CrossRefPubMed Shahian DM, Blackstone EH, Edwards FH, Grover FL, Grunkemeier GL, Naftel DC, Nashef SA, Nugent WC, Peterson ED: Cardiac surgery risk models: a position article. Ann Thorac Surg. 2004, 78: 1868-1877. 10.1016/j.athoracsur.2004.05.054.CrossRefPubMed
5.
go back to reference Biagioli B, Scolletta S, Cevenini G, Barbini E, Giomarelli P, Barbini P: A multivariate Bayesian model for assessing morbidity after coronary artery surgery. Crit Care. 2006, 10: R94-10.1186/cc4441.CrossRefPubMedPubMedCentral Biagioli B, Scolletta S, Cevenini G, Barbini E, Giomarelli P, Barbini P: A multivariate Bayesian model for assessing morbidity after coronary artery surgery. Crit Care. 2006, 10: R94-10.1186/cc4441.CrossRefPubMedPubMedCentral
6.
go back to reference Petros AJ, Marshall JC, Van Saene HKF: Should morbidity replace mortality as an end-point for clinical trials in intensive care?. Lancet. 1995, 345: 369-371. 10.1016/S0140-6736(95)90347-X.CrossRefPubMed Petros AJ, Marshall JC, Van Saene HKF: Should morbidity replace mortality as an end-point for clinical trials in intensive care?. Lancet. 1995, 345: 369-371. 10.1016/S0140-6736(95)90347-X.CrossRefPubMed
7.
go back to reference Higgins TL, Estafanous FG, Loop FD, Beck GJ, Lee JC, Starr NJ, Knaus WA, Cosgrove DM: ICU admission score for predicting morbidity and mortality risk after coronary artery bypass grafting. Ann Thorac Surg. 1997, 64: 1050-1058. 10.1016/S0003-4975(97)00553-5.CrossRefPubMed Higgins TL, Estafanous FG, Loop FD, Beck GJ, Lee JC, Starr NJ, Knaus WA, Cosgrove DM: ICU admission score for predicting morbidity and mortality risk after coronary artery bypass grafting. Ann Thorac Surg. 1997, 64: 1050-1058. 10.1016/S0003-4975(97)00553-5.CrossRefPubMed
8.
go back to reference Higgins TL, Estafanous FG, Loop FD, Beck GJ, Blum JM, Paranandi L: Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. Jama. 1992, 267: 2344-2348. 10.1001/jama.267.17.2344.CrossRefPubMed Higgins TL, Estafanous FG, Loop FD, Beck GJ, Blum JM, Paranandi L: Stratification of morbidity and mortality outcome by preoperative risk factors in coronary artery bypass patients. Jama. 1992, 267: 2344-2348. 10.1001/jama.267.17.2344.CrossRefPubMed
9.
go back to reference van Wermeskerken GK, Lardenoye JW, Hill SE, Grocott HP, Phillips-Bute B, Smith PK, Reves JG, Newman MF: Intraoperative physiologic variables and outcome in cardiac surgery: Part I. In-Hospital Mortality. Ann Thorac Surg. 2000, 69: 1070-1076. 10.1016/S0003-4975(99)01443-5.CrossRefPubMed van Wermeskerken GK, Lardenoye JW, Hill SE, Grocott HP, Phillips-Bute B, Smith PK, Reves JG, Newman MF: Intraoperative physiologic variables and outcome in cardiac surgery: Part I. In-Hospital Mortality. Ann Thorac Surg. 2000, 69: 1070-1076. 10.1016/S0003-4975(99)01443-5.CrossRefPubMed
10.
go back to reference Reich DL, Bodian CA, Krol M, Kuroda M, Osinski T, Thys DM: Intraoperative hemodynamic predictors of mortality, stroke, and myocardial infarction after coronary artery bypass surgery. Anesth Analg. 1999, 89: 814-822. 10.1097/00000539-199910000-00002.PubMed Reich DL, Bodian CA, Krol M, Kuroda M, Osinski T, Thys DM: Intraoperative hemodynamic predictors of mortality, stroke, and myocardial infarction after coronary artery bypass surgery. Anesth Analg. 1999, 89: 814-822. 10.1097/00000539-199910000-00002.PubMed
11.
go back to reference Higgins TL: Quantifying risk and assessing outcome in cardiac surgery. J Cardiothor Vasc Anesth. 1998, 12: 330-340. 10.1016/S1053-0770(98)90018-0.CrossRef Higgins TL: Quantifying risk and assessing outcome in cardiac surgery. J Cardiothor Vasc Anesth. 1998, 12: 330-340. 10.1016/S1053-0770(98)90018-0.CrossRef
12.
go back to reference Murphy-Filkins R, Teres D, Lemeshow S, Hosmer DW: Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: How to distinguish a general from a specialty intensive care unit. Crit Care Med. 1996, 24: 1968-1973. 10.1097/00003246-199612000-00007.CrossRefPubMed Murphy-Filkins R, Teres D, Lemeshow S, Hosmer DW: Effect of changing patient mix on the performance of an intensive care unit severity-of-illness model: How to distinguish a general from a specialty intensive care unit. Crit Care Med. 1996, 24: 1968-1973. 10.1097/00003246-199612000-00007.CrossRefPubMed
13.
go back to reference Schafer JH, Maurer A, Jochimsen F, Emde C, Wegscheider K, Arntz HR, Heitz J, Krell-Schroeder B, Distler A: Outcome prediction models on admission in a medical intensive care unit: Do they predict individual outcome?. Crit Care Med. 1990, 18: 1111-1117.CrossRefPubMed Schafer JH, Maurer A, Jochimsen F, Emde C, Wegscheider K, Arntz HR, Heitz J, Krell-Schroeder B, Distler A: Outcome prediction models on admission in a medical intensive care unit: Do they predict individual outcome?. Crit Care Med. 1990, 18: 1111-1117.CrossRefPubMed
14.
go back to reference Ryan TA, Rady MY, Bashour CA, Leventhal M, Lytle M, Starr NJ: Predictors of outcome in cardiac surgical patients with prolonged intensive care stay. Chest. 1997, 112: 1035-1042.CrossRefPubMed Ryan TA, Rady MY, Bashour CA, Leventhal M, Lytle M, Starr NJ: Predictors of outcome in cardiac surgical patients with prolonged intensive care stay. Chest. 1997, 112: 1035-1042.CrossRefPubMed
15.
16.
go back to reference O'Connor GT, Plume SK, Olmstead EM, Coffin LH, Morton JR, Maloney CT, Nowicki ER, Levy DG, Tryzelaar JF, Hernandez F, Adrian L, Casey KJ, Bundy D, Soule DN, Marrin CAS, Nugent WC, Charlesworth DC, Clough R, Katz S, Leavitt BJ, Wennberg JE: Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Circulation. 1992, 85: 2110-2118.CrossRefPubMed O'Connor GT, Plume SK, Olmstead EM, Coffin LH, Morton JR, Maloney CT, Nowicki ER, Levy DG, Tryzelaar JF, Hernandez F, Adrian L, Casey KJ, Bundy D, Soule DN, Marrin CAS, Nugent WC, Charlesworth DC, Clough R, Katz S, Leavitt BJ, Wennberg JE: Multivariate prediction of in-hospital mortality associated with coronary artery bypass graft surgery. Circulation. 1992, 85: 2110-2118.CrossRefPubMed
17.
go back to reference Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13: 818-829. 10.1097/00003246-198510000-00009.CrossRefPubMed
18.
go back to reference Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalised adults. Chest. 1991, 100: 1619-1636. 10.1378/chest.100.6.1619.CrossRefPubMed Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalised adults. Chest. 1991, 100: 1619-1636. 10.1378/chest.100.6.1619.CrossRefPubMed
19.
go back to reference Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Physiology score (SAPS II) based on a European/North American multicenter study. JAMA. 1993, 270: 2957-2963. 10.1001/jama.270.24.2957.CrossRefPubMed Le Gall JR, Lemeshow S, Saulnier F: A new Simplified Acute Physiology score (SAPS II) based on a European/North American multicenter study. JAMA. 1993, 270: 2957-2963. 10.1001/jama.270.24.2957.CrossRefPubMed
20.
go back to reference Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPMII) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed Lemeshow S, Teres D, Klar J, Avrunin JS, Gehlbach SH, Rapoport J: Mortality Probability Models (MPMII) based on an international cohort of intensive care unit patients. JAMA. 1993, 270: 2478-2486. 10.1001/jama.270.20.2478.CrossRefPubMed
21.
go back to reference Edwards FH, Peterson RF, Bridges C, Ceithaml EL: Use of a Bayesian statistical model for risk assessment in coronary artery surgery. Ann Thorac Surg. 1995, 59: 1611-1612. 10.1016/0003-4975(95)00189-R.CrossRefPubMed Edwards FH, Peterson RF, Bridges C, Ceithaml EL: Use of a Bayesian statistical model for risk assessment in coronary artery surgery. Ann Thorac Surg. 1995, 59: 1611-1612. 10.1016/0003-4975(95)00189-R.CrossRefPubMed
22.
go back to reference Marshall G, Shroyer ALW, Grover FL, Hammermeister KE: Bayesian-logit model for risk assessment in coronary artery bypass grafting. Ann Thorac Surg. 1994, 57: 1492-1500.CrossRefPubMed Marshall G, Shroyer ALW, Grover FL, Hammermeister KE: Bayesian-logit model for risk assessment in coronary artery bypass grafting. Ann Thorac Surg. 1994, 57: 1492-1500.CrossRefPubMed
23.
go back to reference Asimakopoulos G, Al-Ruzzeh S, Ambler G, Omar RZ, Punjabi P, Amrani M, Taylor KM: An evaluation of existing risk stratification models as a tool for comparison of surgical performances for coronary artery bypass grafting between institutions. Eur J Cardiothorac Surg. 2003, 23: 935-941. 10.1016/S1010-7940(03)00165-9.CrossRefPubMed Asimakopoulos G, Al-Ruzzeh S, Ambler G, Omar RZ, Punjabi P, Amrani M, Taylor KM: An evaluation of existing risk stratification models as a tool for comparison of surgical performances for coronary artery bypass grafting between institutions. Eur J Cardiothorac Surg. 2003, 23: 935-941. 10.1016/S1010-7940(03)00165-9.CrossRefPubMed
24.
go back to reference Bridgewater B, Neve H, Moat N, Hooper T, Jones M: Predicting operative risk for coronary artery surgery in the United Kingdom: a comparison of various risk prediction algorithms. Heart. 1998, 79: 350-355.CrossRefPubMedPubMedCentral Bridgewater B, Neve H, Moat N, Hooper T, Jones M: Predicting operative risk for coronary artery surgery in the United Kingdom: a comparison of various risk prediction algorithms. Heart. 1998, 79: 350-355.CrossRefPubMedPubMedCentral
25.
go back to reference Tu JV, Weinstein MC, McNeil BJ, Naylor CD: Predicting mortality after coronary artery bypass surgery: what do artificial neural networks learn? The Steering Committee of the Cardiac Care Network of Ontario. Med Decis Making. 1998, 18: 229-235.CrossRefPubMed Tu JV, Weinstein MC, McNeil BJ, Naylor CD: Predicting mortality after coronary artery bypass surgery: what do artificial neural networks learn? The Steering Committee of the Cardiac Care Network of Ontario. Med Decis Making. 1998, 18: 229-235.CrossRefPubMed
26.
go back to reference Lippmann RP, Shahian DM: Coronary artery bypass risk prediction using neural networks. Ann Thorac Surg. 1997, 63: 1635-1643. 10.1016/S0003-4975(97)00225-7.CrossRefPubMed Lippmann RP, Shahian DM: Coronary artery bypass risk prediction using neural networks. Ann Thorac Surg. 1997, 63: 1635-1643. 10.1016/S0003-4975(97)00225-7.CrossRefPubMed
27.
go back to reference Knuiman MW, Vu HT, Segal MR: An empirical comparison of multivariable methods for estimating risk of death from coronary heart disease. J Cardiovasc Risk. 1997, 4: 127-134. 10.1097/00043798-199704000-00009.CrossRefPubMed Knuiman MW, Vu HT, Segal MR: An empirical comparison of multivariable methods for estimating risk of death from coronary heart disease. J Cardiovasc Risk. 1997, 4: 127-134. 10.1097/00043798-199704000-00009.CrossRefPubMed
28.
go back to reference Marshall G, Grover FL, Henderson WG, Hammermeister KE: Assessment of predictive models for binary outcomes: an empirical approach using operative death from cardiac surgery. Stat Med. 1994, 13: 1501-1511. 10.1002/sim.4780131502.CrossRefPubMed Marshall G, Grover FL, Henderson WG, Hammermeister KE: Assessment of predictive models for binary outcomes: an empirical approach using operative death from cardiac surgery. Stat Med. 1994, 13: 1501-1511. 10.1002/sim.4780131502.CrossRefPubMed
29.
go back to reference Krumholz HM: Mathematical models and the assessment of performance in cardiology. Circulation. 1999, 99: 2067-2069.CrossRefPubMed Krumholz HM: Mathematical models and the assessment of performance in cardiology. Circulation. 1999, 99: 2067-2069.CrossRefPubMed
30.
go back to reference Omar RZ, Ambler G, Royston P, Eliahoo J, Taylor KM: Cardiac surgery risk modeling for mortality: a review of current practice and suggestions for improvement. Ann Thorac Surg. 2004, 77: 2232-2237. 10.1016/j.athoracsur.2003.10.032.CrossRefPubMed Omar RZ, Ambler G, Royston P, Eliahoo J, Taylor KM: Cardiac surgery risk modeling for mortality: a review of current practice and suggestions for improvement. Ann Thorac Surg. 2004, 77: 2232-2237. 10.1016/j.athoracsur.2003.10.032.CrossRefPubMed
31.
go back to reference Geisser HJ, Holzl P, Marohl S, Kuhn-Regnier F, Mehlhorn U, Sudkamp M, De Vivie ER: Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. 2000, 17: 400-406. 10.1016/S1010-7940(00)00385-7.CrossRef Geisser HJ, Holzl P, Marohl S, Kuhn-Regnier F, Mehlhorn U, Sudkamp M, De Vivie ER: Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. 2000, 17: 400-406. 10.1016/S1010-7940(00)00385-7.CrossRef
32.
go back to reference Pitkanen O, Niskanen M, Rehnberg S, Hippelainen M, Hynynen M: Intra-institutional prediction of outcome after cardiac surgery: comparison between a locally derived model and the EuroSCORE. Eur J Cardiothorac Surg. 2000, 18: 703-710. 10.1016/S1010-7940(00)00579-0.CrossRefPubMed Pitkanen O, Niskanen M, Rehnberg S, Hippelainen M, Hynynen M: Intra-institutional prediction of outcome after cardiac surgery: comparison between a locally derived model and the EuroSCORE. Eur J Cardiothorac Surg. 2000, 18: 703-710. 10.1016/S1010-7940(00)00579-0.CrossRefPubMed
33.
go back to reference Fukunaga K: Introduction to Statistical Pattern Recognition. 1990, Boston: Academic Press Fukunaga K: Introduction to Statistical Pattern Recognition. 1990, Boston: Academic Press
34.
go back to reference Bishop CM: Neural Networks for Pattern Recognition. 1995, New York: Oxford University Press Inc Bishop CM: Neural Networks for Pattern Recognition. 1995, New York: Oxford University Press Inc
35.
go back to reference Sivia DS, Skilling J: Data Analysis: A Bayesian Tutorial. 2006, Oxford: Oxford University Press Sivia DS, Skilling J: Data Analysis: A Bayesian Tutorial. 2006, Oxford: Oxford University Press
36.
go back to reference Lee PM: Bayesian Statistics – An Introduction. 2004, London: Arnold Lee PM: Bayesian Statistics – An Introduction. 2004, London: Arnold
37.
go back to reference Itskowitz P, Tropsha A: kappa Nearest neighbors QSAR modeling as a variational problem: theory and applications. J Chem Inf Model. 2005, 45: 777-785. 10.1021/ci049628+.CrossRefPubMed Itskowitz P, Tropsha A: kappa Nearest neighbors QSAR modeling as a variational problem: theory and applications. J Chem Inf Model. 2005, 45: 777-785. 10.1021/ci049628+.CrossRefPubMed
38.
go back to reference Statnikov A, Aliferis CF, Tsamardinos I, Hardin D, Levy S: A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics. 2005, 21: 631-643. 10.1093/bioinformatics/bti033.CrossRefPubMed Statnikov A, Aliferis CF, Tsamardinos I, Hardin D, Levy S: A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis. Bioinformatics. 2005, 21: 631-643. 10.1093/bioinformatics/bti033.CrossRefPubMed
39.
go back to reference Krzanowski WJ: Principles of Multivariate Analysis: A User's Perspective. 1988, Oxford: Clarendon Press Krzanowski WJ: Principles of Multivariate Analysis: A User's Perspective. 1988, Oxford: Clarendon Press
40.
go back to reference Diamond GA: What price perfection? Calibration and discrimination of clinical prediction models. J Clin Epidemiol. 1992, 45: 85-89. 10.1016/0895-4356(92)90192-P.CrossRefPubMed Diamond GA: What price perfection? Calibration and discrimination of clinical prediction models. J Clin Epidemiol. 1992, 45: 85-89. 10.1016/0895-4356(92)90192-P.CrossRefPubMed
41.
go back to reference Vapnik VN: The Nature of Statistical Learning Theory. 1999, New York: Springer-Verlag Vapnik VN: The Nature of Statistical Learning Theory. 1999, New York: Springer-Verlag
42.
go back to reference Ivanov J, Tu JV, Naylor CD: Ready-made, recalibrated, or remodeled? Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation. 1999, 99: 2098-2104.CrossRefPubMed Ivanov J, Tu JV, Naylor CD: Ready-made, recalibrated, or remodeled? Issues in the use of risk indexes for assessing mortality after coronary artery bypass graft surgery. Circulation. 1999, 99: 2098-2104.CrossRefPubMed
43.
go back to reference DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, Mark DB: Comparing risk-adjustment methods for provider profiling. Stat Med. 1997, 16: 2645-2664. 10.1002/(SICI)1097-0258(19971215)16:23<2645::AID-SIM696>3.0.CO;2-D.CrossRefPubMed DeLong ER, Peterson ED, DeLong DM, Muhlbaier LH, Hackett S, Mark DB: Comparing risk-adjustment methods for provider profiling. Stat Med. 1997, 16: 2645-2664. 10.1002/(SICI)1097-0258(19971215)16:23<2645::AID-SIM696>3.0.CO;2-D.CrossRefPubMed
44.
go back to reference Steyerberg EW, Borsboom GJ, van Houwelingen HC, Eijkemans MJ, Habbema JD: Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med. 2004, 23: 2567-2586. 10.1002/sim.1844.CrossRefPubMed Steyerberg EW, Borsboom GJ, van Houwelingen HC, Eijkemans MJ, Habbema JD: Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med. 2004, 23: 2567-2586. 10.1002/sim.1844.CrossRefPubMed
45.
go back to reference Ellenius J, Groth T: Methods for selection of adequate neural network structures with application to early assessment of chest pain patients by biochemical monitoring. Int J Med Inform. 2000, 57: 181-202. 10.1016/S1386-5056(00)00065-4.CrossRefPubMed Ellenius J, Groth T: Methods for selection of adequate neural network structures with application to early assessment of chest pain patients by biochemical monitoring. Int J Med Inform. 2000, 57: 181-202. 10.1016/S1386-5056(00)00065-4.CrossRefPubMed
46.
go back to reference Jain AK, Chandrasekaran B: Dimensionality and Sample Size Considerations in Pattern Recognition Practice. Handbook of Statistics. Amsterdam. Edited by: Krishnaiah PR, Kanal LN. 1982 Jain AK, Chandrasekaran B: Dimensionality and Sample Size Considerations in Pattern Recognition Practice. Handbook of Statistics. Amsterdam. Edited by: Krishnaiah PR, Kanal LN. 1982
47.
go back to reference Jennrich RI: Stepwise discriminant analysis. Statistical methods for digital computers. New York. Edited by: Enslein K, Ralston A, Wilf HS. 1977, 76-95. Jennrich RI: Stepwise discriminant analysis. Statistical methods for digital computers. New York. Edited by: Enslein K, Ralston A, Wilf HS. 1977, 76-95.
48.
go back to reference Armitage P, Berry G: Statistical methods in medical research. 1987, Oxford: Blackwell Scientific Publications Armitage P, Berry G: Statistical methods in medical research. 1987, Oxford: Blackwell Scientific Publications
49.
go back to reference Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristics (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristics (ROC) curve. Radiology. 1982, 143: 29-36.CrossRefPubMed
50.
go back to reference Mason SJ, Graham NE: Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quarterly Journal of the Royal Meteorological Society. 2002, 128: 2145-2166. 10.1256/003590002320603584.CrossRef Mason SJ, Graham NE: Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quarterly Journal of the Royal Meteorological Society. 2002, 128: 2145-2166. 10.1256/003590002320603584.CrossRef
51.
go back to reference Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L: The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inform. 2005, 38: 404-415. 10.1016/j.jbi.2005.02.008.CrossRefPubMed Lasko TA, Bhagwat JG, Zou KH, Ohno-Machado L: The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inform. 2005, 38: 404-415. 10.1016/j.jbi.2005.02.008.CrossRefPubMed
52.
go back to reference Bamber DC: The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology. 1975, 12: 387-415. 10.1016/0022-2496(75)90001-2.CrossRef Bamber DC: The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology. 1975, 12: 387-415. 10.1016/0022-2496(75)90001-2.CrossRef
53.
go back to reference Obuchowski NA, Lieber ML, Wians FH: ROC curves in clinical chemistry: uses, misuses, and possible solutions. Clin Chem. 2004, 50: 1118-25. 10.1373/clinchem.2004.031823.CrossRefPubMed Obuchowski NA, Lieber ML, Wians FH: ROC curves in clinical chemistry: uses, misuses, and possible solutions. Clin Chem. 2004, 50: 1118-25. 10.1373/clinchem.2004.031823.CrossRefPubMed
54.
go back to reference Murphy AH: A new vector partition of the probability score. J Appl Meteor. 1973, 12: 595-600. 10.1175/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2.CrossRef Murphy AH: A new vector partition of the probability score. J Appl Meteor. 1973, 12: 595-600. 10.1175/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2.CrossRef
55.
go back to reference Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K: Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med. 2006, 34: 1378-1388. 10.1097/01.CCM.0000216702.94014.75.CrossRefPubMed Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K: Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med. 2006, 34: 1378-1388. 10.1097/01.CCM.0000216702.94014.75.CrossRefPubMed
56.
go back to reference Moran JL, Solomon PJ: Mortality and other event rates: what do they tell us about performance?. Crit Care Resusc. 2003, 5: 292-304.PubMed Moran JL, Solomon PJ: Mortality and other event rates: what do they tell us about performance?. Crit Care Resusc. 2003, 5: 292-304.PubMed
57.
go back to reference Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.CrossRefPubMed Harrell FE, Lee KL, Mark DB: Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996, 15: 361-387. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.CrossRefPubMed
58.
go back to reference Schulman P: Bayes' theorem – a review. Cardiol Clin. 1984, 2: 319-327.PubMed Schulman P: Bayes' theorem – a review. Cardiol Clin. 1984, 2: 319-327.PubMed
59.
go back to reference Artioli E, Avanzolini G, Barbini P, Cevenini G, Gnudi G: Classification of postoperative cardiac patients: comparative evaluation of four algorithms. Int J Biomed Comput. 1991, 29: 257-270. 10.1016/0020-7101(91)90043-E.CrossRefPubMed Artioli E, Avanzolini G, Barbini P, Cevenini G, Gnudi G: Classification of postoperative cardiac patients: comparative evaluation of four algorithms. Int J Biomed Comput. 1991, 29: 257-270. 10.1016/0020-7101(91)90043-E.CrossRefPubMed
60.
go back to reference Duda RO, Hart PE, Stork DG: Pattern Classification. 2001, New York: John Wiley and Sons Duda RO, Hart PE, Stork DG: Pattern Classification. 2001, New York: John Wiley and Sons
61.
go back to reference Campbell MK, Donner A: Classification efficiency of multinomial logistic regression relative to ordinal logistic regression. J Am Stat Assoc. 1989, 84: 587-591. 10.2307/2289946.CrossRef Campbell MK, Donner A: Classification efficiency of multinomial logistic regression relative to ordinal logistic regression. J Am Stat Assoc. 1989, 84: 587-591. 10.2307/2289946.CrossRef
62.
go back to reference Tabachnick BG, Fidell LS: Using Multivariate Statistics. 1996, New York: Harper Collins Tabachnick BG, Fidell LS: Using Multivariate Statistics. 1996, New York: Harper Collins
63.
go back to reference Friedman GD: Primer of Epidemiology. 2004, New York: McGraw Hill Friedman GD: Primer of Epidemiology. 2004, New York: McGraw Hill
64.
go back to reference Agresti A: On logit confidence intervals for the odds ratio with small samples. Biometrics. 1999, 55: 597-602. 10.1111/j.0006-341X.1999.00597.x.CrossRefPubMed Agresti A: On logit confidence intervals for the odds ratio with small samples. Biometrics. 1999, 55: 597-602. 10.1111/j.0006-341X.1999.00597.x.CrossRefPubMed
65.
go back to reference Silverman BW: Density Estimation for Statistics and Data Analysis. 1986, London: Chapman and HallCrossRef Silverman BW: Density Estimation for Statistics and Data Analysis. 1986, London: Chapman and HallCrossRef
66.
go back to reference Gangopadhyay S, Clark M, Rajagopalan B: Statistical downscaling using K-nearest neighbors. Water Resources Research. 2005, 41: W02024, 1-23. 10.1029/2004WR003444.CrossRef Gangopadhyay S, Clark M, Rajagopalan B: Statistical downscaling using K-nearest neighbors. Water Resources Research. 2005, 41: W02024, 1-23. 10.1029/2004WR003444.CrossRef
67.
go back to reference Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY: An optimal algorithm for approximate nearest neighbor searching in fixed dimensions. Journal of the ACM. 1998, 45: 891-923. 10.1145/293347.293348.CrossRef Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY: An optimal algorithm for approximate nearest neighbor searching in fixed dimensions. Journal of the ACM. 1998, 45: 891-923. 10.1145/293347.293348.CrossRef
68.
go back to reference Azzalini A: Logistic regression for autocorrelated data with application to repeated measures. Biometrika. 1994, 81: 767-775. 10.1093/biomet/81.4.767.CrossRef Azzalini A: Logistic regression for autocorrelated data with application to repeated measures. Biometrika. 1994, 81: 767-775. 10.1093/biomet/81.4.767.CrossRef
69.
go back to reference Le Cessie S, Van Houwelingen JC: Logistic regression for correlated binary data. Appl Statist. 1994, 43: 95-108. 10.2307/2986114.CrossRef Le Cessie S, Van Houwelingen JC: Logistic regression for correlated binary data. Appl Statist. 1994, 43: 95-108. 10.2307/2986114.CrossRef
70.
go back to reference Liang K-Y, Zeger SL: Regression analysis for correlated data. Annu Rev Pub Health. 1993, 14: 43-68. 10.1146/annurev.pu.14.050193.000355.CrossRef Liang K-Y, Zeger SL: Regression analysis for correlated data. Annu Rev Pub Health. 1993, 14: 43-68. 10.1146/annurev.pu.14.050193.000355.CrossRef
71.
go back to reference Cevenini G, Barbini E, Scoletta S, Biagioli B, Giomarelli P, Barbini P: A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery – Part II: an illustrative example. BMC Med Inf Dec Mak. 2007, 7: 36-10.1186/1472-6947-7-36.CrossRef Cevenini G, Barbini E, Scoletta S, Biagioli B, Giomarelli P, Barbini P: A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery – Part II: an illustrative example. BMC Med Inf Dec Mak. 2007, 7: 36-10.1186/1472-6947-7-36.CrossRef
Metadata
Title
A comparative analysis of predictive models of morbidity in intensive care unit after cardiac surgery – Part I: model planning
Authors
Emanuela Barbini
Gabriele Cevenini
Sabino Scolletta
Bonizella Biagioli
Pierpaolo Giomarelli
Paolo Barbini
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2007
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-7-35

Other articles of this Issue 1/2007

BMC Medical Informatics and Decision Making 1/2007 Go to the issue