Skip to main content
Top
Published in: BMC Neurology 1/2018

Open Access 01-12-2018 | Research article

Prognostic models for complete recovery in ischemic stroke: a systematic review and meta-analysis

Authors: Nampet Jampathong, Malinee Laopaiboon, Siwanon Rattanakanokchai, Porjai Pattanittum

Published in: BMC Neurology | Issue 1/2018

Login to get access

Abstract

Background

Prognostic models have been increasingly developed to predict complete recovery in ischemic stroke. However, questions arise about the performance characteristics of these models. The aim of this study was to systematically review and synthesize performance of existing prognostic models for complete recovery in ischemic stroke.

Methods

We searched journal publications indexed in PUBMED, SCOPUS, CENTRAL, ISI Web of Science and OVID MEDLINE from inception until 4 December, 2017, for studies designed to develop and/or validate prognostic models for predicting complete recovery in ischemic stroke patients. Two reviewers independently examined titles and abstracts, and assessed whether each study met the pre-defined inclusion criteria and also independently extracted information about model development and performance. We evaluated validation of the models by medians of the area under the receiver operating characteristic curve (AUC) or c-statistic and calibration performance. We used a random-effects meta-analysis to pool AUC values.

Results

We included 10 studies with 23 models developed from elderly patients with a moderately severe ischemic stroke, mainly in three high income countries. Sample sizes for each study ranged from 75 to 4441. Logistic regression was the only analytical strategy used to develop the models. The number of various predictors varied from one to 11. Internal validation was performed in 12 models with a median AUC of 0.80 (95% CI 0.73 to 0.84). One model reported good calibration. Nine models reported external validation with a median AUC of 0.80 (95% CI 0.76 to 0.82). Four models showed good discrimination and calibration on external validation. The pooled AUC of the two validation models of the same developed model was 0.78 (95% CI 0.71 to 0.85).

Conclusions

The performance of the 23 models found in the systematic review varied from fair to good in terms of internal and external validation. Further models should be developed with internal and external validation in low and middle income countries.
Appendix
Available only for authorised users
Literature
2.
go back to reference Benjamin EJ, Virani SS, Callaway CW, Chang AR, Cheng S, Chiuve SE, et al. Heart disease and stroke statistics-2018 update: a report from the American Heart Association. Circulation. 2018;137:1–442.CrossRef Benjamin EJ, Virani SS, Callaway CW, Chang AR, Cheng S, Chiuve SE, et al. Heart disease and stroke statistics-2018 update: a report from the American Heart Association. Circulation. 2018;137:1–442.CrossRef
3.
go back to reference Moser DK, Kimble LP, Alberts MJ, Alonzo A, Croft JB, Dracup K, Evenson KR, Go AS, Hand MM, Kothari RU, Mensah GA. Reducing delay in seeking treatment by patients with acute coronary syndrome and stroke: a scientific statement from the American Heart Association Council on cardiovascular nursing and stroke council. J Cardiovasc Nurs. 2007;22:326–43.CrossRefPubMed Moser DK, Kimble LP, Alberts MJ, Alonzo A, Croft JB, Dracup K, Evenson KR, Go AS, Hand MM, Kothari RU, Mensah GA. Reducing delay in seeking treatment by patients with acute coronary syndrome and stroke: a scientific statement from the American Heart Association Council on cardiovascular nursing and stroke council. J Cardiovasc Nurs. 2007;22:326–43.CrossRefPubMed
4.
go back to reference Steyerberg E, Moons KGM, van der Windt D, Hayden J, Perel P, Schroter S, et al. Prognosis research strategy (PROGRESS) series 3: prognostic model research. PLoS Med. 2013;10:e1001381.CrossRefPubMedPubMedCentral Steyerberg E, Moons KGM, van der Windt D, Hayden J, Perel P, Schroter S, et al. Prognosis research strategy (PROGRESS) series 3: prognostic model research. PLoS Med. 2013;10:e1001381.CrossRefPubMedPubMedCentral
5.
go back to reference Vogenberg FR. Predictive and prognostic Models: implications for healthcare decision-making in a modern recession. American health & drug benefits. 2009;2:218. Vogenberg FR. Predictive and prognostic Models: implications for healthcare decision-making in a modern recession. American health & drug benefits. 2009;2:218.
6.
go back to reference Pavlou M, Ambler G, Seaman SR, Guttmann O, Elliott P, King M, et al. How to develop a more accurate risk prediction model when there are few events relative to the number of predictors. BMJ (Clinical research ed). 2015;351:h3868. Pavlou M, Ambler G, Seaman SR, Guttmann O, Elliott P, King M, et al. How to develop a more accurate risk prediction model when there are few events relative to the number of predictors. BMJ (Clinical research ed). 2015;351:h3868.
7.
go back to reference Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515–24.CrossRefPubMed Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130:515–24.CrossRefPubMed
8.
go back to reference D’Amico G, Malizia G, D’Amico M. Prognosis research and risk of bias. Intern Emerg Med. 2016;11:251–60.CrossRefPubMed D’Amico G, Malizia G, D’Amico M. Prognosis research and risk of bias. Intern Emerg Med. 2016;11:251–60.CrossRefPubMed
9.
go back to reference Kleinbaum D, Klein M. Logistic regression: a self- learning text. 3rd ed. New York: Springer; 2010.CrossRef Kleinbaum D, Klein M. Logistic regression: a self- learning text. 3rd ed. New York: Springer; 2010.CrossRef
10.
go back to reference Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology (Cambridge, Mass). 2010;21:128.CrossRef Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiology (Cambridge, Mass). 2010;21:128.CrossRef
11.
go back to reference Hanley A, Mcneil J, Hanley JA, BJ MN. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed Hanley A, Mcneil J, Hanley JA, BJ MN. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.CrossRefPubMed
12.
go back to reference StataCorp. Stata statistical software,Release 10. College Station: StataCorp LP; 2007. StataCorp. Stata statistical software,Release 10. College Station: StataCorp LP; 2007.
13.
go back to reference Johnston KC, Connors AF, Wagner DP, Knaus WA, Wang X, Haley EC. A predictive risk model for outcomes of ischemic stroke. Stroke. 2000;31:448–55.CrossRefPubMed Johnston KC, Connors AF, Wagner DP, Knaus WA, Wang X, Haley EC. A predictive risk model for outcomes of ischemic stroke. Stroke. 2000;31:448–55.CrossRefPubMed
14.
15.
go back to reference Johnston KC, Connors AF Jr, Wagner DP, Haley EC Jr. Predicting outcome in ischemic stroke: external validation of predictive risk models. 2003;34:200–2. Johnston KC, Connors AF Jr, Wagner DP, Haley EC Jr. Predicting outcome in ischemic stroke: external validation of predictive risk models. 2003;34:200–2.
16.
go back to reference Johnston KC, Wagner DP, Wang X-Q, Newman GC, Thijs V, Sen S, et al. Validation of an acute ischemic stroke model: does diffusion-weighted imaging lesion volume offer a clinically significant improvement in prediction of outcome? Stroke. 2007;38:1820–5.CrossRefPubMed Johnston KC, Wagner DP, Wang X-Q, Newman GC, Thijs V, Sen S, et al. Validation of an acute ischemic stroke model: does diffusion-weighted imaging lesion volume offer a clinically significant improvement in prediction of outcome? Stroke. 2007;38:1820–5.CrossRefPubMed
17.
go back to reference Weimar C, Ziegler A, König IR, Diener HC. Predicting functional outcome and survival after acute ischemic stroke. J Neurol. 2002;249:888–95.CrossRefPubMed Weimar C, Ziegler A, König IR, Diener HC. Predicting functional outcome and survival after acute ischemic stroke. J Neurol. 2002;249:888–95.CrossRefPubMed
18.
go back to reference German Stroke Study Collaboration. Predicting outcome after acute ischemic stroke: an external validation of prognostic models. Neurology. 2004;62:581–5.CrossRef German Stroke Study Collaboration. Predicting outcome after acute ischemic stroke: an external validation of prognostic models. Neurology. 2004;62:581–5.CrossRef
19.
go back to reference Weimar C, König IR, Kraywinkel K, Ziegler A, Diener HC. Age and National Institutes of Health stroke scale score within 6 hours after onset are accurate predictors of outcome after cerebral ischemia. Stroke. 2004;35:158–62.CrossRefPubMed Weimar C, König IR, Kraywinkel K, Ziegler A, Diener HC. Age and National Institutes of Health stroke scale score within 6 hours after onset are accurate predictors of outcome after cerebral ischemia. Stroke. 2004;35:158–62.CrossRefPubMed
20.
go back to reference König IR, Ziegler A, Bluhmki E, Hacke W, Bath PM, Sacco RL, Diener HC, Weimar C. Predicting long-term outcome after acute ischemic stroke. Stroke. 2008;39:1821–6.CrossRefPubMed König IR, Ziegler A, Bluhmki E, Hacke W, Bath PM, Sacco RL, Diener HC, Weimar C. Predicting long-term outcome after acute ischemic stroke. Stroke. 2008;39:1821–6.CrossRefPubMed
21.
go back to reference Schiemanck SK, Kwakkel G, Post MW, Kappelle LJ, Prevo AJ. Predicting long-term independency in activities of daily living after middle cerebral artery stroke. Stroke. 2006;37:1050–4.CrossRefPubMed Schiemanck SK, Kwakkel G, Post MW, Kappelle LJ, Prevo AJ. Predicting long-term independency in activities of daily living after middle cerebral artery stroke. Stroke. 2006;37:1050–4.CrossRefPubMed
22.
go back to reference Patti J, Helenius J, Puri AS, Henninger N. White matter Hyperintensity–adjusted critical infarct thresholds to predict a favorable 90-day outcome. Stroke. 2016;47:2526–33.CrossRefPubMedPubMedCentral Patti J, Helenius J, Puri AS, Henninger N. White matter Hyperintensity–adjusted critical infarct thresholds to predict a favorable 90-day outcome. Stroke. 2016;47:2526–33.CrossRefPubMedPubMedCentral
23.
go back to reference Hage V. The NIH stroke scale: a window into neurological status. NurseCom Nursing Spectrum (Greater Chicago). 2011;24:44–9. Hage V. The NIH stroke scale: a window into neurological status. NurseCom Nursing Spectrum (Greater Chicago). 2011;24:44–9.
24.
go back to reference Mattishent K, Kwok CS, Ashkir L, Pelpola K, Myint PK, Loke YK. Prognostic tools for early mortality in hemorrhagic stroke: systematic review and meta-analysis. J Clin Neurol. 2015;11:339–48.CrossRefPubMedPubMedCentral Mattishent K, Kwok CS, Ashkir L, Pelpola K, Myint PK, Loke YK. Prognostic tools for early mortality in hemorrhagic stroke: systematic review and meta-analysis. J Clin Neurol. 2015;11:339–48.CrossRefPubMedPubMedCentral
25.
go back to reference Counsell C, Dennis M. Systematic review of prognostic models in patients with acute stroke. Cerebrovasc Dis. 2001;12:159–70.CrossRefPubMed Counsell C, Dennis M. Systematic review of prognostic models in patients with acute stroke. Cerebrovasc Dis. 2001;12:159–70.CrossRefPubMed
26.
go back to reference Thompson DD, Murray GD, Dennis M, Sudlow CL, Whiteley WN. Formal and informal prediction of recurrent stroke and myocardial infarction after stroke: a systematic review and evaluation of clinical prediction models in a new cohort. BMC Med. 2014;12:58.CrossRefPubMedPubMedCentral Thompson DD, Murray GD, Dennis M, Sudlow CL, Whiteley WN. Formal and informal prediction of recurrent stroke and myocardial infarction after stroke: a systematic review and evaluation of clinical prediction models in a new cohort. BMC Med. 2014;12:58.CrossRefPubMedPubMedCentral
Metadata
Title
Prognostic models for complete recovery in ischemic stroke: a systematic review and meta-analysis
Authors
Nampet Jampathong
Malinee Laopaiboon
Siwanon Rattanakanokchai
Porjai Pattanittum
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Neurology / Issue 1/2018
Electronic ISSN: 1471-2377
DOI
https://doi.org/10.1186/s12883-018-1032-5

Other articles of this Issue 1/2018

BMC Neurology 1/2018 Go to the issue