Skip to main content
Top
Published in: European Radiology 11/2019

01-11-2019 | Stroke | Neuro

Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus

Authors: Friederike Austein, Fritz Wodarg, Nora Jürgensen, Monika Huhndorf, Johannes Meyne, Thomas Lindner, Olav Jansen, Naomi Larsen, Christian Riedel

Published in: European Radiology | Issue 11/2019

Login to get access

Abstract

Aim

The purpose of our study was to compare the agreement of both the total Alberta Stroke Program Early CT Score (ASPECTS) and region-based scores from two automated ASPECTS software packages and an expert consensus (EC) reading with final ASPECTS in a selected cohort of patients who had prompt reperfusion from endovascular thrombectomy (EVT).

Methods

ASPECTS were retrospectively and blindly assessed by two software packages and EC on baseline non-contrast-enhanced computed tomography (NCCT) images. All patients had multimodal CT imaging including NCCT, CT angiography, and CT perfusion which demonstrated an acute anterior circulation ischemic stroke with a large vessel occlusion. Final ASPECTS on follow-up scans in patients who had EVT and achieved complete reperfusion within 100 min from NCCT served as ground truth and were compared to total and region-based scores.

Results

Fifty-two patients met our study criteria. Moderate agreement was obtained between both software packages and EC for total ASPECTS and there was no significant difference in overall performance. However, the software packages differed with respect to regional contribution. In this cohort, the majority of infarcted regions were deep structures. Package A was more sensitive in cortical areas than the other methods, but at a cost of specificity. EC and software package B had greater sensitivity, but lower specificity for deep brain structures.

Conclusion

In this cohort, using the final ASPECTS as ground truth, no clinically significant difference was observed for total ASPECT score between human or automated packages, but there were differences in the characteristics of the regions scored.

Key Points

• Some national stroke guidelines have incorporated ASPECTS in their recommendations for selecting patients for endovascular therapy.
• Computer-aided diagnosis is a promising tool to aid the evaluation of early ischemic changes identified on CT.
• Software packages for automated ASPECTS assessment differed significantly with respect to regional contribution without any significant difference in the overall ASPECT score.
Literature
1.
go back to reference Barber PA, Demchuk AM, Zhang J, Buchan AM, Group AS (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet 355:1670–1674CrossRef Barber PA, Demchuk AM, Zhang J, Buchan AM, Group AS (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet 355:1670–1674CrossRef
2.
go back to reference Goyal M, Menon BK, Van Zwam WH et al (2016) Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 387:1723–1731CrossRef Goyal M, Menon BK, Van Zwam WH et al (2016) Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 387:1723–1731CrossRef
3.
go back to reference Powers WJ, Derdeyn CP, Biller J et al (2015) 2015 American Heart Association/American Stroke Association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46:3020–3035CrossRef Powers WJ, Derdeyn CP, Biller J et al (2015) 2015 American Heart Association/American Stroke Association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46:3020–3035CrossRef
4.
go back to reference Farzin B, Fahed R, Guilbert F et al (2016) Early CT changes in patients admitted for thrombectomy intrarater and interrater agreement. Neurology 87:249–256CrossRef Farzin B, Fahed R, Guilbert F et al (2016) Early CT changes in patients admitted for thrombectomy intrarater and interrater agreement. Neurology 87:249–256CrossRef
5.
go back to reference Wilson AT, Dey S, Evans JW, Najm M, Qiu W, Menon BK (2018) Minds treating brains: understanding the interpretation of non-contrast CT ASPECTS in acute ischemic stroke. Expert Rev Cardiovasc Ther 16:143–153CrossRef Wilson AT, Dey S, Evans JW, Najm M, Qiu W, Menon BK (2018) Minds treating brains: understanding the interpretation of non-contrast CT ASPECTS in acute ischemic stroke. Expert Rev Cardiovasc Ther 16:143–153CrossRef
6.
go back to reference Kottner J, Audigé L, Brorson S et al (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud 48:661–671CrossRef Kottner J, Audigé L, Brorson S et al (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Int J Nurs Stud 48:661–671CrossRef
7.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–W12CrossRef Bossuyt PM, Reitsma JB, Bruns DE et al (2003) The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 138:W1–W12CrossRef
8.
go back to reference Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420CrossRef Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420CrossRef
9.
go back to reference Herweh C, Ringleb PA, Rauch G et al (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445CrossRef Herweh C, Ringleb PA, Rauch G et al (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445CrossRef
10.
go back to reference Nagel S, Sinha D, Day D et al (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12:615–622CrossRef Nagel S, Sinha D, Day D et al (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12:615–622CrossRef
11.
go back to reference Gupta AC, Schaefer PW, Chaudhry ZA et al (2012) Interobserver reliability of baseline noncontrast CT Alberta Stroke Program Early CT Score for intra-arterial stroke treatment selection. AJNR Am J Neuroradiol 33:1046–1049CrossRef Gupta AC, Schaefer PW, Chaudhry ZA et al (2012) Interobserver reliability of baseline noncontrast CT Alberta Stroke Program Early CT Score for intra-arterial stroke treatment selection. AJNR Am J Neuroradiol 33:1046–1049CrossRef
12.
go back to reference Pexman JH, Barber PA, Hill MD et al (2001) Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol 22:1534–1542PubMed Pexman JH, Barber PA, Hill MD et al (2001) Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol 22:1534–1542PubMed
13.
go back to reference Khan M, Baird GL, Goddeau RP Jr, Silver B, Henninger N (2017) Alberta Stroke Program Early CT Score infarct location predicts outcome following M2 occlusion. Front Neurol 8:98CrossRef Khan M, Baird GL, Goddeau RP Jr, Silver B, Henninger N (2017) Alberta Stroke Program Early CT Score infarct location predicts outcome following M2 occlusion. Front Neurol 8:98CrossRef
14.
go back to reference Sheth SA, Malhotra K, Liebeskind DS et al (2018) Regional contributions to poststroke disability in endovascular therapy. Interv Neurol 7:533–543CrossRef Sheth SA, Malhotra K, Liebeskind DS et al (2018) Regional contributions to poststroke disability in endovascular therapy. Interv Neurol 7:533–543CrossRef
15.
go back to reference van der Zwan A, Hillen B, Tulleken CA, Dujovny M, Dragovic L (1992) Variability of the territories of the major cerebral arteries. J Neurosurg 77:927–940CrossRef van der Zwan A, Hillen B, Tulleken CA, Dujovny M, Dragovic L (1992) Variability of the territories of the major cerebral arteries. J Neurosurg 77:927–940CrossRef
17.
go back to reference Pfaff J, Herweh C, Schieber S et al (2017) e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 38:1594–1599CrossRef Pfaff J, Herweh C, Schieber S et al (2017) e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 38:1594–1599CrossRef
Metadata
Title
Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus
Authors
Friederike Austein
Fritz Wodarg
Nora Jürgensen
Monika Huhndorf
Johannes Meyne
Thomas Lindner
Olav Jansen
Naomi Larsen
Christian Riedel
Publication date
01-11-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 11/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-019-06252-2

Other articles of this Issue 11/2019

European Radiology 11/2019 Go to the issue