Skip to main content
Top
Published in: Neuroradiology 12/2018

01-12-2018 | Diagnostic Neuroradiology

Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software

Authors: Juliane Goebel, Elena Stenzel, Nika Guberina, Isabel Wanke, Martin Koehrmann, Christoph Kleinschnitz, Lale Umutlu, Michael Forsting, Christoph Moenninghoff, Alexander Radbruch

Published in: Neuroradiology | Issue 12/2018

Login to get access

Abstract

Purpose

Computer-aided diagnosis (CAD) appears promising in early ischemic change detection computed tomography (CT). This study aimed to compare the performance of two new CAD systems (Frontier ASPECTS Prototype and Brainomix) with two experienced readers in selected patients with suspected acute ischemic stroke.

Methods

Retrospectively, non-contrast brain CTs of 150 patients suspected for acute middle cerebral artery ischemia were analyzed with respect to ASPECTS first separately, than in consensus by two senior radiologists, and by use of Frontier and Brainomix. Besides the fully automatic Frontier and Brainomix readings (Frontier_1, Brainomix_1), readings adjusted for the affected brain side (known by CT angiography or clinical presentation, Frontier_2, Brainomix_2) were assessed. Statistical analysis was performed by intraclass correlation and Bland-Altman statistics.

Results

The score-based ASPECTS readings of Brainomix_1, Brainomix_2, both radiologists, and the expert consensus reading correlated highly (r = 0.714 to 0.841; always p < 0.001), whereas Frontier_1 and Frontier_2 correlated only lowly or moderately with both radiologists, the expert consensus reading, and Brainomix (r = 0.471 to 0.680; always p < 0.001). Bland-Altman analysis revealed lower mean ASPECT difference and standard deviation of difference for Brainomix_2 (mean difference = −0.2; SD = 1.15) compared to Frontier_2 (mean difference = 1.2; SD = 1.76). Correlation of region-based ASPECTS reading with the expert consensus reading was moderate for Brainomix_2 (r = 0.534), but only low for Frontier_2 (r = 0283; always p < 0.001).

Conclusion

We found high agreement in ASPECTS rating between both radiologists, expert consensus reading, and Brainomix, but only low to moderate agreement to Frontier.
Literature
1.
go back to reference Forsting M (2017) Machine learning will change medicine. J Nucl Med 58:357–358CrossRef Forsting M (2017) Machine learning will change medicine. J Nucl Med 58:357–358CrossRef
2.
go back to reference Obermeyer Z, Emanuel EJ (2016) Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 375:1216–1219CrossRef Obermeyer Z, Emanuel EJ (2016) Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med 375:1216–1219CrossRef
3.
go back to reference Erickson BJ, Korfiatis P, Akkus Z, Kline TL (2017) Machine learning for medical imaging. Radiographics 37:505–515CrossRef Erickson BJ, Korfiatis P, Akkus Z, Kline TL (2017) Machine learning for medical imaging. Radiographics 37:505–515CrossRef
4.
go back to reference Lee EJ, Kim YH, Kim N, Kang DW (2017) Deep into the brain: artificial intelligence in stroke imaging. J Stroke 19:277–285CrossRef Lee EJ, Kim YH, Kim N, Kang DW (2017) Deep into the brain: artificial intelligence in stroke imaging. J Stroke 19:277–285CrossRef
5.
go back to reference Barber PA, Demchuk AM, Zhang J, Buchan AM (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group Alberta Stroke Programme Early CT Score. Lancet 355:1670–1674CrossRef Barber PA, Demchuk AM, Zhang J, Buchan AM (2000) Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS Study Group Alberta Stroke Programme Early CT Score. Lancet 355:1670–1674CrossRef
6.
go back to reference Pexman JH, Barber PA, Hill MD et al (2001) Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol 22:1534–1542PubMed Pexman JH, Barber PA, Hill MD et al (2001) Use of the Alberta Stroke Program Early CT Score (ASPECTS) for assessing CT scans in patients with acute stroke. AJNR Am J Neuroradiol 22:1534–1542PubMed
7.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 351:h5527CrossRef Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 351:h5527CrossRef
8.
go back to reference von Kummer R, Meyding-Lamade U, Forsting M et al (1994) Sensitivity and prognostic value of early CT in occlusion of the middle cerebral artery trunk. AJNR Am J Neuroradiol 15:9–15 discussion 16-18 von Kummer R, Meyding-Lamade U, Forsting M et al (1994) Sensitivity and prognostic value of early CT in occlusion of the middle cerebral artery trunk. AJNR Am J Neuroradiol 15:9–15 discussion 16-18
9.
go back to reference Patel SC, Levine SR, Tilley BC et al (2001) Lack of clinical significance of early ischemic changes on computed tomography in acute stroke. JAMA 286:2830–2838CrossRef Patel SC, Levine SR, Tilley BC et al (2001) Lack of clinical significance of early ischemic changes on computed tomography in acute stroke. JAMA 286:2830–2838CrossRef
10.
go back to reference Frontier server user manuals ASPECT Score Prototype V1_2_0. Siemens Healthcare GmbH, Erlangen Frontier server user manuals ASPECT Score Prototype V1_2_0. Siemens Healthcare GmbH, Erlangen
11.
go back to reference Herweh C, Ringleb PA, Rauch G, Gerry S, Behrens L, Möhlenbruch M, Gottorf R, Richter D, Schieber S, Nagel S (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445CrossRef Herweh C, Ringleb PA, Rauch G, Gerry S, Behrens L, Möhlenbruch M, Gottorf R, Richter D, Schieber S, Nagel S (2016) Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 11:438–445CrossRef
12.
go back to reference Nagel S, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P, Warburton EA, Guyler P, Tysoe S, Fassbender K, Walter S, Essig M, Heidenrich J, Konstas AA, Harrison M, Papadakis M, Greveson E, Joly O, Gerry S, Maguire H, Roffe C, Hampton-Till J, Buchan AM, Grunwald IQ (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12:615–622CrossRef Nagel S, Sinha D, Day D, Reith W, Chapot R, Papanagiotou P, Warburton EA, Guyler P, Tysoe S, Fassbender K, Walter S, Essig M, Heidenrich J, Konstas AA, Harrison M, Papadakis M, Greveson E, Joly O, Gerry S, Maguire H, Roffe C, Hampton-Till J, Buchan AM, Grunwald IQ (2017) e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 12:615–622CrossRef
13.
go back to reference Pfaff J, Herweh C, Schieber S, Schönenberger S, Bösel J, Ringleb PA, Möhlenbruch M, Bendszus M, Nagel S (2017) e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 38:1594–1599CrossRef Pfaff J, Herweh C, Schieber S, Schönenberger S, Bösel J, Ringleb PA, Möhlenbruch M, Bendszus M, Nagel S (2017) e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. AJNR Am J Neuroradiol 38:1594–1599CrossRef
14.
go back to reference Mokin M, Primiani CT, Siddiqui AH, Turk AS (2017) ASPECTS (Alberta Stroke Program Early CT Score) measurement using Hounsfield unit values when selecting patients for stroke thrombectomy. Stroke 48:1574–1579CrossRef Mokin M, Primiani CT, Siddiqui AH, Turk AS (2017) ASPECTS (Alberta Stroke Program Early CT Score) measurement using Hounsfield unit values when selecting patients for stroke thrombectomy. Stroke 48:1574–1579CrossRef
15.
go back to reference Stoel BC, Marquering HA, Staring M et al (2015) Automated brain computed tomographic densitometry of early ischemic changes in acute stroke. J Med Imaging (Bellingham) 2:014004CrossRef Stoel BC, Marquering HA, Staring M et al (2015) Automated brain computed tomographic densitometry of early ischemic changes in acute stroke. J Med Imaging (Bellingham) 2:014004CrossRef
Metadata
Title
Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software
Authors
Juliane Goebel
Elena Stenzel
Nika Guberina
Isabel Wanke
Martin Koehrmann
Christoph Kleinschnitz
Lale Umutlu
Michael Forsting
Christoph Moenninghoff
Alexander Radbruch
Publication date
01-12-2018
Publisher
Springer Berlin Heidelberg
Published in
Neuroradiology / Issue 12/2018
Print ISSN: 0028-3940
Electronic ISSN: 1432-1920
DOI
https://doi.org/10.1007/s00234-018-2098-x

Other articles of this Issue 12/2018

Neuroradiology 12/2018 Go to the issue