Skip to main content
Top
Published in: Acta Neurochirurgica 3/2022

Open Access 01-03-2022 | Intracranial Aneurysm | Original Article - Vascular Neurosurgery - Aneurysm

Current decision support tools fail to agree or predict therapeutic decisions in a single cohort of unruptured intracranial aneurysms

Authors: Ahilan Kailaya-Vasan, Joseph Frantzias, Jayantan Kailaya-Vasan, Ian A. Anderson, Daniel C. Walsh

Published in: Acta Neurochirurgica | Issue 3/2022

Login to get access

Abstract

Background

There is limited evidence to direct the management of unruptured intracranial aneurysms. Models extrapolated from existing data have been proposed to guide treatment recommendations. The aim of this study is to assess whether a consensus-based treatment score (UIATS) or rupture rate estimation model (PHASES) can be used to benchmark UK multi-disciplinary team (MDT) practice.

Methods

Prospective data was collected on a consecutive series of all patients with unruptured intracranial aneurysms (UIAs) presenting to a major UK neurovascular centre between 2012 and 2015. The agreement between the UIATS and PHASES scores, and their sensitivity and specificity in predicting the real-world MDT outcome were calculated and compared.

Results

A total of 366 patients (456 aneurysms) were included in the analysis. The agreement between UIATS and MDT recommendation was low (weighted kappa 0.26 [95% CI 0.19, 0.32]); sensitivity and specificity were also low at 36% and 52% respectively. Groups that the MDT allocated to treatment, equipoise or no treatment had significantly different PHASES scores (p = 0.004). There was no significant difference between the two scores when predicting patients for whom MDT outcome was to recommend aneurysm treatment, but the UIATS score was superior in predicting patients who received an MDT recommendation of ‘treatment-equipoise’, or ‘not-for-treatment’ (AUC of 0.73 compared to 0.59 for PHASES).

Conclusions

The models studied failed to agree with the consensus view of multi-disciplinary team in a major neurovascular centre. We conclude that decision support tools such as the UIATS and PHASES scores should not be blindly introduced in respective institutions without prior internal validation, as they may not represent the local reality.
Literature
1.
go back to reference Alshafai N, Falenchuk O, Cusimano MD (2015) Practises and controversies in the management of asymptomatic aneurysms: results of an international survey. Br J Neurosurg 29(6):758–764CrossRef Alshafai N, Falenchuk O, Cusimano MD (2015) Practises and controversies in the management of asymptomatic aneurysms: results of an international survey. Br J Neurosurg 29(6):758–764CrossRef
2.
go back to reference Bijlenga P, Gondar R, Schilling S, Morel S, Hirsch S, Cuony J, Corniola M-V, Perren F, Rüfenacht D, Schaller K (2017) PHASES score for the management of intracranial aneurysm: a cross-sectional population-based retrospective study. Stroke 48(8):2105–2112CrossRef Bijlenga P, Gondar R, Schilling S, Morel S, Hirsch S, Cuony J, Corniola M-V, Perren F, Rüfenacht D, Schaller K (2017) PHASES score for the management of intracranial aneurysm: a cross-sectional population-based retrospective study. Stroke 48(8):2105–2112CrossRef
3.
go back to reference Connolly ESJ, Rabinstein AA, Carhuapoma JR et al (2012) Guidelines for the management of aneurysmal subarachnoid hemorrhage: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 43(6):1711–1737CrossRef Connolly ESJ, Rabinstein AA, Carhuapoma JR et al (2012) Guidelines for the management of aneurysmal subarachnoid hemorrhage: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 43(6):1711–1737CrossRef
4.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRef DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRef
5.
go back to reference Dhar S, Tremmel M, Mocco J, Kim M, Yamamoto J, Siddiqui AH, Hopkins LN, Meng H (2008) Morphology parameters for intracranial aneurysm rupture risk assessment. Neurosurgery 63(2):185–187CrossRef Dhar S, Tremmel M, Mocco J, Kim M, Yamamoto J, Siddiqui AH, Hopkins LN, Meng H (2008) Morphology parameters for intracranial aneurysm rupture risk assessment. Neurosurgery 63(2):185–187CrossRef
6.
go back to reference Dunn OJ (1961) Multiple comparisons among means. J Am Stat Assoc 56(293):52–64CrossRef Dunn OJ (1961) Multiple comparisons among means. J Am Stat Assoc 56(293):52–64CrossRef
7.
go back to reference Etminan N, Brown RDJ, Beseoglu K et al (2015) The unruptured intracranial aneurysm treatment score: a multidisciplinary consensus. Neurology 85(10):881–889CrossRef Etminan N, Brown RDJ, Beseoglu K et al (2015) The unruptured intracranial aneurysm treatment score: a multidisciplinary consensus. Neurology 85(10):881–889CrossRef
8.
go back to reference Gillani RL, Podraza KM, Luthra N, Origitano TC, Schneck MJ (2016) Factors influencing the management of unruptured intracranial aneurysms. Cureus 8(5):e601PubMedPubMedCentral Gillani RL, Podraza KM, Luthra N, Origitano TC, Schneck MJ (2016) Factors influencing the management of unruptured intracranial aneurysms. Cureus 8(5):e601PubMedPubMedCentral
9.
go back to reference Grant S, Booth M, Khodyakov D (2018) Lack of preregistered analysis plans allows unacceptable data mining for and selective reporting of consensus in Delphi studies. J Clin Epidemiol 99:96–105CrossRef Grant S, Booth M, Khodyakov D (2018) Lack of preregistered analysis plans allows unacceptable data mining for and selective reporting of consensus in Delphi studies. J Clin Epidemiol 99:96–105CrossRef
10.
go back to reference Greving JP, Wermer MJH, Brown RDJ et al (2014) Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol 13(1):59–66CrossRef Greving JP, Wermer MJH, Brown RDJ et al (2014) Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies. Lancet Neurol 13(1):59–66CrossRef
11.
go back to reference Guan J, Karsy M, Couldwell WT, Schmidt RH, Taussky P, MacDonald JD, Park MS (2016) Factors influencing management of unruptured intracranial aneurysms: an analysis of 424 consecutive patients. J Neurosurg JNS 127:96–101CrossRef Guan J, Karsy M, Couldwell WT, Schmidt RH, Taussky P, MacDonald JD, Park MS (2016) Factors influencing management of unruptured intracranial aneurysms: an analysis of 424 consecutive patients. J Neurosurg JNS 127:96–101CrossRef
13.
go back to reference Hop JW, Rinkel GJE, Algra A, van Gijn J (1997) Case-fatality rates and functional outcome after subarachnoid hemorrhage. Stroke 28(3):660–664CrossRef Hop JW, Rinkel GJE, Algra A, van Gijn J (1997) Case-fatality rates and functional outcome after subarachnoid hemorrhage. Stroke 28(3):660–664CrossRef
14.
go back to reference Kotowski M, Naggara O, Darsaut TE, Nolet S, Gevry G, Kouznetsov E, Raymond J (2013) Safety and occlusion rates of surgical treatment of unruptured intracranial aneurysms: a systematic review and meta-analysis of the literature from 1990 to 2011. J Neurol Neurosurg Psychiatry 84(1):42–48CrossRef Kotowski M, Naggara O, Darsaut TE, Nolet S, Gevry G, Kouznetsov E, Raymond J (2013) Safety and occlusion rates of surgical treatment of unruptured intracranial aneurysms: a systematic review and meta-analysis of the literature from 1990 to 2011. J Neurol Neurosurg Psychiatry 84(1):42–48CrossRef
15.
go back to reference Landis J, Koch G (1997) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRef Landis J, Koch G (1997) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRef
16.
go back to reference Mateo O, Valtueña M, Valés M, García-Leal R, del Valle M, Fortea F, Castro E (2018) Controversies on treatment of unruptured intracranial aneurysms. Value of UIATS and PHASES scores in a daily practice in a Spanish population. Interdiscip Neurosurg 13:49–55CrossRef Mateo O, Valtueña M, Valés M, García-Leal R, del Valle M, Fortea F, Castro E (2018) Controversies on treatment of unruptured intracranial aneurysms. Value of UIATS and PHASES scores in a daily practice in a Spanish population. Interdiscip Neurosurg 13:49–55CrossRef
17.
go back to reference McNemar Q (1947) Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12(2):153–157CrossRef McNemar Q (1947) Note on the sampling error of the difference between correlated proportions or percentages. Psychometrika 12(2):153–157CrossRef
19.
go back to reference Molyneux AJ, Kerr RS, Yu L-M, Clarke M, Sneade M, Yarnold JA, Sandercock P (2005) International subarachnoid aneurysm trial (ISAT) of neurosurgical clipping versus endovascular coiling in 2143 patients with ruptured intracranial aneurysms: a randomised comparison of effects on survival, dependency, seizures, rebleeding, subgroups, and aneurysm occlusion. Lancet 366(9488):809–817CrossRef Molyneux AJ, Kerr RS, Yu L-M, Clarke M, Sneade M, Yarnold JA, Sandercock P (2005) International subarachnoid aneurysm trial (ISAT) of neurosurgical clipping versus endovascular coiling in 2143 patients with ruptured intracranial aneurysms: a randomised comparison of effects on survival, dependency, seizures, rebleeding, subgroups, and aneurysm occlusion. Lancet 366(9488):809–817CrossRef
21.
go back to reference Ravindra VM, de Havenon A, Gooldy TC, Scoville J, Guan J, Couldwell WT, Taussky P, MacDonald JD, Schmidt RH, Park MS (2017) Validation of the unruptured intracranial aneurysm treatment score: comparison with real-world cerebrovascular practice. J Neurosurg 1–7 Ravindra VM, de Havenon A, Gooldy TC, Scoville J, Guan J, Couldwell WT, Taussky P, MacDonald JD, Schmidt RH, Park MS (2017) Validation of the unruptured intracranial aneurysm treatment score: comparison with real-world cerebrovascular practice. J Neurosurg 1–7
22.
go back to reference Ravindra VM, de Havenon A, Gooldy TC, Scoville J, Guan J, Couldwell WT, Taussky P, MacDonald JD, Schmidt RH, Park MS (2018) Validation of the unruptured intracranial aneurysm treatment score: comparison with real-world cerebrovascular practice. J Neurosurg 129(1):100–106CrossRef Ravindra VM, de Havenon A, Gooldy TC, Scoville J, Guan J, Couldwell WT, Taussky P, MacDonald JD, Schmidt RH, Park MS (2018) Validation of the unruptured intracranial aneurysm treatment score: comparison with real-world cerebrovascular practice. J Neurosurg 129(1):100–106CrossRef
23.
go back to reference Smedley A, Yusupov N, Almousa A, Solbach T, Toma AK, Grieve JP (2018) Management of incidental aneurysms: comparison of single centre multi-disciplinary team decision making with the unruptured incidental aneurysm treatment score. Br J Neurosurg 32(5):536–540CrossRef Smedley A, Yusupov N, Almousa A, Solbach T, Toma AK, Grieve JP (2018) Management of incidental aneurysms: comparison of single centre multi-disciplinary team decision making with the unruptured incidental aneurysm treatment score. Br J Neurosurg 32(5):536–540CrossRef
24.
go back to reference Stumpo V, Latour K, Trevisi G, Valente I, D’Arrigo S, Mangiola A, Olivi A, Sturiale CL (2020) Retrospective application of UIATS recommendations to a multicenter cohort of ruptured intracranial aneurysms: how it would have oriented the treatment choices? World Neurosurg 147:e262–e271CrossRef Stumpo V, Latour K, Trevisi G, Valente I, D’Arrigo S, Mangiola A, Olivi A, Sturiale CL (2020) Retrospective application of UIATS recommendations to a multicenter cohort of ruptured intracranial aneurysms: how it would have oriented the treatment choices? World Neurosurg 147:e262–e271CrossRef
25.
go back to reference Thompson BG, Brown RDJ, Amin-Hanjani S et al (2015) Guidelines for the management of patients with unruptured intracranial aneurysms: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46(8):2368–2400CrossRef Thompson BG, Brown RDJ, Amin-Hanjani S et al (2015) Guidelines for the management of patients with unruptured intracranial aneurysms: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 46(8):2368–2400CrossRef
26.
go back to reference Ujiie H, Tachi H, Hiramatsu O, Hazel AL, Matsumoto T, Ogasawara Y, Nakajima H, Hori T, Takakura K, Kajiya F (1999) Effects of size and shape (aspect ratio) on the hemodynamics of saccular aneurysms: a possible index for surgical treatment of intracranial aneurysms. Neurosurgery 45(1):119–130PubMed Ujiie H, Tachi H, Hiramatsu O, Hazel AL, Matsumoto T, Ogasawara Y, Nakajima H, Hori T, Takakura K, Kajiya F (1999) Effects of size and shape (aspect ratio) on the hemodynamics of saccular aneurysms: a possible index for surgical treatment of intracranial aneurysms. Neurosurgery 45(1):119–130PubMed
27.
go back to reference Vlak MH, Algra A, Brandenburg R, Rinkel GJ (2011) Prevalence of unruptured intracranial aneurysms, with emphasis on sex, age, comorbidity, country, and time period: a systematic review and meta-analysis. Lancet Neurol 10(7):626–636CrossRef Vlak MH, Algra A, Brandenburg R, Rinkel GJ (2011) Prevalence of unruptured intracranial aneurysms, with emphasis on sex, age, comorbidity, country, and time period: a systematic review and meta-analysis. Lancet Neurol 10(7):626–636CrossRef
28.
go back to reference Wiebers DO, Whisnant JP, Huston J 3rd et al (2003) Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet (London, England) 362(9378):103–110CrossRef Wiebers DO, Whisnant JP, Huston J 3rd et al (2003) Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet (London, England) 362(9378):103–110CrossRef
29.
go back to reference Wiebers DO, Whisnant JP, Sundt TM, O’Fallon WM (1987) The significance of unruptured intracranial saccular aneurysms. J Neurosurg 66(1):23–29CrossRef Wiebers DO, Whisnant JP, Sundt TM, O’Fallon WM (1987) The significance of unruptured intracranial saccular aneurysms. J Neurosurg 66(1):23–29CrossRef
30.
go back to reference Zacharia BE, Bruce SS, Carpenter AM et al (2014) Variability in outcome after elective cerebral aneurysm repair in high-volume academic medical centers. Stroke 45:1447–1452CrossRef Zacharia BE, Bruce SS, Carpenter AM et al (2014) Variability in outcome after elective cerebral aneurysm repair in high-volume academic medical centers. Stroke 45:1447–1452CrossRef
Metadata
Title
Current decision support tools fail to agree or predict therapeutic decisions in a single cohort of unruptured intracranial aneurysms
Authors
Ahilan Kailaya-Vasan
Joseph Frantzias
Jayantan Kailaya-Vasan
Ian A. Anderson
Daniel C. Walsh
Publication date
01-03-2022
Publisher
Springer Vienna
Published in
Acta Neurochirurgica / Issue 3/2022
Print ISSN: 0001-6268
Electronic ISSN: 0942-0940
DOI
https://doi.org/10.1007/s00701-021-04852-w

Other articles of this Issue 3/2022

Acta Neurochirurgica 3/2022 Go to the issue