Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Study protocol

The Ottawa SAH search algorithms: protocol for a multi- centre validation study of primary subarachnoid hemorrhage prediction models using health administrative data (the SAHepi prediction study protocol)

Authors: S. W. English, L. McIntyre, V. Saigle, M. Chassé, D. A. Fergusson, A. F. Turgeon, F. Lauzier, D. Griesdale, A. Garland, R. Zarychanski, A. Algird, C. van Walraven

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Conducting prospective epidemiological studies of hospitalized patients with rare diseases like primary subarachnoid hemorrhage (pSAH) are difficult due to time and budgetary constraints. Routinely collected administrative data could remove these barriers. We derived and validated 3 algorithms to identify hospitalized patients with a high probability of pSAH using administrative data. We aim to externally validate their performance in four hospitals across Canada.

Methods

Eligible patients include those ≥18 years of age admitted to these centres from January 1, 2012 to December 31, 2013. We will include patients whose discharge abstracts contain predictive variables identified in the models (ICD-10-CA diagnostic codes I60** (subarachnoid hemorrhage), I61** (intracranial hemorrhage), 162** (other nontrauma intracranial hemorrhage), I67** (other cerebrovascular disease), S06** (intracranial injury), G97 (other postprocedural nervous system disorder) and CCI procedural codes 1JW51 (occlusion of intracranial vessels), 1JE51 (carotid artery inclusion), 3JW10 (intracranial vessel imaging), 3FY20 (CT scan (soft tissue of neck)), and 3OT20 (CT scan (abdominal cavity)). The algorithms will be applied to each patient and the diagnosis confirmed via chart review. We will assess each model’s sensitivity, specificity, negative and positive predictive value across the sites.

Discussion

Validating the Ottawa SAH Prediction Algorithms will provide a way to accurately identify large SAH cohorts, thereby furthering research and altering care.
Literature
1.
go back to reference Bonita R, Beaglehole R, North JD. Subarachnoid hemorrhage in New Zealand: an epidemiological study. Stroke A J Cereb Circ. 1983;14:342–7.CrossRef Bonita R, Beaglehole R, North JD. Subarachnoid hemorrhage in New Zealand: an epidemiological study. Stroke A J Cereb Circ. 1983;14:342–7.CrossRef
2.
go back to reference Ostbye T, Levy AR, Mayo NE. Hospitalization and case-fatality rates for subarachnoid hemorrhage in Canada from 1982 through 1991. The Canadian collaborative study Group of Stroke Hospitalizations. Stroke. 1997;28:793–8.CrossRef Ostbye T, Levy AR, Mayo NE. Hospitalization and case-fatality rates for subarachnoid hemorrhage in Canada from 1982 through 1991. The Canadian collaborative study Group of Stroke Hospitalizations. Stroke. 1997;28:793–8.CrossRef
3.
go back to reference Knekt P, Reunanen A, Aho K, Heliövaara M, Rissanen A, Aromaa A, et al. Risk factors for subarachnoid hemorrhage in a longitudinal population study. J Clin Epidemiol. 1991;44:933–9.CrossRef Knekt P, Reunanen A, Aho K, Heliövaara M, Rissanen A, Aromaa A, et al. Risk factors for subarachnoid hemorrhage in a longitudinal population study. J Clin Epidemiol. 1991;44:933–9.CrossRef
4.
go back to reference Van GJ, GJE R. Subarachnoid haemorrhage: diagnosis , causes and management. Brain. 2001;124:249–78.CrossRef Van GJ, GJE R. Subarachnoid haemorrhage: diagnosis , causes and management. Brain. 2001;124:249–78.CrossRef
5.
go back to reference Bederson JB, Connolly ES, Batjer HH, Dacey RG, Dion JE, Diringer MN, et al. Guidelines for the management of aneurysmal subarachnoid hemorrhage: a statement for healthcare professionals from a special writing group of the stroke council, American Heart Association. Stroke. Acm. 2009;40:994–1025.CrossRef Bederson JB, Connolly ES, Batjer HH, Dacey RG, Dion JE, Diringer MN, et al. Guidelines for the management of aneurysmal subarachnoid hemorrhage: a statement for healthcare professionals from a special writing group of the stroke council, American Heart Association. Stroke. Acm. 2009;40:994–1025.CrossRef
6.
go back to reference Connolly ES, Rabinstein AA, Carhuapoma JR, Derdeyn CP, Dion J, Higashida RT, et al. Guidelines for the management of aneurysmal subarachnoid hemorrhage: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2012;43:1711–37.CrossRef Connolly ES, Rabinstein AA, Carhuapoma JR, Derdeyn CP, Dion J, Higashida RT, et al. Guidelines for the management of aneurysmal subarachnoid hemorrhage: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2012;43:1711–37.CrossRef
7.
go back to reference de Rooij NK, Linn FHH, van der Plas JA, Algra A, Rinkel GJE. Incidence of subarachnoid haemorrhage: a systematic review with emphasis on region, age, gender and time trends. J Neurol Neurosurg Psychiatry BMJ Group. 2007;78:1365–72.CrossRef de Rooij NK, Linn FHH, van der Plas JA, Algra A, Rinkel GJE. Incidence of subarachnoid haemorrhage: a systematic review with emphasis on region, age, gender and time trends. J Neurol Neurosurg Psychiatry BMJ Group. 2007;78:1365–72.CrossRef
8.
go back to reference Williams GR, Jiang JG, Matchar DB, Samsa GP. Incidence and Occurrence of Total (first-ever and recurrent) stroke. Stroke. 1999;30:2523–8.CrossRef Williams GR, Jiang JG, Matchar DB, Samsa GP. Incidence and Occurrence of Total (first-ever and recurrent) stroke. Stroke. 1999;30:2523–8.CrossRef
9.
go back to reference Ingall T, Asplund K, Mähönen M, Bonita R. A multinational comparison of subarachnoid hemorrhage epidemiology in the WHO MONICA stroke study. Stroke A J Cereb Circ Am Heart Assoc. 2000;31:1054–61.CrossRef Ingall T, Asplund K, Mähönen M, Bonita R. A multinational comparison of subarachnoid hemorrhage epidemiology in the WHO MONICA stroke study. Stroke A J Cereb Circ Am Heart Assoc. 2000;31:1054–61.CrossRef
10.
go back to reference Pobereskin LH. Incidence and outcome of subarachnoid haemorrhage: a retrospective population based study. J. Neurol. Neurosurg. Psychiatry. BMJ Group. 2001;70:340–3.CrossRef Pobereskin LH. Incidence and outcome of subarachnoid haemorrhage: a retrospective population based study. J. Neurol. Neurosurg. Psychiatry. BMJ Group. 2001;70:340–3.CrossRef
11.
go back to reference Sandvei MS, Mathiesen EB, Vatten LJ, Müller TB, Lindekleiv H, Ingebrigtsen T, et al. Incidence and mortality of aneurysmal subarachnoid hemorrhage in two Norwegian cohorts, 1984-2007. Neurology. 2011;77:1833–9.CrossRef Sandvei MS, Mathiesen EB, Vatten LJ, Müller TB, Lindekleiv H, Ingebrigtsen T, et al. Incidence and mortality of aneurysmal subarachnoid hemorrhage in two Norwegian cohorts, 1984-2007. Neurology. 2011;77:1833–9.CrossRef
12.
go back to reference Zimmerman JE, Kramer AA, Knaus WA. Changes in hospital mortality for United States intensive care unit admissions from 1988 to 2012. Crit Care. 2013;17:R81.CrossRef Zimmerman JE, Kramer AA, Knaus WA. Changes in hospital mortality for United States intensive care unit admissions from 1988 to 2012. Crit Care. 2013;17:R81.CrossRef
13.
go back to reference Ellekjaer H, Holmen J, Krüger O, Terent A. Identification of incident stroke in Norway: hospital discharge data compared with a population-based stroke register. Stroke. 1999;30:56–60.CrossRef Ellekjaer H, Holmen J, Krüger O, Terent A. Identification of incident stroke in Norway: hospital discharge data compared with a population-based stroke register. Stroke. 1999;30:56–60.CrossRef
14.
go back to reference Mayo NE, Chockalingam A, Reeder BA, Phillips S. Surveillance for stroke in Canada. Heal. Reports/stat. Canada, can. Cent. Heal. Inf. - Rapp. Sur la santé/stat. Canada, cent. Can. d’information Sur la santé. 1994;6:62–72. Mayo NE, Chockalingam A, Reeder BA, Phillips S. Surveillance for stroke in Canada. Heal. Reports/stat. Canada, can. Cent. Heal. Inf. - Rapp. Sur la santé/stat. Canada, cent. Can. d’information Sur la santé. 1994;6:62–72.
15.
go back to reference Liu L, Reeder B, Shuaib A, Mazagri R. Validity of stroke diagnosis on hospital discharge records in Saskatchewan, Canada: implications for stroke surveillance. Cerebrovasc Dis. 1993;9:224–30.CrossRef Liu L, Reeder B, Shuaib A, Mazagri R. Validity of stroke diagnosis on hospital discharge records in Saskatchewan, Canada: implications for stroke surveillance. Cerebrovasc Dis. 1993;9:224–30.CrossRef
16.
go back to reference Phillips S, Cameron K, Chung C. Stroke surveillance revisited. Can. J Cardiol. 1993;9(Suppl D):124–5. Phillips S, Cameron K, Chung C. Stroke surveillance revisited. Can. J Cardiol. 1993;9(Suppl D):124–5.
17.
go back to reference Mayo N, Danys I, Carleton J. Validity of hospital discharge diagnosis of stroke. Can. J Cardiol. 1993;9(Suppl D):121–4. Mayo N, Danys I, Carleton J. Validity of hospital discharge diagnosis of stroke. Can. J Cardiol. 1993;9(Suppl D):121–4.
18.
go back to reference Tirschwell DL. Validating administrative data in stroke research. Stroke. 2002;33:2465–70.CrossRef Tirschwell DL. Validating administrative data in stroke research. Stroke. 2002;33:2465–70.CrossRef
19.
go back to reference Jones SA, Gottesman RF, Shahar E, Wruck L, Rosamond WD. Validity of hospital discharge diagnosis codes for stroke: the atherosclerosis risk in communities study. Stroke. 2014;45:3219–25.CrossRef Jones SA, Gottesman RF, Shahar E, Wruck L, Rosamond WD. Validity of hospital discharge diagnosis codes for stroke: the atherosclerosis risk in communities study. Stroke. 2014;45:3219–25.CrossRef
20.
go back to reference English SW, McIntyre L, Fergusson D, Turgeon A, Sun C, Dos Santos MP, et al. Enriched administrative data can be used to retrospectively identify all known cases of primary subarachnoid hemorrhage. J Clin Epidemiol. 2016;70:146–54.CrossRef English SW, McIntyre L, Fergusson D, Turgeon A, Sun C, Dos Santos MP, et al. Enriched administrative data can be used to retrospectively identify all known cases of primary subarachnoid hemorrhage. J Clin Epidemiol. 2016;70:146–54.CrossRef
21.
go back to reference English SW, McIntyre L, Fergusson D, Turgeon A, Dos Santos MP, Lum C, et al. Subarachnoid hemorrhage admissions retrospectively identified using a prediction model. Neurology. 2016;87:1557–64.CrossRef English SW, McIntyre L, Fergusson D, Turgeon A, Dos Santos MP, Lum C, et al. Subarachnoid hemorrhage admissions retrospectively identified using a prediction model. Neurology. 2016;87:1557–64.CrossRef
22.
go back to reference Sullivan LM, Massaro JM, D’Agostino RB. Presentation of multivariate data for clinical use: The Framingham Study risk score functions. Stat Med. 2004;23:1631–1660.CrossRef Sullivan LM, Massaro JM, D’Agostino RB. Presentation of multivariate data for clinical use: The Framingham Study risk score functions. Stat Med. 2004;23:1631–1660.CrossRef
23.
go back to reference Austin PC, Steyerberg EW. Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models. Stat Methods Med Res. SAGE Publications. 2017;26:796–808.CrossRef Austin PC, Steyerberg EW. Events per variable (EPV) and the relative performance of different strategies for estimating the out-of-sample validity of logistic regression models. Stat Methods Med Res. SAGE Publications. 2017;26:796–808.CrossRef
24.
go back to reference English SW, Chasse M, Turgeon A, Lauzier F, Griesdale D, Garland A, et al. Aneurysmal subarachnoid hemorrhage and anemia: a Canadian multi-Centre retrospective cohort study. Crit. Care. 2016;20:P337. English SW, Chasse M, Turgeon A, Lauzier F, Griesdale D, Garland A, et al. Aneurysmal subarachnoid hemorrhage and anemia: a Canadian multi-Centre retrospective cohort study. Crit. Care. 2016;20:P337.
25.
go back to reference English SW, Chasse M, Turgeon A, Lauzier F, Griesdale D, Garland A, et al. Red blood cell transfusion in aneurysmal subarachnoid hemorrhage – the Sahara cohort study. Crit. Care. 2016;20:P336. English SW, Chasse M, Turgeon A, Lauzier F, Griesdale D, Garland A, et al. Red blood cell transfusion in aneurysmal subarachnoid hemorrhage – the Sahara cohort study. Crit. Care. 2016;20:P336.
26.
go back to reference Bewick V, Cheek L, Ball J. Statistics review 13: receiver operating characteristic curves. Crit Care. 2004;8:508–12.CrossRef Bewick V, Cheek L, Ball J. Statistics review 13: receiver operating characteristic curves. Crit Care. 2004;8:508–12.CrossRef
27.
go back to reference Leibson CL, Naessens JM, Brown RD, Whisnant JP. Accuracy of hospital discharge abstracts for identifying stroke. Stroke. 1994;25:2348–55.CrossRef Leibson CL, Naessens JM, Brown RD, Whisnant JP. Accuracy of hospital discharge abstracts for identifying stroke. Stroke. 1994;25:2348–55.CrossRef
28.
go back to reference Broderick J, Brott T, Kothari R, Miller R, Khoury J, Pancioli A, et al. The greater Cincinnati/northern Kentucky stroke study: preliminary first-ever and total incidence rates of stroke among blacks. Stroke. 1998;29:415–21.CrossRef Broderick J, Brott T, Kothari R, Miller R, Khoury J, Pancioli A, et al. The greater Cincinnati/northern Kentucky stroke study: preliminary first-ever and total incidence rates of stroke among blacks. Stroke. 1998;29:415–21.CrossRef
29.
go back to reference Rosamond WD, Folsom AR, Chambless LE, Wang CH, McGovern PG, Howard G, et al. Stroke incidence and survival among middle-aged adults: 9-year follow-up of the atherosclerosis risk in communities (ARIC) cohort. Stroke. 1999;30:736–43.CrossRef Rosamond WD, Folsom AR, Chambless LE, Wang CH, McGovern PG, Howard G, et al. Stroke incidence and survival among middle-aged adults: 9-year follow-up of the atherosclerosis risk in communities (ARIC) cohort. Stroke. 1999;30:736–43.CrossRef
30.
go back to reference Roumie CL, Mitchel E, Gideon PS, Varas-Lorenzo C, Castellsague J, Griffin MR. Validation of ICD-9 codes with a high positive predictive value for incident strokes resulting in hospitalization using Medicaid health data. Pharmacoepidemiol Drug Saf. 2008;17(1):20–6.CrossRef Roumie CL, Mitchel E, Gideon PS, Varas-Lorenzo C, Castellsague J, Griffin MR. Validation of ICD-9 codes with a high positive predictive value for incident strokes resulting in hospitalization using Medicaid health data. Pharmacoepidemiol Drug Saf. 2008;17(1):20–6.CrossRef
31.
go back to reference Kokotailo R a, Hill MD. Coding of stroke and stroke risk factors using international classification of diseases, revisions 9 and 10. Stroke. 2005;36(8):1776–81.CrossRef Kokotailo R a, Hill MD. Coding of stroke and stroke risk factors using international classification of diseases, revisions 9 and 10. Stroke. 2005;36(8):1776–81.CrossRef
Metadata
Title
The Ottawa SAH search algorithms: protocol for a multi- centre validation study of primary subarachnoid hemorrhage prediction models using health administrative data (the SAHepi prediction study protocol)
Authors
S. W. English
L. McIntyre
V. Saigle
M. Chassé
D. A. Fergusson
A. F. Turgeon
F. Lauzier
D. Griesdale
A. Garland
R. Zarychanski
A. Algird
C. van Walraven
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0553-3

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue