Skip to main content
Top
Published in: BMC Medicine 1/2016

Open Access 01-12-2016 | Research article

Predicting dementia risk in primary care: development and validation of the Dementia Risk Score using routinely collected data

Authors: K. Walters, S. Hardoon, I. Petersen, S. Iliffe, R. Z. Omar, I. Nazareth, G. Rait

Published in: BMC Medicine | Issue 1/2016

Login to get access

Abstract

Background

Existing dementia risk scores require collection of additional data from patients, limiting their use in practice. Routinely collected healthcare data have the potential to assess dementia risk without the need to collect further information. Our objective was to develop and validate a 5-year dementia risk score derived from primary healthcare data.

Methods

We used data from general practices in The Health Improvement Network (THIN) database from across the UK, randomly selecting 377 practices for a development cohort and identifying 930,395 patients aged 60–95 years without a recording of dementia, cognitive impairment or memory symptoms at baseline. We developed risk algorithm models for two age groups (60–79 and 80–95 years). An external validation was conducted by validating the model on a separate cohort of 264,224 patients from 95 randomly chosen THIN practices that did not contribute to the development cohort. Our main outcome was 5-year risk of first recorded dementia diagnosis. Potential predictors included sociodemographic, cardiovascular, lifestyle and mental health variables.

Results

Dementia incidence was 1.88 (95 % CI, 1.83–1.93) and 16.53 (95 % CI, 16.15–16.92) per 1000 PYAR for those aged 60–79 (n = 6017) and 80–95 years (n = 7104), respectively. Predictors for those aged 60–79 included age, sex, social deprivation, smoking, BMI, heavy alcohol use, anti-hypertensive drugs, diabetes, stroke/TIA, atrial fibrillation, aspirin, depression. The discrimination and calibration of the risk algorithm were good for the 60–79 years model; D statistic 2.03 (95 % CI, 1.95–2.11), C index 0.84 (95 % CI, 0.81–0.87), and calibration slope 0.98 (95 % CI, 0.93–1.02). The algorithm had a high negative predictive value, but lower positive predictive value at most risk thresholds. Discrimination and calibration were poor for the 80–95 years model.

Conclusions

Routinely collected data predicts 5-year risk of recorded diagnosis of dementia for those aged 60–79, but not those aged 80+. This algorithm can identify higher risk populations for dementia in primary care. The risk score has a high negative predictive value and may be most helpful in ‘ruling out’ those at very low risk from further testing or intensive preventative activities.
Appendix
Available only for authorised users
Literature
1.
go back to reference Alzheimer’s Disease International. World Alzheimer Report 2009. London: Alzheimer’s Disease International; 2009. Alzheimer’s Disease International. World Alzheimer Report 2009. London: Alzheimer’s Disease International; 2009.
2.
go back to reference Alzheimer’s Disease International. World Alzheimer Report 2010: The Global Economic Impact of Dementia. London: Alzheimer’s Disease International; 2010. Alzheimer’s Disease International. World Alzheimer Report 2010: The Global Economic Impact of Dementia. London: Alzheimer’s Disease International; 2010.
3.
go back to reference Norton S, Matthews FE, Barnes D, Yaffe K, Brayne C. Potential for primary prevention of Alzheimer’s disease: an analysis of population-based data. Lancet Neurol. 2014;13:788–94.CrossRefPubMed Norton S, Matthews FE, Barnes D, Yaffe K, Brayne C. Potential for primary prevention of Alzheimer’s disease: an analysis of population-based data. Lancet Neurol. 2014;13:788–94.CrossRefPubMed
5.
go back to reference Lincoln P, Fenton K, Alessi C, Prince M, Brayne C, Wortmann M, et al. The Blackfriars Consensus on brain health and dementia. Lancet. 2014;383(9931):1805–6.CrossRefPubMed Lincoln P, Fenton K, Alessi C, Prince M, Brayne C, Wortmann M, et al. The Blackfriars Consensus on brain health and dementia. Lancet. 2014;383(9931):1805–6.CrossRefPubMed
7.
go back to reference Boorson S, Frank L, Bayley PJ, Boustani M, Dean M, Lin PJ, et al. Improving dementia care: the role of screening and detection of cognitive impairment. Alzheimers Dement. 2013;9:151–9.CrossRef Boorson S, Frank L, Bayley PJ, Boustani M, Dean M, Lin PJ, et al. Improving dementia care: the role of screening and detection of cognitive impairment. Alzheimers Dement. 2013;9:151–9.CrossRef
9.
go back to reference Stephan BC, Brayne C. Risk factors and screening methods for detecting dementia: a narrative review. J Alzheimers Dis. 2014;42 Suppl 4:S329–38. doi:10.3233/JAD-141413.PubMed Stephan BC, Brayne C. Risk factors and screening methods for detecting dementia: a narrative review. J Alzheimers Dis. 2014;42 Suppl 4:S329–38. doi:10.​3233/​JAD-141413.PubMed
10.
go back to reference Stephan BC, Kurth T, Matthews FE, Brayne C, Dufouil C. Dementia risk prediction in the population: are screening models accurate? Nat Rev Neurol. 2010;6:318–26.CrossRefPubMed Stephan BC, Kurth T, Matthews FE, Brayne C, Dufouil C. Dementia risk prediction in the population: are screening models accurate? Nat Rev Neurol. 2010;6:318–26.CrossRefPubMed
12.
go back to reference Kivipelto M, Ngandu T, Laatikainen T, Winblad B, Soininen H, Tuomilehto J. Risk score for the prediction of dementia risk in 20 years among middle aged people: a longitudinal, population-based study. Lancet Neurol. 2006;5:735–41.CrossRefPubMed Kivipelto M, Ngandu T, Laatikainen T, Winblad B, Soininen H, Tuomilehto J. Risk score for the prediction of dementia risk in 20 years among middle aged people: a longitudinal, population-based study. Lancet Neurol. 2006;5:735–41.CrossRefPubMed
13.
go back to reference Barnes DE, Covinsky KE, Whitmer RA, Kuller LH, Lopez OL, Yaffe K. Predicting risk of dementia in older adults: the late-life dementia risk index. Neurology. 2009;73:173–9.PubMedCentralCrossRefPubMed Barnes DE, Covinsky KE, Whitmer RA, Kuller LH, Lopez OL, Yaffe K. Predicting risk of dementia in older adults: the late-life dementia risk index. Neurology. 2009;73:173–9.PubMedCentralCrossRefPubMed
14.
go back to reference Reitz C, Tang MX, Schupf N, Manly JJ, Mayeux R, Luchsinger JA. A summary risk score for the prediction of Alzheimer disease in elderly persons. Arch Neurol. 2010;67:835–41.PubMedCentralPubMed Reitz C, Tang MX, Schupf N, Manly JJ, Mayeux R, Luchsinger JA. A summary risk score for the prediction of Alzheimer disease in elderly persons. Arch Neurol. 2010;67:835–41.PubMedCentralPubMed
15.
go back to reference Jessen F, Wiese B, Bickel H, Eifflander-Gorfer S, Fuchs A, Kaduszkiewicz H, et al. Prediction of dementia in primary care patients. PLoS One. 2011;6, e16852.PubMedCentralCrossRefPubMed Jessen F, Wiese B, Bickel H, Eifflander-Gorfer S, Fuchs A, Kaduszkiewicz H, et al. Prediction of dementia in primary care patients. PLoS One. 2011;6, e16852.PubMedCentralCrossRefPubMed
16.
17.
go back to reference Wolfsgruber S, Jessen F, Wiese B, Stein J, Bickel H, Mösch E, et al. The CERAD neuropsychological assessment battery total score detects and predicts Alzheimer disease dementia with high diagnostic accuracy. Am J Geriatric Psych. 2014;22(10):1017–28. doi:10.1016/j.jagp.2012.08.021.CrossRef Wolfsgruber S, Jessen F, Wiese B, Stein J, Bickel H, Mösch E, et al. The CERAD neuropsychological assessment battery total score detects and predicts Alzheimer disease dementia with high diagnostic accuracy. Am J Geriatric Psych. 2014;22(10):1017–28. doi:10.​1016/​j.​jagp.​2012.​08.​021.CrossRef
19.
go back to reference Barnes DE, Beiser AS, Lee A, Langer KM, Koyama A, Pries SR, et al. Development and validation of a brief dementia screening indicator for primary care. Alzheimers Dement. 2014;10(6):656–65.e1. doi:10.1016/j.jalz.2013.11.006. Barnes DE, Beiser AS, Lee A, Langer KM, Koyama A, Pries SR, et al. Development and validation of a brief dementia screening indicator for primary care. Alzheimers Dement. 2014;10(6):656–65.e1. doi:10.​1016/​j.​jalz.​2013.​11.​006.
21.
go back to reference Collins GS, Altman D. Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2. BMJ. 2012;344, e4181.PubMedCentralCrossRefPubMed Collins GS, Altman D. Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2. BMJ. 2012;344, e4181.PubMedCentralCrossRefPubMed
23.
go back to reference Blak BT, Thompson M, Dattani H, Bourke A. Generalisability of The Health Improvement Network (THIN) database: demographics, chronic disease prevalence and mortality rates. Inform Prim Care. 2011;19:251–5.PubMed Blak BT, Thompson M, Dattani H, Bourke A. Generalisability of The Health Improvement Network (THIN) database: demographics, chronic disease prevalence and mortality rates. Inform Prim Care. 2011;19:251–5.PubMed
24.
go back to reference Townsend P, Phillimore P, Beattie A. Inequalities in health in the northern region. Newcastle-upon-Tyne: Northern Regional Health Authority and University of Bristol; 1986. Townsend P, Phillimore P, Beattie A. Inequalities in health in the northern region. Newcastle-upon-Tyne: Northern Regional Health Authority and University of Bristol; 1986.
25.
go back to reference Lewis JD, Schinnar R, Bilker WB, Wang X, Strom BL. Validation studies of the health improvement network (THIN) database for pharmacoepidemiology research. Pharmacoepidemiol Drug Saf. 2007;16:393–401.CrossRefPubMed Lewis JD, Schinnar R, Bilker WB, Wang X, Strom BL. Validation studies of the health improvement network (THIN) database for pharmacoepidemiology research. Pharmacoepidemiol Drug Saf. 2007;16:393–401.CrossRefPubMed
26.
go back to reference Ruigómez A, Martín-Merino E, Rodríguez LA. Validation of ischemic cerebrovascular diagnoses in the health improvement network (THIN). Pharmacoepidemiol Drug Saf. 2010;19:579–85.CrossRefPubMed Ruigómez A, Martín-Merino E, Rodríguez LA. Validation of ischemic cerebrovascular diagnoses in the health improvement network (THIN). Pharmacoepidemiol Drug Saf. 2010;19:579–85.CrossRefPubMed
27.
go back to reference Dunn N, Mullee M, Perry VH, Holmes C. Association between dementia and infectious disease: evidence from a case–control study. Alzheimer Dis Assoc Disord. 2005;19:91–4.CrossRefPubMed Dunn N, Mullee M, Perry VH, Holmes C. Association between dementia and infectious disease: evidence from a case–control study. Alzheimer Dis Assoc Disord. 2005;19:91–4.CrossRefPubMed
28.
go back to reference Rait G, Walters K, Bottomley C, Petersen I, Iliffe S, Nazareth I. Survival of people with clinical diagnosis of dementia in primary care: cohort study. BMJ. 2010;341:c3584.PubMedCentralCrossRefPubMed Rait G, Walters K, Bottomley C, Petersen I, Iliffe S, Nazareth I. Survival of people with clinical diagnosis of dementia in primary care: cohort study. BMJ. 2010;341:c3584.PubMedCentralCrossRefPubMed
29.
go back to reference Grant R, Drennan V, Rait G, Petersen I, Iliffe S. First diagnosis and management of incontinence in older people with and without dementia in primary care: a cohort study using The Health Improvement Network primary care database. PLoS Med. 2013;10, e1001505.PubMedCentralCrossRefPubMed Grant R, Drennan V, Rait G, Petersen I, Iliffe S. First diagnosis and management of incontinence in older people with and without dementia in primary care: a cohort study using The Health Improvement Network primary care database. PLoS Med. 2013;10, e1001505.PubMedCentralCrossRefPubMed
30.
go back to reference Maguire A, Blak BT, Thompson M. The importance of defining periods of complete mortality reporting for research using automated data from primary care. Pharmacoepidemiol Drug Saf. 2009;18(1):76–83.CrossRefPubMed Maguire A, Blak BT, Thompson M. The importance of defining periods of complete mortality reporting for research using automated data from primary care. Pharmacoepidemiol Drug Saf. 2009;18(1):76–83.CrossRefPubMed
31.
go back to reference Horsfall L, Walters K, Petersen I. Identifying periods of acceptable computer usage in primary care research databases. Pharmacoepidemiol Drug Saf. 2013;22(1):64–9.CrossRefPubMed Horsfall L, Walters K, Petersen I. Identifying periods of acceptable computer usage in primary care research databases. Pharmacoepidemiol Drug Saf. 2013;22(1):64–9.CrossRefPubMed
32.
go back to reference Di Marco LY, Marzo A, Muñoz-Ruiz M, Ikram MA, Kivipelto M, Ruefenacht D, et al. Modifiable lifestyle factors in dementia: a systematic review of longitudinal observational cohort studies. J Alz Dis. 2014;42:119–35. doi:10.3233/JAD-132225. Di Marco LY, Marzo A, Muñoz-Ruiz M, Ikram MA, Kivipelto M, Ruefenacht D, et al. Modifiable lifestyle factors in dementia: a systematic review of longitudinal observational cohort studies. J Alz Dis. 2014;42:119–35. doi:10.​3233/​JAD-132225.
33.
go back to reference Harrell FE. Regression modeling strategies with applications to linear models. Logistic Regression, and Survival Analysis Series: Springer Series in Statistics. Harrell FE. 1st ed. 2002. Corr. 2nd printing 2001, XXIII. Harrell FE. Regression modeling strategies with applications to linear models. Logistic Regression, and Survival Analysis Series: Springer Series in Statistics. Harrell FE. 1st ed. 2002. Corr. 2nd printing 2001, XXIII.
35.
go back to reference Wood AM, White IR, Royston P. How should variable selection be performed with multiply imputed data? Stat Med. 2008;27:3227–46.CrossRefPubMed Wood AM, White IR, Royston P. How should variable selection be performed with multiply imputed data? Stat Med. 2008;27:3227–46.CrossRefPubMed
36.
go back to reference Uno H, Cai T, Pencina MJ, D'Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30(10):1105–17.PubMedCentralPubMed Uno H, Cai T, Pencina MJ, D'Agostino RB, Wei LJ. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30(10):1105–17.PubMedCentralPubMed
37.
go back to reference Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med. 2004;23:723–48.CrossRefPubMed Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med. 2004;23:723–48.CrossRefPubMed
38.
go back to reference Anstey KJ, Lipnicki DM, Low LF. Cholesterol as a risk factor for dementia and cognitive decline: A systematic review of prospective studies with meta-analysis. Am J Geriatric Psychiat. 2008;16:343–54.CrossRef Anstey KJ, Lipnicki DM, Low LF. Cholesterol as a risk factor for dementia and cognitive decline: A systematic review of prospective studies with meta-analysis. Am J Geriatric Psychiat. 2008;16:343–54.CrossRef
41.
go back to reference Boustani M, Peterson B, Hanson L, Harris R, Lohr K. Screening for dementia in primary care: a summary of the evidence for the US preventive services task force. Ann Intern Med. 2003;138:927–37.CrossRefPubMed Boustani M, Peterson B, Hanson L, Harris R, Lohr K. Screening for dementia in primary care: a summary of the evidence for the US preventive services task force. Ann Intern Med. 2003;138:927–37.CrossRefPubMed
42.
go back to reference Schrijvers EM, Verhaaren BF, Koudstaal PJ, Hofman A, Ikram MA, Breteler MM. Is dementia incidence declining? Trends in dementia incidence since 1990 in the Rotterdam Study. Neurology. 2012;78:1456–63.CrossRefPubMed Schrijvers EM, Verhaaren BF, Koudstaal PJ, Hofman A, Ikram MA, Breteler MM. Is dementia incidence declining? Trends in dementia incidence since 1990 in the Rotterdam Study. Neurology. 2012;78:1456–63.CrossRefPubMed
Metadata
Title
Predicting dementia risk in primary care: development and validation of the Dementia Risk Score using routinely collected data
Authors
K. Walters
S. Hardoon
I. Petersen
S. Iliffe
R. Z. Omar
I. Nazareth
G. Rait
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2016
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-016-0549-y

Other articles of this Issue 1/2016

BMC Medicine 1/2016 Go to the issue