Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2020

01-12-2020 | Attention Deficit Hyperactivity Disorder | Research article

Validation of an EMR algorithm to measure the prevalence of ADHD in the Canadian Primary Care Sentinel Surveillance Network (CPCSSN)

Authors: Rachael Morkem, Kenneth Handelman, John A. Queenan, Richard Birtwhistle, David Barber

Published in: BMC Medical Informatics and Decision Making | Issue 1/2020

Login to get access

Abstract

Background

Building and validating electronic algorithms to identify patients with specific disease profiles using health data is becoming increasingly important to disease surveillance and population health management. The aim of this study was to develop and validate an algorithm to find patients with ADHD diagnoses within primary care electronic medical records (EMR); and then use the algorithm to describe the epidemiology of ADHD from 2008 to 2015 in a Canadian Primary care sample.

Methods

This was a cross sectional time series that used data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN), a repository of primary care EMR data. A sample of electronic patient charts from one local clinic were manually reviewed to determine the positive predictive value (PPV) and negative predictive value (NPV) of an ADHD case-finding algorithm. In each study year a practice population was determined, and the algorithm was used to measure an observed prevalence of ADHD. The observed prevalence was adjusted for misclassification, as measured by the validity indices, to obtain an estimate of the true prevalence. Estimates were calculated by age group (4–17 year olds, 18 to 34 year olds, and 35 to 64 year olds) and gender, and compared over time.

Results

The EMR algorithm had a PPV of 98.0% (95% CI [92.5, 99.5]) and an NPV of 95.0% (95% CI [92.9, 98.6]). After adjusting for misclassification, it was determined that the prevalence of patients with a clinical diagnosis of ADHD has risen in all age groups between 2008 and 2015, most notably in children and young adults (6.92, 95% CI [5.62, 8.39] to 8.57, 95% CI [7.32, 10.00]; 5.73, 95% CI [4.40, 7.23] to 7.33, 95% CI [6.04, 8.78], respectively). The well-established gender gap persisted in all age groups across time but was considerably smaller in older adults compared to children and young adults.

Conclusion

Overall, the ADHD case-finding algorithm was found to be a valid tool to assess the epidemiology of ADHD in Canadian primary care practice. The increased prevalence of ADHD between 2008 and 2015 may reflect an improvement in the recognition and treatment of this disorder within primary care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Brault MC, Lacourse E. Prevalence of prescribed attention-deficit hyperactivity disorder medications and diagnosis among canadian preschoolers and school-age children: 1994-2007. Can J Psychiatr. 2012;57:93–101.CrossRef Brault MC, Lacourse E. Prevalence of prescribed attention-deficit hyperactivity disorder medications and diagnosis among canadian preschoolers and school-age children: 1994-2007. Can J Psychiatr. 2012;57:93–101.CrossRef
2.
go back to reference Giles LL, Martini DR. The challenges and promises of Pediatric psychopharmacology. Acad Pediatr. 2016;16:508–18.CrossRef Giles LL, Martini DR. The challenges and promises of Pediatric psychopharmacology. Acad Pediatr. 2016;16:508–18.CrossRef
3.
go back to reference Biederman J, Petty CR, Evans M, Small J, Farone SV. How persistent is ADHD? A controlled 10-year follow-up study of boys with ADHD. Psychiatry Res. 2010;177(3):299–304.CrossRef Biederman J, Petty CR, Evans M, Small J, Farone SV. How persistent is ADHD? A controlled 10-year follow-up study of boys with ADHD. Psychiatry Res. 2010;177(3):299–304.CrossRef
4.
go back to reference Lara C, Fayyad J, de Graaf R, Kessler RC, Aguilar-Gaxiola S, Angermeyer M, et al. Childhood predictors of adult attention-deficit/hyperactivity disorder: results from the World Health Organization world mental health survey initiative. Biol Psychiatry. 2009;65(1):46–54.CrossRef Lara C, Fayyad J, de Graaf R, Kessler RC, Aguilar-Gaxiola S, Angermeyer M, et al. Childhood predictors of adult attention-deficit/hyperactivity disorder: results from the World Health Organization world mental health survey initiative. Biol Psychiatry. 2009;65(1):46–54.CrossRef
5.
go back to reference McCarthy S, Wilton L, Murray ML, Hodgkins P, Asherson P, Wong ICK. The epidemiology of pharmacologically treated attention deficit hyperactivity disorder (ADHD) in children, adolescents and adults in UK primary care. BMC Pediatr. 2012;12:78.CrossRef McCarthy S, Wilton L, Murray ML, Hodgkins P, Asherson P, Wong ICK. The epidemiology of pharmacologically treated attention deficit hyperactivity disorder (ADHD) in children, adolescents and adults in UK primary care. BMC Pediatr. 2012;12:78.CrossRef
7.
go back to reference Patten SB, Waheed W, Bresee L. A review of Pharmacoepidemiologic studies of antipsychotic use in children and adolescents. Can J Psychiatr. 2012;57:717–21.CrossRef Patten SB, Waheed W, Bresee L. A review of Pharmacoepidemiologic studies of antipsychotic use in children and adolescents. Can J Psychiatr. 2012;57:717–21.CrossRef
9.
go back to reference Aman MG, Bukstein OG, Gadow KD, Arnold E, Molina BSG, McNamara NK, et al. What does Risperidone add to stimulant and parent training for severe aggression in child attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2014;53:47–60.CrossRef Aman MG, Bukstein OG, Gadow KD, Arnold E, Molina BSG, McNamara NK, et al. What does Risperidone add to stimulant and parent training for severe aggression in child attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2014;53:47–60.CrossRef
10.
go back to reference Pringsheim T, Lam D, Pattern SB. The pharmacoepidemiology of antipsychotic medications for Canadian children and adolescents: 2005-2009. J Child Adolesc Psychopharmacol. 2011;21:537–43.CrossRef Pringsheim T, Lam D, Pattern SB. The pharmacoepidemiology of antipsychotic medications for Canadian children and adolescents: 2005-2009. J Child Adolesc Psychopharmacol. 2011;21:537–43.CrossRef
11.
go back to reference Alessi-Severini S, Biscontri RG, Collins DM, Sareen J, Enns MW. Ten years of antipsychotic prescribing to children: a Canadian population-based study. Can J Psychiatr. 2012;57(1):52–8.CrossRef Alessi-Severini S, Biscontri RG, Collins DM, Sareen J, Enns MW. Ten years of antipsychotic prescribing to children: a Canadian population-based study. Can J Psychiatr. 2012;57(1):52–8.CrossRef
12.
go back to reference Hauck TS, Lau C, Wing LLF, Kurdyak P, Tu K. ADHD treatment in primary care: demographic factors, medication trends, and treatment predictors. Can J Psychiatr. 2017;62(6):393–402.CrossRef Hauck TS, Lau C, Wing LLF, Kurdyak P, Tu K. ADHD treatment in primary care: demographic factors, medication trends, and treatment predictors. Can J Psychiatr. 2017;62(6):393–402.CrossRef
13.
go back to reference Vasiliadis H-M, Diallo FB, Rochette L, Smith M, Langille D, Lin E, Kisely S, Fombonne E, Thompson AH, Renaud J, Lesage A. Temporal trends in the prevalence and incidence of diagnosed ADHD in children and young adults between 1999 and 2012 in Canada: a data linkage study. Can J Psychiatr. 2017;62(12):818–26.CrossRef Vasiliadis H-M, Diallo FB, Rochette L, Smith M, Langille D, Lin E, Kisely S, Fombonne E, Thompson AH, Renaud J, Lesage A. Temporal trends in the prevalence and incidence of diagnosed ADHD in children and young adults between 1999 and 2012 in Canada: a data linkage study. Can J Psychiatr. 2017;62(12):818–26.CrossRef
14.
go back to reference Hesson J, Fowler K. Prevalence and correlates of self-reported ADD/ADHD in a large National Sample of Canadian adults. J Atten Disord. 2018;22(2):191–200.CrossRef Hesson J, Fowler K. Prevalence and correlates of self-reported ADD/ADHD in a large National Sample of Canadian adults. J Atten Disord. 2018;22(2):191–200.CrossRef
15.
go back to reference Mossialos E, Wenzl M, Osborn R, Samak D. International Profiles of Health Care Systems, 2015, The Commonwealth Fund; 2016. Mossialos E, Wenzl M, Osborn R, Samak D. International Profiles of Health Care Systems, 2015, The Commonwealth Fund; 2016.
16.
go back to reference Queenan JA, Williamson T, Khan S, Drummond N, Garies S, Morkem R, Birtwhistle R. Representativeness of patients and providers in the Canadian primary care sentinel surveillance network: a cross-sectional study. CMAJ Open. 2016;4:E28–32.CrossRef Queenan JA, Williamson T, Khan S, Drummond N, Garies S, Morkem R, Birtwhistle R. Representativeness of patients and providers in the Canadian primary care sentinel surveillance network: a cross-sectional study. CMAJ Open. 2016;4:E28–32.CrossRef
18.
go back to reference Kirby JC, Speltz P, Rasmussen LV, Basford M, Gottesman O, Peissig PL. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. J Am Med Inform Assoc. 2016;23(6):1046–52.CrossRef Kirby JC, Speltz P, Rasmussen LV, Basford M, Gottesman O, Peissig PL. PheKB: a catalog and workflow for creating electronic phenotype algorithms for transportability. J Am Med Inform Assoc. 2016;23(6):1046–52.CrossRef
19.
go back to reference Bollaerts K, Rekkas A, De Smedt T, Dodd C, Andrews N, Gini R. Disease misclassification in electronic healthcare database studies: deriving validity indices – a contribution form the ADVANCE project. PLoS One. 2020;15(4):e0231333.CrossRef Bollaerts K, Rekkas A, De Smedt T, Dodd C, Andrews N, Gini R. Disease misclassification in electronic healthcare database studies: deriving validity indices – a contribution form the ADVANCE project. PLoS One. 2020;15(4):e0231333.CrossRef
20.
go back to reference Rogan WJ, Gladen B. Estimating prevalence from the results of a screening test. AJE. 1978;10(1):71–6.CrossRef Rogan WJ, Gladen B. Estimating prevalence from the results of a screening test. AJE. 1978;10(1):71–6.CrossRef
22.
go back to reference Faraone SV, Biederman J, Mick E. The age-dependent decline of attention deficit hyperactivity disorder: a meta-analysis of follow-up studies. Psychol Med. 2006;36(2):159–65.CrossRef Faraone SV, Biederman J, Mick E. The age-dependent decline of attention deficit hyperactivity disorder: a meta-analysis of follow-up studies. Psychol Med. 2006;36(2):159–65.CrossRef
23.
go back to reference Walkup JT, Stossel L, Rendleman R. Beyond rising rates: personalized medicine and public health approaches to the diagnosis and treatment of attention-deficity/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2014;53(1):14–6.CrossRef Walkup JT, Stossel L, Rendleman R. Beyond rising rates: personalized medicine and public health approaches to the diagnosis and treatment of attention-deficity/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry. 2014;53(1):14–6.CrossRef
24.
go back to reference Polanczyk G, Willcutt EG, Salum GA, Kieling C, Rohde LA. ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. Int J Epidemiol. 2014;43:434–42.CrossRef Polanczyk G, Willcutt EG, Salum GA, Kieling C, Rohde LA. ADHD prevalence estimates across three decades: an updated systematic review and meta-regression analysis. Int J Epidemiol. 2014;43:434–42.CrossRef
25.
go back to reference Paris J, Bhat V, Thombs B. Is adult attention-deficit hyperactivity disorder being Overdiagnosed. Can J Psychiatr. 2015;60(7):324–8.CrossRef Paris J, Bhat V, Thombs B. Is adult attention-deficit hyperactivity disorder being Overdiagnosed. Can J Psychiatr. 2015;60(7):324–8.CrossRef
26.
go back to reference Kessler RC, Adler L, Barkley R, Biederman J, Conners CK, Demler O. The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. Am J Psychiatry. 2006;163(4):716–23.CrossRef Kessler RC, Adler L, Barkley R, Biederman J, Conners CK, Demler O. The prevalence and correlates of adult ADHD in the United States: results from the National Comorbidity Survey Replication. Am J Psychiatry. 2006;163(4):716–23.CrossRef
27.
go back to reference Fayyad J, Sampson NA, Hwang I, Adamowski T, Aguilar-Gaxiola S, Al-Hamzawi A. The descriptive epidemiology of DSM-IV adult ADHD in the World Health Organization world mental health surveys. Atten Defic Hyperact Disord. 2017;9(1):47–65.CrossRef Fayyad J, Sampson NA, Hwang I, Adamowski T, Aguilar-Gaxiola S, Al-Hamzawi A. The descriptive epidemiology of DSM-IV adult ADHD in the World Health Organization world mental health surveys. Atten Defic Hyperact Disord. 2017;9(1):47–65.CrossRef
28.
go back to reference Rucklidge JJ. Gender differences in attention-deficit/hyperactivity disorder. Psychiatr Clin North Am. 2010;33(2):357–73.CrossRef Rucklidge JJ. Gender differences in attention-deficit/hyperactivity disorder. Psychiatr Clin North Am. 2010;33(2):357–73.CrossRef
29.
go back to reference Brault MC, Lacourse E. Prevalence of prescribed attention-deficit hyperactivity disorder medications and diagnosis among childhood Preschoolers and school-age children: 1994-2007. Can J Psychiatr. 2012;57(2):93–101.CrossRef Brault MC, Lacourse E. Prevalence of prescribed attention-deficit hyperactivity disorder medications and diagnosis among childhood Preschoolers and school-age children: 1994-2007. Can J Psychiatr. 2012;57(2):93–101.CrossRef
30.
go back to reference Cortese S, Faraone SV, Bernardi S, Wang S, Blanco C. Gender differences in adult attention-deficit/hyperactivity disorder: results from the National Epidemiological Survey on alcohol and related conditions (NESARC). J Clin Psychiatry. 2016;77(4):e421–8.CrossRef Cortese S, Faraone SV, Bernardi S, Wang S, Blanco C. Gender differences in adult attention-deficit/hyperactivity disorder: results from the National Epidemiological Survey on alcohol and related conditions (NESARC). J Clin Psychiatry. 2016;77(4):e421–8.CrossRef
31.
go back to reference Reale L, Bartoli B, Cartabia M, Zanetti M, Costantino MA, Canevini MP. Comorbidity prevalence and treatment outcome in children and adolescents with ADHD. Eur Child Adolesc Pychiatry. 2017;26(12):1443–57.CrossRef Reale L, Bartoli B, Cartabia M, Zanetti M, Costantino MA, Canevini MP. Comorbidity prevalence and treatment outcome in children and adolescents with ADHD. Eur Child Adolesc Pychiatry. 2017;26(12):1443–57.CrossRef
Metadata
Title
Validation of an EMR algorithm to measure the prevalence of ADHD in the Canadian Primary Care Sentinel Surveillance Network (CPCSSN)
Authors
Rachael Morkem
Kenneth Handelman
John A. Queenan
Richard Birtwhistle
David Barber
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2020
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-020-01182-2

Other articles of this Issue 1/2020

BMC Medical Informatics and Decision Making 1/2020 Go to the issue