Skip to main content
Top
Published in: European Child & Adolescent Psychiatry 9/2016

Open Access 01-09-2016 | Original Contribution

Diagnostic efficiency of the SDQ for parents to identify ADHD in the UK: a ROC analysis

Authors: Guillermo Perez Algorta, Alyson Lamont Dodd, Argyris Stringaris, Eric A. Youngstrom

Published in: European Child & Adolescent Psychiatry | Issue 9/2016

Login to get access

Abstract

Early, accurate identification of ADHD would improve outcomes while avoiding unnecessary medication exposure for non-ADHD youths, but is challenging, especially in primary care. The aim of this paper is to test the Strengths and Difficulties Questionnaire (SDQ) using a nationally representative sample to develop scoring weights for clinical use. The British Child and Adolescent Mental Health Survey (N = 18,232 youths 5–15 years old) included semi-structured interview DSM-IV diagnoses and parent-rated SDQ scores. Areas under the curve for SDQ subscales were good (0.81) to excellent (0.96) across sex and age groups. Hyperactivity/inattention scale scores of 10+ increased odds of ADHD by 21.3×. For discriminating ADHD from other diagnoses, accuracy was fair (<0.70) to good (0.88); Hyperactivity/inattention scale scores of 10+ increased odds of ADHD by 4.47×. The SDQ is free, easy to score, and provides clinically meaningful changes in odds of ADHD that can guide clinical decision-making in an evidence-based medicine framework.
Literature
5.
go back to reference Hechtman L, Swanson JM, Sibley M, Stehli A, Owens EB, Mitchell JT, Arnold LE, Molina BSG, Hinshaw SP, Abikoff H, Algorta GP, Howard A, Hoza B, Etcovitch J, Lakes KD, Nichols JQ, MTA Cooperative Group (under review) Functional adult outcomes 16 years after childhood diagnosis of attention-deficit/hyperactivity disorder: MTA results. JAMA Psychiatry Hechtman L, Swanson JM, Sibley M, Stehli A, Owens EB, Mitchell JT, Arnold LE, Molina BSG, Hinshaw SP, Abikoff H, Algorta GP, Howard A, Hoza B, Etcovitch J, Lakes KD, Nichols JQ, MTA Cooperative Group (under review) Functional adult outcomes 16 years after childhood diagnosis of attention-deficit/hyperactivity disorder: MTA results. JAMA Psychiatry
6.
go back to reference Telford C, Green C, Logan S, Langley K, Thapar A, Ford T (2013) Estimating the costs of ongoing care for adolescents with attention-deficit hyperactivity disorder. Soc Psychiatry Psychiatr Epidemiol 48(2):337–344. doi:10.1007/s00127-012-0530-9 CrossRefPubMed Telford C, Green C, Logan S, Langley K, Thapar A, Ford T (2013) Estimating the costs of ongoing care for adolescents with attention-deficit hyperactivity disorder. Soc Psychiatry Psychiatr Epidemiol 48(2):337–344. doi:10.​1007/​s00127-012-0530-9 CrossRefPubMed
7.
go back to reference Thapar AK, Thapar A (2003) Attention-deficit hyperactivity disorder. Br J Gen Pract J R Coll Gen Pract 53(488):225–230 Thapar AK, Thapar A (2003) Attention-deficit hyperactivity disorder. Br J Gen Pract J R Coll Gen Pract 53(488):225–230
10.
11.
go back to reference Wolraich ML, Bard DE, Stein MT, Rushton JL, O’Connor KG (2010) Pediatricians’ attitudes and practices on ADHD before and after the development of ADHD pediatric practice guidelines. J Atten Disord 13(6):563–572. doi:10.1177/1087054709344194 CrossRefPubMed Wolraich ML, Bard DE, Stein MT, Rushton JL, O’Connor KG (2010) Pediatricians’ attitudes and practices on ADHD before and after the development of ADHD pediatric practice guidelines. J Atten Disord 13(6):563–572. doi:10.​1177/​1087054709344194​ CrossRefPubMed
13.
go back to reference Goodman R, Renfrew D, Mullick M (2000) Predicting type of psychiatric disorder from strengths and difficulties questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry 9(2):129–134CrossRefPubMed Goodman R, Renfrew D, Mullick M (2000) Predicting type of psychiatric disorder from strengths and difficulties questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry 9(2):129–134CrossRefPubMed
14.
go back to reference Goodman R, Ford T, Corbin T, Meltzer H (2004) Using the strengths and difficulties questionnaire (SDQ) multi-informant algorithm to screen looked-after children for psychiatric disorders. Eur Child Adolesc Psychiatry 13(2):Ii25–Ii31. doi:10.1007/s00787-004-2005-3 PubMed Goodman R, Ford T, Corbin T, Meltzer H (2004) Using the strengths and difficulties questionnaire (SDQ) multi-informant algorithm to screen looked-after children for psychiatric disorders. Eur Child Adolesc Psychiatry 13(2):Ii25–Ii31. doi:10.​1007/​s00787-004-2005-3 PubMed
15.
go back to reference Rettew DC, Lynch AD, Achenbach TM, Dumenci L, Ivanova MY (2009) Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. Int J Methods Psychiatr Res 18(3):169–184. doi:10.1002/mpr.289 CrossRefPubMed Rettew DC, Lynch AD, Achenbach TM, Dumenci L, Ivanova MY (2009) Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. Int J Methods Psychiatr Res 18(3):169–184. doi:10.​1002/​mpr.​289 CrossRefPubMed
16.
go back to reference Nigg JT, Barkley RA (2014) Attention-Deficit/Hyperactive Disorder. In: Mash EJ, Barkley RA (eds) Child psychopathology. The Guilford Press, New York, pp 75–144 Nigg JT, Barkley RA (2014) Attention-Deficit/Hyperactive Disorder. In: Mash EJ, Barkley RA (eds) Child psychopathology. The Guilford Press, New York, pp 75–144
17.
go back to reference Rimvall MK, Elberling H, Rask CU, Helenius D, Skovgaard AM, Jeppesen P (2014) Predicting ADHD in school age when using the strengths and difficulties questionnaire in preschool age: a longitudinal general population study, CCC2000. Eur Child Adolesc Psychiatry 23(11):1051–1060. doi:10.1007/s00787-014-0546-7 CrossRefPubMed Rimvall MK, Elberling H, Rask CU, Helenius D, Skovgaard AM, Jeppesen P (2014) Predicting ADHD in school age when using the strengths and difficulties questionnaire in preschool age: a longitudinal general population study, CCC2000. Eur Child Adolesc Psychiatry 23(11):1051–1060. doi:10.​1007/​s00787-014-0546-7 CrossRefPubMed
18.
go back to reference Ullebo AK, Posserud MB, Heiervang E, Gillberg C, Obel C (2011) Screening for the attention deficit hyperactivity disorder phenotype using the strength and difficulties questionnaire. Eur Child Adolesc Psychiatry 20(9):451–458. doi:10.1007/s00787-011-0198-9 CrossRefPubMed Ullebo AK, Posserud MB, Heiervang E, Gillberg C, Obel C (2011) Screening for the attention deficit hyperactivity disorder phenotype using the strength and difficulties questionnaire. Eur Child Adolesc Psychiatry 20(9):451–458. doi:10.​1007/​s00787-011-0198-9 CrossRefPubMed
19.
go back to reference Carballo JJ, Rodriguez-Blanco L, Garcia-Nieto R, Baca-Garcia E (2014) Screening for the ADHD phenotype using the strengths and difficulties questionnaire in a clinical sample of newly referred children and adolescents. J Atten Disord. doi:10.1177/1087054714561858 PubMed Carballo JJ, Rodriguez-Blanco L, Garcia-Nieto R, Baca-Garcia E (2014) Screening for the ADHD phenotype using the strengths and difficulties questionnaire in a clinical sample of newly referred children and adolescents. J Atten Disord. doi:10.​1177/​1087054714561858​ PubMed
20.
go back to reference Jaeschke R, Guyatt GH, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA 271(9):703–707CrossRefPubMed Jaeschke R, Guyatt GH, Sackett DL (1994) Users’ guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. JAMA 271(9):703–707CrossRefPubMed
21.
go back to reference Meltzer H, Gatward R, Goodman R, Ford T (2000) Mental health of children and adolescents in Great Britain. TSO, LondonCrossRef Meltzer H, Gatward R, Goodman R, Ford T (2000) Mental health of children and adolescents in Great Britain. TSO, LondonCrossRef
22.
go back to reference Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The development and well-being assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41(5):645–655CrossRefPubMed Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The development and well-being assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41(5):645–655CrossRefPubMed
23.
go back to reference Goodman R, Ford T, Simmons H, Gatward R, Meltzer H (2000) Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry J Ment Sci 177:534–539CrossRef Goodman R, Ford T, Simmons H, Gatward R, Meltzer H (2000) Using the strengths and difficulties questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry J Ment Sci 177:534–539CrossRef
24.
26.
go back to reference American Psychiatric Association (1994) Diagnostic criteria from DSM-IV. The Association, Washington, DC American Psychiatric Association (1994) Diagnostic criteria from DSM-IV. The Association, Washington, DC
27.
go back to reference Swets JA (1988) Measuring the accuracy of diagnostic systems. Science (New York, NY) 240(4857):1285–1293CrossRef Swets JA (1988) Measuring the accuracy of diagnostic systems. Science (New York, NY) 240(4857):1285–1293CrossRef
28.
29.
go back to reference Venkatraman ES (2000) A permutation test to compare receiver operating characteristic curves. Biometrics 56(4):1134–1138CrossRefPubMed Venkatraman ES (2000) A permutation test to compare receiver operating characteristic curves. Biometrics 56(4):1134–1138CrossRefPubMed
30.
go back to reference Kraemer HC (1992) Evaluating medical tests: objective and quantitative guidelines. Sage Publications, Newbury Park Kraemer HC (1992) Evaluating medical tests: objective and quantitative guidelines. Sage Publications, Newbury Park
31.
go back to reference Straus SE, Richardson WS, Glasziou P, Haynes RB (2005) Evidence-based medicine: how to practice and teach EBM Straus SE, Richardson WS, Glasziou P, Haynes RB (2005) Evidence-based medicine: how to practice and teach EBM
32.
go back to reference Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Muller M (2011) pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinform 12:77. doi:10.1186/1471-2105-12-77 CrossRef Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Muller M (2011) pROC: an open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinform 12:77. doi:10.​1186/​1471-2105-12-77 CrossRef
33.
go back to reference Becker A, Woerner W, Hasselhorn M, Banaschewski T, Rothenberger A (2004) Validation of the parent and teacher SDQ in a clinical sample. Eur Child Adolesc Psychiatry 13(2):Ii11–Ii16. doi:10.1007/s00787-004-2003-5 PubMed Becker A, Woerner W, Hasselhorn M, Banaschewski T, Rothenberger A (2004) Validation of the parent and teacher SDQ in a clinical sample. Eur Child Adolesc Psychiatry 13(2):Ii11–Ii16. doi:10.​1007/​s00787-004-2003-5 PubMed
34.
go back to reference Klasen H, Woerner W, Wolke D, Meyer R, Overmeyer S, Kaschnitz W, Rothenberger A, Goodman R (2000) Comparing the German versions of the strengths and difficulties questionnaire (SDQ-Deu) and the child behavior checklist. Eur Child Adolesc Psychiatry 9(4):271–276CrossRefPubMed Klasen H, Woerner W, Wolke D, Meyer R, Overmeyer S, Kaschnitz W, Rothenberger A, Goodman R (2000) Comparing the German versions of the strengths and difficulties questionnaire (SDQ-Deu) and the child behavior checklist. Eur Child Adolesc Psychiatry 9(4):271–276CrossRefPubMed
35.
36.
go back to reference Garb HN, Boyle PA (2003) Understanding why some clinicians use pseudoscientific methods: findings from research on clinical judgment. In: Science and pseudoscience in clinical psychology. The Guilford Press, New York Garb HN, Boyle PA (2003) Understanding why some clinicians use pseudoscientific methods: findings from research on clinical judgment. In: Science and pseudoscience in clinical psychology. The Guilford Press, New York
37.
go back to reference Ægisdóttir S, White MJ, Spengler PM, Maugherman AS, Anderson LA, Cook RS, Nichols CN, Lampropoulos GK, Walker BS, Cohen G (2006) The meta-analysis of clinical judgment project: fifty-six years of accumulated research on clinical versus statistical prediction. Couns Psychol 34(3):341–382CrossRef Ægisdóttir S, White MJ, Spengler PM, Maugherman AS, Anderson LA, Cook RS, Nichols CN, Lampropoulos GK, Walker BS, Cohen G (2006) The meta-analysis of clinical judgment project: fifty-six years of accumulated research on clinical versus statistical prediction. Couns Psychol 34(3):341–382CrossRef
38.
go back to reference Dawes RM, Faust D, Meehl PE (1989) Clinical versus actuarial judgment. Science (New York, NY) 243(4899):1668–1674CrossRef Dawes RM, Faust D, Meehl PE (1989) Clinical versus actuarial judgment. Science (New York, NY) 243(4899):1668–1674CrossRef
39.
go back to reference Grove WM, Zald DH, Lebow BS, Snitz BE, Nelson C (2000) Clinical versus mechanical prediction: a meta-analysis. Psychol Assess 12(1):19–30CrossRefPubMed Grove WM, Zald DH, Lebow BS, Snitz BE, Nelson C (2000) Clinical versus mechanical prediction: a meta-analysis. Psychol Assess 12(1):19–30CrossRefPubMed
41.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ (Clinical Research ed) 326(7379):41–44CrossRef Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC (2003) Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ (Clinical Research ed) 326(7379):41–44CrossRef
42.
43.
go back to reference Youngstrom EA, Choukas-Bradley S, Calhoun CD, Jensen-Doss A (2015) Clinical guide to the evidence-based assessment approach to diagnosis and treatment. Cogn Behav Pract 22(1):20–35CrossRef Youngstrom EA, Choukas-Bradley S, Calhoun CD, Jensen-Doss A (2015) Clinical guide to the evidence-based assessment approach to diagnosis and treatment. Cogn Behav Pract 22(1):20–35CrossRef
44.
go back to reference Guyatt GH, Rennie D (eds) (2002) Users’ guides to the medical literature. AMA Press, Chicago Guyatt GH, Rennie D (eds) (2002) Users’ guides to the medical literature. AMA Press, Chicago
45.
go back to reference Mackin P, Targum SD, Kalali A, Rom D, Young AH (2006) Culture and assessment of manic symptoms. Br J Psychiatry 189:379–380CrossRefPubMed Mackin P, Targum SD, Kalali A, Rom D, Young AH (2006) Culture and assessment of manic symptoms. Br J Psychiatry 189:379–380CrossRefPubMed
47.
go back to reference Jenkins MM, Youngstrom EA (2015) A randomized controlled trial of cognitive debiasing improves assessment and treatment selection for pediatric bipolar disorder. J Consul Clin Psychol Jenkins MM, Youngstrom EA (2015) A randomized controlled trial of cognitive debiasing improves assessment and treatment selection for pediatric bipolar disorder. J Consul Clin Psychol
48.
go back to reference Jenkins MM, Youngstrom EA, Washburn JJ, Youngstrom JK (2011) Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Prof Psychol Res Pract 42(2):121–129. doi:10.1037/a0022506 CrossRef Jenkins MM, Youngstrom EA, Washburn JJ, Youngstrom JK (2011) Evidence-based strategies improve assessment of pediatric bipolar disorder by community practitioners. Prof Psychol Res Pract 42(2):121–129. doi:10.​1037/​a0022506 CrossRef
49.
go back to reference Pepe MS (2003) The statistical evaluation of medical tests for classification and prediction. Wiley, New York Pepe MS (2003) The statistical evaluation of medical tests for classification and prediction. Wiley, New York
50.
go back to reference Zhou X-H, Obuchowski NA, McClish DK (2002) Statistical methods in diagnostic medicine. Wiley, New YorkCrossRef Zhou X-H, Obuchowski NA, McClish DK (2002) Statistical methods in diagnostic medicine. Wiley, New YorkCrossRef
51.
go back to reference Alyahri A, Goodman R (2006) Validation of the arabic strengths and difficulties questionnaire and the development and well-being assessment. East Mediterr Health J = La revue de sante de la Mediterranee orientale = al-Majallah al-sihhiyah li-sharq al-mutawassit 12(2):S138–S146 Alyahri A, Goodman R (2006) Validation of the arabic strengths and difficulties questionnaire and the development and well-being assessment. East Mediterr Health J = La revue de sante de la Mediterranee orientale = al-Majallah al-sihhiyah li-sharq al-mutawassit 12(2):S138–S146
53.
go back to reference Mullick MS, Goodman R (2001) Questionnaire screening for mental health problems in Bangladeshi children: a preliminary study. Soc Psychiatry Psychiatr Epidemiol 36(2):94–99CrossRefPubMed Mullick MS, Goodman R (2001) Questionnaire screening for mental health problems in Bangladeshi children: a preliminary study. Soc Psychiatry Psychiatr Epidemiol 36(2):94–99CrossRefPubMed
Metadata
Title
Diagnostic efficiency of the SDQ for parents to identify ADHD in the UK: a ROC analysis
Authors
Guillermo Perez Algorta
Alyson Lamont Dodd
Argyris Stringaris
Eric A. Youngstrom
Publication date
01-09-2016
Publisher
Springer Berlin Heidelberg
Published in
European Child & Adolescent Psychiatry / Issue 9/2016
Print ISSN: 1018-8827
Electronic ISSN: 1435-165X
DOI
https://doi.org/10.1007/s00787-015-0815-0

Other articles of this Issue 9/2016

European Child & Adolescent Psychiatry 9/2016 Go to the issue