Skip to main content
Top
Published in: ADHD Attention Deficit and Hyperactivity Disorders 1/2019

01-03-2019 | Original Article

Parent–clinician agreement in rating the presence and severity of attention-deficit/hyperactivity disorder symptoms

Authors: Ellen Nobel, J. Agnes Brunnekreef, Russell J. Schachar, Barbara J. van den Hoofdakker, Pieter J. Hoekstra

Published in: ADHD Attention Deficit and Hyperactivity Disorders | Issue 1/2019

Login to get access

Abstract

We determined the validity of a parent-report questionnaire as a research tool for rating attention-deficit/hyperactivity disorder (ADHD) symptoms in children. Using Cohen’s kappa and Pearson correlation, we examined the agreement between parent reports of ADHD symptoms (using the Swanson, Nolan and Pelham Questionnaire-IV; SNAP-IV) and clinical judgment (using a semi-structured parent interview). Also, we explored factors that may be associated with the level of agreement, using regression analyses. We found moderate levels of agreement for severity of overall ADHD (r = 0.43) and for hyperactive-impulsive symptoms (r = 0.54), but no significant agreement for inattentive symptoms. On individual symptom level (range kappa = − 0.05–0.22) and for the presence/absence of ADHD (kappa = 0.14), agreement was poor. Therefore, we conclude that parent-report questionnaires may be acceptable to rate the overall severity of ADHD symptoms in treatment effect studies, but not to detect the presence of ADHD in epidemiological studies.
Literature
go back to reference Abidin RR (1995) Parenting stress index (PSI) manual, 3rd edn. Pediatric Psychology Press, Charlottesville Abidin RR (1995) Parenting stress index (PSI) manual, 3rd edn. Pediatric Psychology Press, Charlottesville
go back to reference Alda JA, Serrano-Troncoso E (2013) Attention-deficit hyperactivity disorder: agreement between clinical impression and the SNAP-IV screening tool. Actas Esp Psiquiatr 41(2):76–83PubMed Alda JA, Serrano-Troncoso E (2013) Attention-deficit hyperactivity disorder: agreement between clinical impression and the SNAP-IV screening tool. Actas Esp Psiquiatr 41(2):76–83PubMed
go back to reference Altman DG (1994) Practical statistics for medical research. Chapman and Hall, London Altman DG (1994) Practical statistics for medical research. Chapman and Hall, London
go back to reference American Psychiatric Association (1994) Diagnostic and statistical manual of mental disorders, 4th edn. American Psychiatric Association, Washington (DC) American Psychiatric Association (1994) Diagnostic and statistical manual of mental disorders, 4th edn. American Psychiatric Association, Washington (DC)
go back to reference American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Association, Washington, DCCrossRef American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Association, Washington, DCCrossRef
go back to reference Barkley RA, Murphy KR (1998) Attention deficit hyperactivity disorder: a clinical workbook, 3rd edn. Guilford, New York Barkley RA, Murphy KR (1998) Attention deficit hyperactivity disorder: a clinical workbook, 3rd edn. Guilford, New York
go back to reference Beck AT, Steer RA, Brown GK (1996) Beck depression inventory—second edition manual. The Psychological Corporation, San Antonio Beck AT, Steer RA, Brown GK (1996) Beck depression inventory—second edition manual. The Psychological Corporation, San Antonio
go back to reference Bird HR, Gould MS, Staghezza B (1992) Aggregating data from multiple informants in child psychiatry and epidemiological research. J Am Acad Child Adolesc Psychiatry 31:78–85CrossRefPubMed Bird HR, Gould MS, Staghezza B (1992) Aggregating data from multiple informants in child psychiatry and epidemiological research. J Am Acad Child Adolesc Psychiatry 31:78–85CrossRefPubMed
go back to reference Bussing R, Fernandez M, Harwood M, Hou W, Wilson GC, Eyberg SM, Swanson JM (2008) Parent and teacher snap-iv ratings of attention deficit/hyperactivity disorder symptoms: psychometric properties and normative ratings from a school district sample. Assessment 5(3):317–328CrossRef Bussing R, Fernandez M, Harwood M, Hou W, Wilson GC, Eyberg SM, Swanson JM (2008) Parent and teacher snap-iv ratings of attention deficit/hyperactivity disorder symptoms: psychometric properties and normative ratings from a school district sample. Assessment 5(3):317–328CrossRef
go back to reference Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20:121–153CrossRef Cohen J (1960) A coefficient of agreement for nominal scales. Educ Psychol Meas 20:121–153CrossRef
go back to reference Conners CK (2001) Conners’ rating scales: revised technical manual. Multi-Health Systems, Toronto Conners CK (2001) Conners’ rating scales: revised technical manual. Multi-Health Systems, Toronto
go back to reference Daley D, Van der Oord S, Ferrin M, Danckaerts M, Doepfner M, Cortese S, Sonuga-Barke EJ, (European ADHD Guidelines Group) (2014) Behavioral interventions in attention-deficit/hyperactivity disorder: a meta-analysis of randomized controlled trials across multiple outcome domains. J Am Acad Child Adolesc Psychiatry 53(8):835–847CrossRefPubMed Daley D, Van der Oord S, Ferrin M, Danckaerts M, Doepfner M, Cortese S, Sonuga-Barke EJ, (European ADHD Guidelines Group) (2014) Behavioral interventions in attention-deficit/hyperactivity disorder: a meta-analysis of randomized controlled trials across multiple outcome domains. J Am Acad Child Adolesc Psychiatry 53(8):835–847CrossRefPubMed
go back to reference De Los Reyes A, Kazdin AE (2005) Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol Bull 131:483–509CrossRefPubMed De Los Reyes A, Kazdin AE (2005) Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychol Bull 131:483–509CrossRefPubMed
go back to reference Hair JF, Black WC, Babin BJ, Anderson RE (2010) Multivariate data analysis, 7th edn. Pearson Prentice Hall, Upper Saddle River Hair JF, Black WC, Babin BJ, Anderson RE (2010) Multivariate data analysis, 7th edn. Pearson Prentice Hall, Upper Saddle River
go back to reference Ickowics A, Schachar RJ, Sugerman R, Chen SX, Millette C, Cook L (2006) The parent interview for child symptoms: a situation-specific clinical research interview for attention-deficit hyperactivity and related disorders. Can J Psychiatry 51(5):325–328CrossRef Ickowics A, Schachar RJ, Sugerman R, Chen SX, Millette C, Cook L (2006) The parent interview for child symptoms: a situation-specific clinical research interview for attention-deficit hyperactivity and related disorders. Can J Psychiatry 51(5):325–328CrossRef
go back to reference Jensen AL, Weisz JR (2002) Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnosis for clinic-referred children and adolescents. J Consult Clin Psychol 70:158–168CrossRefPubMed Jensen AL, Weisz JR (2002) Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnosis for clinic-referred children and adolescents. J Consult Clin Psychol 70:158–168CrossRefPubMed
go back to reference Klein JB, Lavigne JV, Seshadrin R (2010) Clinician-assigned and parent-report questionnaire-derived child psychiatric diagnosis: correlates and consequences of disagreement. Am J Orthopsychiatry 80(3):375–385CrossRefPubMed Klein JB, Lavigne JV, Seshadrin R (2010) Clinician-assigned and parent-report questionnaire-derived child psychiatric diagnosis: correlates and consequences of disagreement. Am J Orthopsychiatry 80(3):375–385CrossRefPubMed
go back to reference McCann DC, Thompson M, Daley D, Barton J, Laver-Bradbury C, Hutchings J, Coghill D, Stanton L, Maishman T, Dixon L, Caddy J, Chorozoglou M, Raftery J, Sonuga-Barke EJ (2014) Study protocol for a randomized controlled trial comparing the efficacy of a specialist and a generic parenting program for the treatment of preschool ADHD. Trials 15:142–162CrossRefPubMedPubMedCentral McCann DC, Thompson M, Daley D, Barton J, Laver-Bradbury C, Hutchings J, Coghill D, Stanton L, Maishman T, Dixon L, Caddy J, Chorozoglou M, Raftery J, Sonuga-Barke EJ (2014) Study protocol for a randomized controlled trial comparing the efficacy of a specialist and a generic parenting program for the treatment of preschool ADHD. Trials 15:142–162CrossRefPubMedPubMedCentral
go back to reference National Collaborating Centre for Mental Health & Royal College of Psychiatrists’ Research and Training Unit (2009) Attention deficit hyperactivity disorder: The NICE guideline on diagnosis and management of ADHD in children, young people and adults. The British Psychological Society and The Royal College of Psychiatrists, Leicester/London National Collaborating Centre for Mental Health & Royal College of Psychiatrists’ Research and Training Unit (2009) Attention deficit hyperactivity disorder: The NICE guideline on diagnosis and management of ADHD in children, young people and adults. The British Psychological Society and The Royal College of Psychiatrists, Leicester/London
go back to reference Parker A, Corkum P (2016) ADHD diagnosis: as simple as administering a questionnaire or a complex diagnostic process? J Atten Disord 20(6):478–486CrossRefPubMed Parker A, Corkum P (2016) ADHD diagnosis: as simple as administering a questionnaire or a complex diagnostic process? J Atten Disord 20(6):478–486CrossRefPubMed
go back to reference Raiker JS, Freeman AJ, Perez-Algorta G, Frazier TW, Findling RL, Youngstrom EA (2017) Accuracy of Achenbach scales in the screening of attention-deficit/hyperactivity disorder in a community mental health clinic. J Am Acad Child Adolesc Psychiatry 56(5):401–409CrossRefPubMedPubMedCentral Raiker JS, Freeman AJ, Perez-Algorta G, Frazier TW, Findling RL, Youngstrom EA (2017) Accuracy of Achenbach scales in the screening of attention-deficit/hyperactivity disorder in a community mental health clinic. J Am Acad Child Adolesc Psychiatry 56(5):401–409CrossRefPubMedPubMedCentral
go back to reference Schachar RJ, Ickowicz A, Wachsmuth R (1995) Parent interview for child symptoms (P.I.C.S.-4). The Hospital for Sick Children, Toronto (unpublished document) Schachar RJ, Ickowicz A, Wachsmuth R (1995) Parent interview for child symptoms (P.I.C.S.-4). The Hospital for Sick Children, Toronto (unpublished document)
go back to reference Sonuga-Barke EJ, Brandeis D, Cortese S, Daley D, Ferrin M, Holtmann M, Stevenson J, Danckaerts M, Van der Oord S, Döpfner M, Dittmann RW, Simonoff E, Zuddas A, Banaschewski T, Buitelaar J, Coghill D, Hollis C, Konofal E, Lecendreux M, Wong ICK, Sergeant J, (European ADHD Guidelines Group) (2013) Nonpharmacological interventions for adhd: systematic review and meta analyses of randomized controlled trials of dietary and psychological treatments. Am J Psychiatry 170(3):275–289CrossRefPubMed Sonuga-Barke EJ, Brandeis D, Cortese S, Daley D, Ferrin M, Holtmann M, Stevenson J, Danckaerts M, Van der Oord S, Döpfner M, Dittmann RW, Simonoff E, Zuddas A, Banaschewski T, Buitelaar J, Coghill D, Hollis C, Konofal E, Lecendreux M, Wong ICK, Sergeant J, (European ADHD Guidelines Group) (2013) Nonpharmacological interventions for adhd: systematic review and meta analyses of randomized controlled trials of dietary and psychological treatments. Am J Psychiatry 170(3):275–289CrossRefPubMed
go back to reference Swanson J (1992) School-based assessments and interventions for ADD students. K.C. Publications, Irvine Swanson J (1992) School-based assessments and interventions for ADD students. K.C. Publications, Irvine
go back to reference The MTA Cooperative Group (1991) A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry 56:1073–1086 The MTA Cooperative Group (1991) A 14-month randomized clinical trial of treatment strategies for attention-deficit/hyperactivity disorder. Arch Gen Psychiatry 56:1073–1086
go back to reference Ullebø AK, Posserud MB, Heiervang E, Obel C, Gillberg C (2012) Prevalence of the ADHD phenotype in 7- to 9-year-old children: effects of informant, gender and non-participation. Soc Psychiatry Psychiatr Epidemiol 47(5):763–769CrossRefPubMed Ullebø AK, Posserud MB, Heiervang E, Obel C, Gillberg C (2012) Prevalence of the ADHD phenotype in 7- to 9-year-old children: effects of informant, gender and non-participation. Soc Psychiatry Psychiatr Epidemiol 47(5):763–769CrossRefPubMed
go back to reference Wagner DJ, Vallerand IA, McLennan JD (2014) Treatment receipt and outcomes from a clinic employing the attention-deficit/hyperactivity disorder treatment guideline of the children’s medication algorithm project. J Child Adolesc Psychopharmacol 24(9):472–480CrossRefPubMed Wagner DJ, Vallerand IA, McLennan JD (2014) Treatment receipt and outcomes from a clinic employing the attention-deficit/hyperactivity disorder treatment guideline of the children’s medication algorithm project. J Child Adolesc Psychopharmacol 24(9):472–480CrossRefPubMed
go back to reference Yamada DC, Porter AA, Conway JL, LeBlanc JC, Shea SE, Hancock- Friesen CL, Warren AE (2013) Early repair of congenital heart disease associated with increased rate of attention deficit hyperactivity disorder symptoms. Can J Cardiol 29(12):1623–1628CrossRefPubMed Yamada DC, Porter AA, Conway JL, LeBlanc JC, Shea SE, Hancock- Friesen CL, Warren AE (2013) Early repair of congenital heart disease associated with increased rate of attention deficit hyperactivity disorder symptoms. Can J Cardiol 29(12):1623–1628CrossRefPubMed
go back to reference Yang R, Gao W, Li R, Zhao Z (2015) Effect of Atomaxetine on the cognitive functions in treatment of attention deficit hyperactivity disorder in children with congenital hypothyroidism: a pilot study. Int J Neuropsychopharmacol 18:1 Yang R, Gao W, Li R, Zhao Z (2015) Effect of Atomaxetine on the cognitive functions in treatment of attention deficit hyperactivity disorder in children with congenital hypothyroidism: a pilot study. Int J Neuropsychopharmacol 18:1
Metadata
Title
Parent–clinician agreement in rating the presence and severity of attention-deficit/hyperactivity disorder symptoms
Authors
Ellen Nobel
J. Agnes Brunnekreef
Russell J. Schachar
Barbara J. van den Hoofdakker
Pieter J. Hoekstra
Publication date
01-03-2019
Publisher
Springer Vienna
Published in
ADHD Attention Deficit and Hyperactivity Disorders / Issue 1/2019
Print ISSN: 1866-6116
Electronic ISSN: 1866-6647
DOI
https://doi.org/10.1007/s12402-018-0267-8

Other articles of this Issue 1/2019

ADHD Attention Deficit and Hyperactivity Disorders 1/2019 Go to the issue