Skip to main content
Top
Published in: BMC Psychiatry 1/2005

Open Access 01-12-2005 | Research article

Testing assumptions for endophenotype studies in ADHD: Reliability and validity of tasks in a general population sample

Authors: Jonna Kuntsi, Penny Andreou, Jonathan Ma, Norbert A Börger, Jaap J van der Meere

Published in: BMC Psychiatry | Issue 1/2005

Login to get access

Abstract

Background

Advances in both genetic and cognitive-experimental studies on attention deficit hyperactivity disorder (ADHD) have opened new opportunities for cognitive endophenotype research. In such genetic designs the focus is on individual differences in characteristics, associated with ADHD, that can be measured reliably over time. Genetic studies that take a 'quantitative trait loci' approach hypothesise that multiple susceptibility genes contribute to a continuous dimension of ADHD symptoms. As an important initial step, we aimed to investigate the underlying assumptions that (1) key cognitive-experimental tasks indicate adequate test-retest reliability and (2) ADHD symptom scores in a general population sample are associated with performance on these tasks.

Methods

Forty-nine children were assessed on a go/no-go task and a reaction time task (the 'fast task') that included manipulations with event rate and incentives. The children were assessed twice, with a test-retest interval of two weeks.

Results

The majority of the task variables demonstrated moderate-to-good test-retest reliability. The correlations between teacher ratings of ADHD symptoms and key task variables were .4–.6: ADHD symptoms were associated with poor performance (especially high reaction time variability) in a slow baseline condition, whereas there was low or no association in conditions with a faster event rate or incentives. In contrast, no clear pattern of findings emerged based on parent ratings of ADHD symptoms.

Conclusion

The data support the usefulness of the go/no-go and fast tasks for genetic studies, which require reliable and valid indices of individual differences. The overall pattern of associations between teacher ratings of ADHD symptoms and task variables is consistent with effects of event rate and incentives on performance, as predicted by the model of activation and arousal regulation. The lack of a clear pattern of findings with parent ratings of ADHD symptoms warrants further study.
Literature
1.
go back to reference Asherson PJ, IMAGE consortium: Attention deficit hyperactivity disorder in the post-genomic era. Eur J Child Adolesc Psychiatry. 2004, 150-70. Suppl 1 Asherson PJ, IMAGE consortium: Attention deficit hyperactivity disorder in the post-genomic era. Eur J Child Adolesc Psychiatry. 2004, 150-70. Suppl 1
2.
go back to reference DiMaio S, Grizenko N, Joober R: Dopamine genes and attention-deficit hyperactivity disorder: a review. J Psychiatry Neurosci. 2003, 28: 27-38.PubMedPubMedCentral DiMaio S, Grizenko N, Joober R: Dopamine genes and attention-deficit hyperactivity disorder: a review. J Psychiatry Neurosci. 2003, 28: 27-38.PubMedPubMedCentral
3.
go back to reference Faraone SV, Doyle AE: The nature and heritability of attention-deficit/hyperactivity disorder. Child Adolesc Psychiatr Clin N Am. 2001, 10: 299-316.PubMed Faraone SV, Doyle AE: The nature and heritability of attention-deficit/hyperactivity disorder. Child Adolesc Psychiatr Clin N Am. 2001, 10: 299-316.PubMed
4.
go back to reference Castellanos FX, Tannock R: Neuroscience of attention-deficit/hyperactivity disorder: the search for endophenotypes. Nat Rev Neurosci. 2002, 3: 617-628.CrossRefPubMed Castellanos FX, Tannock R: Neuroscience of attention-deficit/hyperactivity disorder: the search for endophenotypes. Nat Rev Neurosci. 2002, 3: 617-628.CrossRefPubMed
5.
go back to reference van der Meere JJ: The role of attention. Hyperactivity disorders of childhood. Edited by: Sandberg S. 2002, Cambridge: Cambridge University Press, 162-213. 2 van der Meere JJ: The role of attention. Hyperactivity disorders of childhood. Edited by: Sandberg S. 2002, Cambridge: Cambridge University Press, 162-213. 2
6.
go back to reference De Geus EJC, Boomsma DI: A genetic neuroscience approach to human cognition. Eur Psychol. 2001, 6: 241-253. 10.1027//1016-9040.6.4.241.CrossRef De Geus EJC, Boomsma DI: A genetic neuroscience approach to human cognition. Eur Psychol. 2001, 6: 241-253. 10.1027//1016-9040.6.4.241.CrossRef
7.
go back to reference Kuntsi J, Oosterlaan J, Stevenson J: Psychological mechanisms in hyperactivity: I Response inhibition deficit, working memory impairment, delay aversion, or something else?. J Child Psychol Psychiatr. 2001, 42: 199-210. 10.1017/S0021963001006709.CrossRef Kuntsi J, Oosterlaan J, Stevenson J: Psychological mechanisms in hyperactivity: I Response inhibition deficit, working memory impairment, delay aversion, or something else?. J Child Psychol Psychiatr. 2001, 42: 199-210. 10.1017/S0021963001006709.CrossRef
8.
go back to reference Levy F, Hay D, McStephen M, Wood C, Waldman I: Attention-deficit hyperactivity disorder: A category or a continuum? Genetic analysis of a large-scale twin study. J Am Acad Child Adolesc Psychiatry. 1997, 36: 737-744. 10.1097/00004583-199706000-00009.CrossRefPubMed Levy F, Hay D, McStephen M, Wood C, Waldman I: Attention-deficit hyperactivity disorder: A category or a continuum? Genetic analysis of a large-scale twin study. J Am Acad Child Adolesc Psychiatry. 1997, 36: 737-744. 10.1097/00004583-199706000-00009.CrossRefPubMed
9.
go back to reference Willcutt EG, Pennington BF, DeFries JC: Etiology of inattention and hyperactivity/impulsivity in a community sample of twins with learning difficulties. J Abnorm Child Psychol. 2000, 28: 149-159. 10.1023/A:1005170730653.CrossRefPubMed Willcutt EG, Pennington BF, DeFries JC: Etiology of inattention and hyperactivity/impulsivity in a community sample of twins with learning difficulties. J Abnorm Child Psychol. 2000, 28: 149-159. 10.1023/A:1005170730653.CrossRefPubMed
10.
go back to reference Konrad K, Gauggel S, Manz A, Schöll M: Lack of inhibition: a motivational deficit in children with attention deficit/hyperactivity disorder and children with traumatic brain injury. Child Neuropsychol. 2001, 6: 286-296.CrossRef Konrad K, Gauggel S, Manz A, Schöll M: Lack of inhibition: a motivational deficit in children with attention deficit/hyperactivity disorder and children with traumatic brain injury. Child Neuropsychol. 2001, 6: 286-296.CrossRef
11.
go back to reference Slusarek M, Velling S, Bunk D, Eggers C: Motivational effects on inhibitory control in children with ADHD. J Am Acad Child Adolesc Psychiatry. 2001, 40: 355-363. 10.1097/00004583-200103000-00016.CrossRefPubMed Slusarek M, Velling S, Bunk D, Eggers C: Motivational effects on inhibitory control in children with ADHD. J Am Acad Child Adolesc Psychiatry. 2001, 40: 355-363. 10.1097/00004583-200103000-00016.CrossRefPubMed
12.
go back to reference Oosterlaan J, Sergeant JA: Effects of reward and response cost on response inhibition in AD/HD, disruptive, anxious, and normal children. J Abnorm Child Psychol. 1998, 26: 161-174. 10.1023/A:1022650216978.CrossRefPubMed Oosterlaan J, Sergeant JA: Effects of reward and response cost on response inhibition in AD/HD, disruptive, anxious, and normal children. J Abnorm Child Psychol. 1998, 26: 161-174. 10.1023/A:1022650216978.CrossRefPubMed
13.
go back to reference van der Meere JJ, Stemerdink N, Gunning B: Effects of presentation rate of stimuli on response inhibition in ADHD children with and without tics. Percept Mot Skills. 1995, 81: 259-262.CrossRefPubMed van der Meere JJ, Stemerdink N, Gunning B: Effects of presentation rate of stimuli on response inhibition in ADHD children with and without tics. Percept Mot Skills. 1995, 81: 259-262.CrossRefPubMed
14.
go back to reference Börger N, van der Meere JJ: Motor control and state regulation in children with ADHD: a cardiac response study. Biol Psychiatry. 2000, 5: 247-267.CrossRef Börger N, van der Meere JJ: Motor control and state regulation in children with ADHD: a cardiac response study. Biol Psychiatry. 2000, 5: 247-267.CrossRef
15.
go back to reference Scheres A, Oosterlaan J, Sergeant JA: Response execution and inhibition in children with AD/HD and other disruptive disorders: the role of behavioural activation. J Child Psychol Psychiatry. 2001, 42: 347-357. 10.1017/S0021963001006898.CrossRefPubMed Scheres A, Oosterlaan J, Sergeant JA: Response execution and inhibition in children with AD/HD and other disruptive disorders: the role of behavioural activation. J Child Psychol Psychiatry. 2001, 42: 347-357. 10.1017/S0021963001006898.CrossRefPubMed
16.
go back to reference Wiersema RJ, van der Meere JJ, Roeyers H: State regulation and response inhibition in children with ADHD and children with early and continuously treated phenylketonuria: an event-related potential comparison. J Inherit Metab Dis. Wiersema RJ, van der Meere JJ, Roeyers H: State regulation and response inhibition in children with ADHD and children with early and continuously treated phenylketonuria: an event-related potential comparison. J Inherit Metab Dis.
17.
go back to reference Banaschewski T, Brandeis D, Heinrich H, Albrecht B, Brunner E, Rothenberger A: Questioning inhibitory control as the specific deficit of ADHD – evidence from brain electrical activity. J Neural Trans. 2004, 111: 841-864. 10.1007/s00702-003-0040-8.CrossRef Banaschewski T, Brandeis D, Heinrich H, Albrecht B, Brunner E, Rothenberger A: Questioning inhibitory control as the specific deficit of ADHD – evidence from brain electrical activity. J Neural Trans. 2004, 111: 841-864. 10.1007/s00702-003-0040-8.CrossRef
18.
go back to reference Leth-Steensen C, King Elbaz Z, Douglas VI: Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach. Acta Psychologica. 2000, 104: 167-190. 10.1016/S0001-6918(00)00019-6.CrossRefPubMed Leth-Steensen C, King Elbaz Z, Douglas VI: Mean response times, variability, and skew in the responding of ADHD children: a response time distributional approach. Acta Psychologica. 2000, 104: 167-190. 10.1016/S0001-6918(00)00019-6.CrossRefPubMed
19.
go back to reference Zentall SS, Zentall TR: Optimal stimulation: a model of disordered activity and performance in normal and deviant children. Psychol Bull. 1983, 94: 446-471. 10.1037//0033-2909.94.3.446.CrossRefPubMed Zentall SS, Zentall TR: Optimal stimulation: a model of disordered activity and performance in normal and deviant children. Psychol Bull. 1983, 94: 446-471. 10.1037//0033-2909.94.3.446.CrossRefPubMed
20.
go back to reference Sergeant JA, Oosterlaan J, van der Meere JJ: Information processing and energetic factors in attention-deficit/hyperactivity disorder. Handbook of disruptive behaviour disorders. Edited by: Quay HC, Hogan A. 1999, New York: Plenum Press, 75-104.CrossRef Sergeant JA, Oosterlaan J, van der Meere JJ: Information processing and energetic factors in attention-deficit/hyperactivity disorder. Handbook of disruptive behaviour disorders. Edited by: Quay HC, Hogan A. 1999, New York: Plenum Press, 75-104.CrossRef
21.
go back to reference Mason DJ, Humphreys GW, Kent LS: Exploring selective attention in ADHD: visual search through space and time. J Child Psychol Psychiatry. 2003, 44: 1158-1176. 10.1111/1469-7610.00204.CrossRefPubMed Mason DJ, Humphreys GW, Kent LS: Exploring selective attention in ADHD: visual search through space and time. J Child Psychol Psychiatry. 2003, 44: 1158-1176. 10.1111/1469-7610.00204.CrossRefPubMed
22.
go back to reference van der Meere J: ADHD and state regulation. Attention deficit hyperactivity disorder: from genes to patients. Edited by: Gozal D, Molfese DL. 2005, NJ: Humana Press Inc, 413-422.CrossRef van der Meere J: ADHD and state regulation. Attention deficit hyperactivity disorder: from genes to patients. Edited by: Gozal D, Molfese DL. 2005, NJ: Humana Press Inc, 413-422.CrossRef
23.
go back to reference Kuntsi J, Stevenson J, Oosterlaan J, Sonuga-Barke EJS: Test-retest reliability of a new delay aversion task and executive function measures. B J Dev Psychol. 2001, 19: 339-338. 10.1348/026151001166137.CrossRef Kuntsi J, Stevenson J, Oosterlaan J, Sonuga-Barke EJS: Test-retest reliability of a new delay aversion task and executive function measures. B J Dev Psychol. 2001, 19: 339-338. 10.1348/026151001166137.CrossRef
24.
go back to reference Kuntsi J, Stevenson J: Psychological mechanisms in hyperactivity: II The role of genetic factors. J Child Psychol Psychiatr. 2001, 42: 211-219. 10.1017/S0021963001006710.CrossRef Kuntsi J, Stevenson J: Psychological mechanisms in hyperactivity: II The role of genetic factors. J Child Psychol Psychiatr. 2001, 42: 211-219. 10.1017/S0021963001006710.CrossRef
25.
go back to reference Nigg J, Blaskey L, Stawicki JA, Sachek J: Evaluating the endophenotype model of ADHD neuropsychological deficit: results for parents and siblings with DSM-IV ADHD combined and inattentive subtypes. J Abnorm Psychol. 2004, 113: 614-625. 10.1037/0021-843X.113.4.614.CrossRefPubMed Nigg J, Blaskey L, Stawicki JA, Sachek J: Evaluating the endophenotype model of ADHD neuropsychological deficit: results for parents and siblings with DSM-IV ADHD combined and inattentive subtypes. J Abnorm Psychol. 2004, 113: 614-625. 10.1037/0021-843X.113.4.614.CrossRefPubMed
26.
go back to reference Conners CK, Sitarenios G, Parker JDA, Epstein JN: The revised Conners' Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998, 26: 257-268. 10.1023/A:1022602400621.CrossRefPubMed Conners CK, Sitarenios G, Parker JDA, Epstein JN: The revised Conners' Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998, 26: 257-268. 10.1023/A:1022602400621.CrossRefPubMed
27.
go back to reference Conners CK, Sitarenios G, Parker JDA, Epstein JN: Revision and restandardization of the Conners Teacher Rating Scale (CTRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998, 26: 279-291. 10.1023/A:1022606501530.CrossRefPubMed Conners CK, Sitarenios G, Parker JDA, Epstein JN: Revision and restandardization of the Conners Teacher Rating Scale (CTRS-R): factor structure, reliability, and criterion validity. J Abnorm Child Psychol. 1998, 26: 279-291. 10.1023/A:1022606501530.CrossRefPubMed
28.
go back to reference Conners CK: Conners' Rating Scales-Revised: technical manual. 1997, North Tonawanda: Multi-Health Systems Inc Conners CK: Conners' Rating Scales-Revised: technical manual. 1997, North Tonawanda: Multi-Health Systems Inc
29.
go back to reference Wechsler D: Wechsler Intelligence Scale for Children. 1991, UK. London: The Psychological Corporation, Third Wechsler D: Wechsler Intelligence Scale for Children. 1991, UK. London: The Psychological Corporation, Third
30.
go back to reference Sattler JM: Assessment of children: WISC-III and WPPSI-R supplement. San Diego: CA. 1992 Sattler JM: Assessment of children: WISC-III and WPPSI-R supplement. San Diego: CA. 1992
31.
go back to reference Rousson V, Gasser T, Seifert B: Assessing intrarater, interrater and test-retest reliability of continuous measurements. Stat Med. 2002, 21: 3431-3446. 10.1002/sim.1253.CrossRefPubMed Rousson V, Gasser T, Seifert B: Assessing intrarater, interrater and test-retest reliability of continuous measurements. Stat Med. 2002, 21: 3431-3446. 10.1002/sim.1253.CrossRefPubMed
32.
go back to reference Kuntsi J, Eley TC, Taylor A, Hughes C, Asherson P, Caspi A, Moffitt TE: Co-occurrence of ADHD and low IQ has genetic origins. Am J Med Genet (Neuropsychiatric Genetics). 2004, 124B: 41-47. 10.1002/ajmg.b.20076.CrossRef Kuntsi J, Eley TC, Taylor A, Hughes C, Asherson P, Caspi A, Moffitt TE: Co-occurrence of ADHD and low IQ has genetic origins. Am J Med Genet (Neuropsychiatric Genetics). 2004, 124B: 41-47. 10.1002/ajmg.b.20076.CrossRef
33.
go back to reference Ryan JJ, Lopez SJ, Sumerall SW: Understanding test construction. Understanding psychological assessment. Edited by: Dorman WI, Hersen M. 2001, New York: Kluwer Academic/Plenum Publishers Ryan JJ, Lopez SJ, Sumerall SW: Understanding test construction. Understanding psychological assessment. Edited by: Dorman WI, Hersen M. 2001, New York: Kluwer Academic/Plenum Publishers
34.
go back to reference Fergusson DM, Horwood LJ, Lynskey MT: The effects of conduct disorder and attention deficit in middle childhood on offending and scholastic ability at age 13. J Child Psychol Psychiatr. 1993, 34: 899-916.CrossRef Fergusson DM, Horwood LJ, Lynskey MT: The effects of conduct disorder and attention deficit in middle childhood on offending and scholastic ability at age 13. J Child Psychol Psychiatr. 1993, 34: 899-916.CrossRef
35.
go back to reference Goodman R, Simonoff E, Stevenson J: The impact of child IQ, parent IQ and sibling IQ on child behavioural deviance scores. J Child Psychol Psychiatr. 1995, 36: 409-425.CrossRef Goodman R, Simonoff E, Stevenson J: The impact of child IQ, parent IQ and sibling IQ on child behavioural deviance scores. J Child Psychol Psychiatr. 1995, 36: 409-425.CrossRef
36.
go back to reference Rapport MD, Scanlan SW, Denney CB: Attention-deficit/hyperactivity disorder and scholastic achievement: A model of dual developmental pathways. J Child Psychol Psychiatry. 1999, 40: 1169-1183. 10.1017/S0021963099004618.CrossRefPubMed Rapport MD, Scanlan SW, Denney CB: Attention-deficit/hyperactivity disorder and scholastic achievement: A model of dual developmental pathways. J Child Psychol Psychiatry. 1999, 40: 1169-1183. 10.1017/S0021963099004618.CrossRefPubMed
37.
go back to reference Oosterlaan J, Scheres A, Sergeant JA: Which executive functioning deficits are associated with AD/HD, ODD/CD and combordid AD/HD + ODD/CD?. J Abnorm Child Psychol. 2005, 33: 69-85. 10.1007/s10802-005-0935-y.CrossRefPubMed Oosterlaan J, Scheres A, Sergeant JA: Which executive functioning deficits are associated with AD/HD, ODD/CD and combordid AD/HD + ODD/CD?. J Abnorm Child Psychol. 2005, 33: 69-85. 10.1007/s10802-005-0935-y.CrossRefPubMed
38.
go back to reference Martin N, Scourfield J, McGuffin P: Observer effects and heritability of childhood attention-deficit hyperactivity disorder symptoms. B J Psychiatry. 2002, 180: 260-265. 10.1192/bjp.180.3.260.CrossRef Martin N, Scourfield J, McGuffin P: Observer effects and heritability of childhood attention-deficit hyperactivity disorder symptoms. B J Psychiatry. 2002, 180: 260-265. 10.1192/bjp.180.3.260.CrossRef
39.
go back to reference Gomez R, Harvey J, Quick C, Scharer I, Harris G: DSM-IV AD/HD: confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. J Child Psychol Psychiatr. 1999, 40: 265-274. 10.1017/S0021963098003321.CrossRef Gomez R, Harvey J, Quick C, Scharer I, Harris G: DSM-IV AD/HD: confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. J Child Psychol Psychiatr. 1999, 40: 265-274. 10.1017/S0021963098003321.CrossRef
40.
go back to reference Nadder TS, Silberg JL, Rutter M, Maes HH, Eaves LE: Comparisons of multiple measures of ADHD symptomatology: a multivariate genetic analysis. J Child Psychol Psychiatry. 2001, 42: 475-486. 10.1017/S0021963001007119.CrossRefPubMed Nadder TS, Silberg JL, Rutter M, Maes HH, Eaves LE: Comparisons of multiple measures of ADHD symptomatology: a multivariate genetic analysis. J Child Psychol Psychiatry. 2001, 42: 475-486. 10.1017/S0021963001007119.CrossRefPubMed
41.
go back to reference Nadder TS, Rutter M, Silberg JL, Maes HH, Eaves LJ: Genetic effects on the variation and covariation of attention deficit-hyperactivity disorder (ADHD) and oppositional-defiant disorder/conduct disorder (ODD/CD) symptomatologies across informant and occasion of measurement. Psychol Med. 2002, 32: 39-53.CrossRefPubMed Nadder TS, Rutter M, Silberg JL, Maes HH, Eaves LJ: Genetic effects on the variation and covariation of attention deficit-hyperactivity disorder (ADHD) and oppositional-defiant disorder/conduct disorder (ODD/CD) symptomatologies across informant and occasion of measurement. Psychol Med. 2002, 32: 39-53.CrossRefPubMed
42.
go back to reference Chhabildas NA, Pennington BF, Willcutt EG: A comparison of the neuropsychological profiles of the DSM-IV subtypes of ADHD. J Abnorm Child Psychol. 2001, 29: 529-540. 10.1023/A:1012281226028.CrossRefPubMed Chhabildas NA, Pennington BF, Willcutt EG: A comparison of the neuropsychological profiles of the DSM-IV subtypes of ADHD. J Abnorm Child Psychol. 2001, 29: 529-540. 10.1023/A:1012281226028.CrossRefPubMed
43.
go back to reference Todd RD, Sitdhiraksa N, Reich W, Ji TH, Joyner CA, Heath AC, Neuman RJ: Discrimination of DSM-IV and latent class attention-deficit/hyperactivity disorder subtypes by educational and cognitive performance in a population-based sample of child and adolescent twins. J Am Acad Child Adolesc Psychiatry. 2002, 41: 820-828. 10.1097/00004583-200207000-00014.CrossRefPubMed Todd RD, Sitdhiraksa N, Reich W, Ji TH, Joyner CA, Heath AC, Neuman RJ: Discrimination of DSM-IV and latent class attention-deficit/hyperactivity disorder subtypes by educational and cognitive performance in a population-based sample of child and adolescent twins. J Am Acad Child Adolesc Psychiatry. 2002, 41: 820-828. 10.1097/00004583-200207000-00014.CrossRefPubMed
44.
go back to reference Swanson JM, Sergeant JA, Taylor E, Sonuga-Barke EJS, Jensen PS, Cantwell DP: Attention-deficit hyperactivity disorder and hyperkinetic disorder. Lancet. 1998, 351: 429-433. 10.1016/S0140-6736(97)11450-7.CrossRefPubMed Swanson JM, Sergeant JA, Taylor E, Sonuga-Barke EJS, Jensen PS, Cantwell DP: Attention-deficit hyperactivity disorder and hyperkinetic disorder. Lancet. 1998, 351: 429-433. 10.1016/S0140-6736(97)11450-7.CrossRefPubMed
Metadata
Title
Testing assumptions for endophenotype studies in ADHD: Reliability and validity of tasks in a general population sample
Authors
Jonna Kuntsi
Penny Andreou
Jonathan Ma
Norbert A Börger
Jaap J van der Meere
Publication date
01-12-2005
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2005
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/1471-244X-5-40

Other articles of this Issue 1/2005

BMC Psychiatry 1/2005 Go to the issue