Skip to main content
Top
Published in: European Child & Adolescent Psychiatry 1/2021

Open Access 01-01-2021 | Developmental Disorder | Brief Report

A short note on the reliability of perceptual timing tasks as commonly used in research on developmental disorders

Authors: Ivo Marx, Katya Rubia, Olaf Reis, Valdas Noreika

Published in: European Child & Adolescent Psychiatry | Issue 1/2021

Login to get access

Abstract

Objectives

Perceptual timing tasks are frequently applied in research on developmental disorders, but information on their reliability is lacking in pediatric studies. We therefore aimed to assess the reliability of the four paradigms most frequently used, i.e., time discrimination, time estimation, time production, and time reproduction.

Methods

Based on the data from our recent longitudinal study by Marx et al. (Front Hum Neurosci 11:122, 2017), we estimated the internal consistency and test–retest reliability of these tasks in children with ADHD and typically developing children. Individual thresholds were used as dependent measures for the time discrimination task, whereas absolute error and accuracy coefficient scores were used for the other three tasks.

Results

Although less commonly used, the time estimation paradigm was the most robust measure of perceptual timing in terms of internal consistency and test–retest reliability in both ADHD and typically developing children, whereas the most frequently used paradigms showed poor internal consistency (time reproduction) and poor test–retest reliability (time discrimination). Compared to the absolute errors, accuracy coefficients showed almost exclusively higher internal consistency and test–retest reliability.

Conclusions

Our findings call for more frequent use of the time estimation paradigm in studies of perceptual timing in ADHD. The time reproduction paradigm should be re-considered, avoiding pooling of a wide range of time intervals (2–48 s). The accuracy coefficient score is the more reliable and the more intuitive dependent variable and should be preferred in future timing research. To increase the reliability of the timing measurement, each experimental session should be performed twice, if possible.
Literature
1.
go back to reference Noreika V, Falter CM, Rubia K (2013) Timing deficits in attention-deficit/hyperactivity disorder (ADHD): evidence from neurocognitive and neuroimaging studies. Neuropsychologia 51:235–266CrossRef Noreika V, Falter CM, Rubia K (2013) Timing deficits in attention-deficit/hyperactivity disorder (ADHD): evidence from neurocognitive and neuroimaging studies. Neuropsychologia 51:235–266CrossRef
2.
go back to reference Marx I, Weirich S, Berger C, Herpertz SC, Cohrs S, Wandschneider R et al (2017) Living in the fast lane: evidence for a global perceptual timing deficit in childhood ADHD caused by distinct but partially overlapping task-dependent cognitive mechanisms. Front Hum Neurosci 11:122CrossRef Marx I, Weirich S, Berger C, Herpertz SC, Cohrs S, Wandschneider R et al (2017) Living in the fast lane: evidence for a global perceptual timing deficit in childhood ADHD caused by distinct but partially overlapping task-dependent cognitive mechanisms. Front Hum Neurosci 11:122CrossRef
3.
go back to reference Gooch D, Snowling M, Hulme C (2011) Time perception, phonological skills and executive function in children with dyslexia and/or ADHD symptoms. J Child Psychol Psychiatry 52:195–203CrossRef Gooch D, Snowling M, Hulme C (2011) Time perception, phonological skills and executive function in children with dyslexia and/or ADHD symptoms. J Child Psychol Psychiatry 52:195–203CrossRef
4.
go back to reference Karaminis T, Cicchini GM, Neil L, Cappagli G, Aagten-Murphy D, Burr D et al (2016) Central tendency effects in time interval reproduction in autism. Sci Rep 6:28570CrossRef Karaminis T, Cicchini GM, Neil L, Cappagli G, Aagten-Murphy D, Burr D et al (2016) Central tendency effects in time interval reproduction in autism. Sci Rep 6:28570CrossRef
5.
go back to reference Isaksson S, Salomäki S, Tuominen J, Arstila V, Falter-Wagner CM et al (2018) Is there a generalized timing impairment in autism spectrum disorders across time scales and paradigms? J Psychiatr Res 99:111–121CrossRef Isaksson S, Salomäki S, Tuominen J, Arstila V, Falter-Wagner CM et al (2018) Is there a generalized timing impairment in autism spectrum disorders across time scales and paradigms? J Psychiatr Res 99:111–121CrossRef
6.
go back to reference Rubia K, Halari R, Christakou A, Taylor E (2009) Impulsiveness as a timing disturbance: neurocognitive abnormalities in attention-deficit hyperactivity disorder during temporal processes and normalization with methylphenidate. Philos Trans R Soc Lond B Biol Sci 364:1919–1931CrossRef Rubia K, Halari R, Christakou A, Taylor E (2009) Impulsiveness as a timing disturbance: neurocognitive abnormalities in attention-deficit hyperactivity disorder during temporal processes and normalization with methylphenidate. Philos Trans R Soc Lond B Biol Sci 364:1919–1931CrossRef
7.
go back to reference Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428CrossRef Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428CrossRef
8.
go back to reference Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163CrossRef Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163CrossRef
9.
go back to reference Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:284CrossRef Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:284CrossRef
10.
go back to reference Rubia K, Smith A (2004) The neural correlates of cognitive time management: a review. Acta Neurobiol Exp (Wars) 64:329–340 Rubia K, Smith A (2004) The neural correlates of cognitive time management: a review. Acta Neurobiol Exp (Wars) 64:329–340
Metadata
Title
A short note on the reliability of perceptual timing tasks as commonly used in research on developmental disorders
Authors
Ivo Marx
Katya Rubia
Olaf Reis
Valdas Noreika
Publication date
01-01-2021
Publisher
Springer Berlin Heidelberg
Published in
European Child & Adolescent Psychiatry / Issue 1/2021
Print ISSN: 1018-8827
Electronic ISSN: 1435-165X
DOI
https://doi.org/10.1007/s00787-020-01474-y

Other articles of this Issue 1/2021

European Child & Adolescent Psychiatry 1/2021 Go to the issue