Skip to main content
Top
Published in: BMC Psychiatry 1/2019

Open Access 01-12-2019 | Autism Spectrum Disorder | Research article

The development of a brief screener for autism using item response theory

Authors: Caroline Mårland, Gitta Lubke, Alessio Degl’Innocenti, Maria Råstam, Christopher Gillberg, Thomas Nilsson, Sebastian Lundström

Published in: BMC Psychiatry | Issue 1/2019

Login to get access

Abstract

Background

Brief screening instruments focusing on autism spectrum disorder (ASD) that can be administered in primary care are scarce; there is a need for shorter and more precise instruments. The Autism–Tics, AD/HD and other Comorbidities inventory (A-TAC) has previously been validated for ASD reporting excellent validity. This study aims to determine the psychometric properties of each item in the ASD domain (17 items) in the A–TAC using item response theory (IRT), and thereby construct and validate a short form that could be used as a screening instrument in the general population.

Methods

Since 2004, parents of all 9-year-old Swedish twins have been invited to participate in a telephone interview in the Child and Adolescent Twin Study in Sweden (CATSS). The CATSS is linked to the National Patient Register (NPR), which includes data from in- and outpatient care. Data on ASD (A-TAC) collected in CATSS were compared with diagnoses from the NPR. Diagnoses that had been made both before (previous validity) and after (predictive validity) the interviews were included. The sample was divided into a developmental sample and a validation sample. An IRT model was fitted to the developmental sample and item parameters were used to select a subset of items for the short form. The performance of the proposed short form was examined in the validation sample by the use of receiver operation characteristic curves.

Results

Four items which were able to discriminate among individuals with more autism traits were deemed sufficient for use in the short form. The values of the area under the receiver operating characteristic curve for a clinical diagnosis of ASD was .95 (previous validity) and .72 (predictive validity).

Conclusions

The proposed short form with 4 out of the original 17 items from A-TAC, showed excellent previous validity while the predictive validity was fair. The validity of the short form was in agreement with previous validations of the full ASD domain. The short form can be a valuable screening instrument in primary care settings in order to identify individuals in need for further assessment and for use in epidemiological studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fifth edition (DSM-5). Arlington, VA: American Psychiatric Association; 2013.CrossRef American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fifth edition (DSM-5). Arlington, VA: American Psychiatric Association; 2013.CrossRef
2.
go back to reference Constantino JN, Todd RD. Autistic traits in the general population: a twin study. Arch Gen Psychiatry. 2003;60(5):524–30.CrossRef Constantino JN, Todd RD. Autistic traits in the general population: a twin study. Arch Gen Psychiatry. 2003;60(5):524–30.CrossRef
3.
go back to reference Lundström S, Chang Z, Råstam M, Gillberg C, Larsson H, Anckarsäter H, et al. Autism spectrum disorders and autisticlike traits: similar etiology in the extreme end and the normal variation. Arch Gen Psychiatry. 2012;69(1):46–52.CrossRef Lundström S, Chang Z, Råstam M, Gillberg C, Larsson H, Anckarsäter H, et al. Autism spectrum disorders and autisticlike traits: similar etiology in the extreme end and the normal variation. Arch Gen Psychiatry. 2012;69(1):46–52.CrossRef
4.
go back to reference World Health Organization. International statistical classification of diseases and related health problems, tenth revision (ICD-10). Geneva: World Health Organization; 1992. World Health Organization. International statistical classification of diseases and related health problems, tenth revision (ICD-10). Geneva: World Health Organization; 1992.
6.
go back to reference Penner M, Anagnostou E, Andoni LY, Ungar WJ. Systematic review of clinical guidance documents for autism spectrum disorder diagnostic assessment in select regions. Autism. 2018;22(5):517–27.CrossRef Penner M, Anagnostou E, Andoni LY, Ungar WJ. Systematic review of clinical guidance documents for autism spectrum disorder diagnostic assessment in select regions. Autism. 2018;22(5):517–27.CrossRef
7.
go back to reference Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31(2):131–44.CrossRef Robins DL, Fein D, Barton ML, Green JA. The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord. 2001;31(2):131–44.CrossRef
8.
go back to reference Ehlers S, Gillberg C. The epidemiology of Asperger syndrome. A total population study. J Child Psychol Psychiatry. 1993;34(8):1327–50.CrossRef Ehlers S, Gillberg C. The epidemiology of Asperger syndrome. A total population study. J Child Psychol Psychiatry. 1993;34(8):1327–50.CrossRef
9.
go back to reference Ehlers S, Gillberg C, Wing L. A screening questionnaire for Asperger syndrome and other high-functioning autism spectrum disorders in school age children. J Autism Dev Disord. 1999;29(2):129–41.CrossRef Ehlers S, Gillberg C, Wing L. A screening questionnaire for Asperger syndrome and other high-functioning autism spectrum disorders in school age children. J Autism Dev Disord. 1999;29(2):129–41.CrossRef
10.
go back to reference Rutter M, Bailey A, Lord C. Social Communication Questionnaire. Los Angeles: Western Psychological Services; 2003. Rutter M, Bailey A, Lord C. Social Communication Questionnaire. Los Angeles: Western Psychological Services; 2003.
11.
go back to reference Berument SK, Rutter M, Lord C, Pickles A, Bailey A. Autism screening questionnaire: diagnostic validity. Br J Psychiatry. 1999;175:444–51.CrossRef Berument SK, Rutter M, Lord C, Pickles A, Bailey A. Autism screening questionnaire: diagnostic validity. Br J Psychiatry. 1999;175:444–51.CrossRef
12.
go back to reference Constantino JN, Gruber CP. Social Responsiveness scale. Los Angeles: Western Psychological Services; 2005. Constantino JN, Gruber CP. Social Responsiveness scale. Los Angeles: Western Psychological Services; 2005.
13.
go back to reference Larson T, Anckarsäter H, Gillberg C, Ståhlberg O, Carlström E, Kadesjö B, et al. (2010). The autism–tics, AD/HD and other comorbidities inventory (A-TAC): further validation of a telephone interview for epidemiological research. BMC Psychiatry. 2010;10:1. Larson T, Anckarsäter H, Gillberg C, Ståhlberg O, Carlström E, Kadesjö B, et al. (2010). The autism–tics, AD/HD and other comorbidities inventory (A-TAC): further validation of a telephone interview for epidemiological research. BMC Psychiatry. 2010;10:1.
14.
go back to reference DeVellis RF. Scale development: theory and applications. 3 ed. Thousand Oaks, California: Sage Publications; 2012. DeVellis RF. Scale development: theory and applications. 3 ed. Thousand Oaks, California: Sage Publications; 2012.
15.
go back to reference Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16:5–18.CrossRef Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16:5–18.CrossRef
16.
go back to reference Reise SP, Waller NG. Item response theory and clinical measurement. Annu Rev Clin Psychol. 2009;5:27–48.CrossRef Reise SP, Waller NG. Item response theory and clinical measurement. Annu Rev Clin Psychol. 2009;5:27–48.CrossRef
17.
go back to reference Sturm A, Kuhfeld M, Kasari C, McCracken JT. Development and validation of an item response theory-based social responsiveness scale short form. J Child Psychol Psychiatry. 2017;58(9):1053–61.CrossRef Sturm A, Kuhfeld M, Kasari C, McCracken JT. Development and validation of an item response theory-based social responsiveness scale short form. J Child Psychol Psychiatry. 2017;58(9):1053–61.CrossRef
18.
go back to reference Hansson SL, Svanström Röjvall A, Rastam M, Gillberg C, Gillberg C, Anckarsäter H. Psychiatric telephone interview with parents for screening of childhood autism–tics, attention-deficit hyperactivity disorder and other comorbidities (A-TAC): preliminary reliability and validity. Br J Psychiatry. 2005;187:262–7.CrossRef Hansson SL, Svanström Röjvall A, Rastam M, Gillberg C, Gillberg C, Anckarsäter H. Psychiatric telephone interview with parents for screening of childhood autism–tics, attention-deficit hyperactivity disorder and other comorbidities (A-TAC): preliminary reliability and validity. Br J Psychiatry. 2005;187:262–7.CrossRef
19.
go back to reference Cubo E, Sáez Velasco S, Delgado Benito V, Ausín Villaverde V, García Soto XR, Trejo Gabriel Y, Galán JM, et al. Psychometric attributes of the Spanish version of A-TAC screening scale for autism spectrum disorders. An Pediatr (Barc). 2011;75:40–50.CrossRef Cubo E, Sáez Velasco S, Delgado Benito V, Ausín Villaverde V, García Soto XR, Trejo Gabriel Y, Galán JM, et al. Psychometric attributes of the Spanish version of A-TAC screening scale for autism spectrum disorders. An Pediatr (Barc). 2011;75:40–50.CrossRef
20.
go back to reference Larson T, Lundström S, Nilsson T, Selinus EN, Råstam M, Lichtenstein P, et al. Predictive properties of the A-TAC inventory when screening for childhood-onset neurodevelopmental problems in a population-based sample. BMC Psychiatry. 2013;13:233.CrossRef Larson T, Lundström S, Nilsson T, Selinus EN, Råstam M, Lichtenstein P, et al. Predictive properties of the A-TAC inventory when screening for childhood-onset neurodevelopmental problems in a population-based sample. BMC Psychiatry. 2013;13:233.CrossRef
21.
go back to reference Larson T, Kerekes N, Selinus EN, Lichtenstein P, Gumpert CH, Anckarsäter H, et al. Reliability of autism–tics, AD/HD, and other comorbidities (A-TAC) inventory in a test-retest design. Psychol Rep. 2014;114:93–103.CrossRef Larson T, Kerekes N, Selinus EN, Lichtenstein P, Gumpert CH, Anckarsäter H, et al. Reliability of autism–tics, AD/HD, and other comorbidities (A-TAC) inventory in a test-retest design. Psychol Rep. 2014;114:93–103.CrossRef
22.
go back to reference Mårland C, Lichtenstein P, Degl’Innocenti A, Larson T, Råstam M, Anckarsäter H, et al. The autism–tics, ADHD and other comorbidities inventory (A-TAC): previous and predictive validity. BMC Psychiatry. 2017;17(1):403.CrossRef Mårland C, Lichtenstein P, Degl’Innocenti A, Larson T, Råstam M, Anckarsäter H, et al. The autism–tics, ADHD and other comorbidities inventory (A-TAC): previous and predictive validity. BMC Psychiatry. 2017;17(1):403.CrossRef
23.
go back to reference Anckarsäter H, Lundström S, Kollberg L, Kerekes N, Palm C, Carlström E, et al. The child and adolescent twin study in Sweden (CATSS). Twin Res and Hum Genet. 2011;14(6):495–508.CrossRef Anckarsäter H, Lundström S, Kollberg L, Kerekes N, Palm C, Carlström E, et al. The child and adolescent twin study in Sweden (CATSS). Twin Res and Hum Genet. 2011;14(6):495–508.CrossRef
24.
go back to reference World Health Organization. International statistical classification of diseases and related health problems, ninth revision (ICD-9). Geneva: World Health Organization; 1979. World Health Organization. International statistical classification of diseases and related health problems, ninth revision (ICD-9). Geneva: World Health Organization; 1979.
26.
go back to reference Idring S, Rai D, Dal H, Dalman C, Sturm H, Zander E, et al. Autism spectrum disorders in the Stockholm youth cohort: design, prevalence and validity. PLoS One. 2012;7:e41280.CrossRef Idring S, Rai D, Dal H, Dalman C, Sturm H, Zander E, et al. Autism spectrum disorders in the Stockholm youth cohort: design, prevalence and validity. PLoS One. 2012;7:e41280.CrossRef
27.
go back to reference American Psychiatric Association. Diagnostic and statistical manual of mental disorders 4th edition (DSM-IV). Washington DC: American Psychiatric Association; 1994. American Psychiatric Association. Diagnostic and statistical manual of mental disorders 4th edition (DSM-IV). Washington DC: American Psychiatric Association; 1994.
28.
go back to reference Gillberg C, Gillberg IC, Råstam M, Wentz E. The Asperger syndrome (and high-functioning autism) diagnostic interview (ASDI): a preliminary study of a new structured clinical interview. Autism. 2001;5:57–66.CrossRef Gillberg C, Gillberg IC, Råstam M, Wentz E. The Asperger syndrome (and high-functioning autism) diagnostic interview (ASDI): a preliminary study of a new structured clinical interview. Autism. 2001;5:57–66.CrossRef
29.
go back to reference Kadesjö B, Janols L, Korkman M, Mickelsson K, Strand G, Trillingsgaard A, Gillberg C. The FTF (five to fifteen): the development of a parent questionnaire for the assessment of ADHD and comorbid conditions. Eur Child Adolesc Psychiatry. 2004;13:3–13.CrossRef Kadesjö B, Janols L, Korkman M, Mickelsson K, Strand G, Trillingsgaard A, Gillberg C. The FTF (five to fifteen): the development of a parent questionnaire for the assessment of ADHD and comorbid conditions. Eur Child Adolesc Psychiatry. 2004;13:3–13.CrossRef
31.
go back to reference Lundström S, Reichenberg A, Anckarsäter H, Lichtenstein P, Gillberg C. Autism phenotype versus registered diagnosis in Swedish children: prevalence trends over 10 years in general population samples. BMJ. 2015;350:h1961.CrossRef Lundström S, Reichenberg A, Anckarsäter H, Lichtenstein P, Gillberg C. Autism phenotype versus registered diagnosis in Swedish children: prevalence trends over 10 years in general population samples. BMJ. 2015;350:h1961.CrossRef
32.
go back to reference Dawson G, Rogers S, Munson J, Smith M, Winter J, Greenson J, et al. Randomized, controlled trial of an intervention for toddlers with autism: the early start Denver model. Pediatrics. 2010;125(1):e17–23.CrossRef Dawson G, Rogers S, Munson J, Smith M, Winter J, Greenson J, et al. Randomized, controlled trial of an intervention for toddlers with autism: the early start Denver model. Pediatrics. 2010;125(1):e17–23.CrossRef
33.
go back to reference Zwaigenbaum L, Penner M. Autism spectrum disorder: advances in diagnosis and evaluation. BMJ. 2018;361:k1674.CrossRef Zwaigenbaum L, Penner M. Autism spectrum disorder: advances in diagnosis and evaluation. BMJ. 2018;361:k1674.CrossRef
34.
go back to reference Volkmar F, Siegel M, Woodbury-Smith M, King B, McCracken J, State M, et al. Practice parameter for the assessment and treatment of children and adolescents with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry. 2014;53(2):237–57.CrossRef Volkmar F, Siegel M, Woodbury-Smith M, King B, McCracken J, State M, et al. Practice parameter for the assessment and treatment of children and adolescents with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry. 2014;53(2):237–57.CrossRef
35.
go back to reference American Academy of Pediatrics. Identifying infants and young children with developmental disorders in the medical home: an algorithm for developmental surveillance and screening. Pediatrics. 2006;118(1):405–20.CrossRef American Academy of Pediatrics. Identifying infants and young children with developmental disorders in the medical home: an algorithm for developmental surveillance and screening. Pediatrics. 2006;118(1):405–20.CrossRef
36.
go back to reference Robins DL. Screening for autism spectrum disorders in primary care settings. Autism. 2008;12(5):537–56.CrossRef Robins DL. Screening for autism spectrum disorders in primary care settings. Autism. 2008;12(5):537–56.CrossRef
37.
go back to reference Arvidsson O, Gillberg C, Lichtenstein P, Lundström L. Secular changes in the symptom level of clinically diagnosed autism. J Child Psychol Psychiatry. 2018;59(7):744–51.CrossRef Arvidsson O, Gillberg C, Lichtenstein P, Lundström L. Secular changes in the symptom level of clinically diagnosed autism. J Child Psychol Psychiatry. 2018;59(7):744–51.CrossRef
39.
go back to reference Loomes R, Hull L, Mandy WPL. What is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry. 2017;56(6):466–74.CrossRef Loomes R, Hull L, Mandy WPL. What is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. J Am Acad Child Adolesc Psychiatry. 2017;56(6):466–74.CrossRef
40.
go back to reference Betancur C, Leboyer M, Gillberg C. Increased rate of twins among affected sibling pairs with autism. Am J Hum Genet. 2002;70(5):1381–3.CrossRef Betancur C, Leboyer M, Gillberg C. Increased rate of twins among affected sibling pairs with autism. Am J Hum Genet. 2002;70(5):1381–3.CrossRef
41.
go back to reference Greenberg DA, Hodge SE, Sowinski J, Nicoll D. Excess of twins among affected sibling pairs with autism: implications for the etiology of autism. Am J Hum Genet. 2001;69(5):1062–7.CrossRef Greenberg DA, Hodge SE, Sowinski J, Nicoll D. Excess of twins among affected sibling pairs with autism: implications for the etiology of autism. Am J Hum Genet. 2001;69(5):1062–7.CrossRef
42.
go back to reference Hallmayer J, Glasson EJ, Bower C, Petterson B, Croen L, Grether J, et al. On the twin risk of autism. Am J Hum Genet. 2002;71(4):941–6.CrossRef Hallmayer J, Glasson EJ, Bower C, Petterson B, Croen L, Grether J, et al. On the twin risk of autism. Am J Hum Genet. 2002;71(4):941–6.CrossRef
43.
go back to reference Croen LA, Grether JK, Selvin S. Descriptive epidemiology of autism in a California population: who is at risk? J Autism Dev Disord. 2002;32(3):217–24.CrossRef Croen LA, Grether JK, Selvin S. Descriptive epidemiology of autism in a California population: who is at risk? J Autism Dev Disord. 2002;32(3):217–24.CrossRef
44.
go back to reference Hultman CM, Sparén P, Cnattingius S. Perinatal risk factors for infantile autism. Epidemiology. 2002;13(4):417–23.CrossRef Hultman CM, Sparén P, Cnattingius S. Perinatal risk factors for infantile autism. Epidemiology. 2002;13(4):417–23.CrossRef
Metadata
Title
The development of a brief screener for autism using item response theory
Authors
Caroline Mårland
Gitta Lubke
Alessio Degl’Innocenti
Maria Råstam
Christopher Gillberg
Thomas Nilsson
Sebastian Lundström
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Psychiatry / Issue 1/2019
Electronic ISSN: 1471-244X
DOI
https://doi.org/10.1186/s12888-019-2333-y

Other articles of this Issue 1/2019

BMC Psychiatry 1/2019 Go to the issue