Skip to main content
Top
Published in: Journal of Neurodevelopmental Disorders 1/2014

Open Access 01-12-2014 | New method

Improving IQ measurement in intellectual disabilities using true deviation from population norms

Authors: Stephanie M Sansone, Andrea Schneider, Erika Bickel, Elizabeth Berry-Kravis, Christina Prescott, David Hessl

Published in: Journal of Neurodevelopmental Disorders | Issue 1/2014

Login to get access

Abstract

Background

Intellectual disability (ID) is characterized by global cognitive deficits, yet the very IQ tests used to assess ID have limited range and precision in this population, especially for more impaired individuals.

Methods

We describe the development and validation of a method of raw z-score transformation (based on general population norms) that ameliorates floor effects and improves the precision of IQ measurement in ID using the Stanford Binet 5 (SB5) in fragile X syndrome (FXS; n = 106), the leading inherited cause of ID, and in individuals with idiopathic autism spectrum disorder (ASD; n = 205). We compared the distributional characteristics and Q-Q plots from the standardized scores with the deviation z-scores. Additionally, we examined the relationship between both scoring methods and multiple criterion measures.

Results

We found evidence that substantial and meaningful variation in cognitive ability on standardized IQ tests among individuals with ID is lost when converting raw scores to standardized scaled, index and IQ scores. Use of the deviation z- score method rectifies this problem, and accounts for significant additional variance in criterion validation measures, above and beyond the usual IQ scores. Additionally, individual and group-level cognitive strengths and weaknesses are recovered using deviation scores.

Conclusion

Traditional methods for generating IQ scores in lower functioning individuals with ID are inaccurate and inadequate, leading to erroneously flat profiles. However assessment of cognitive abilities is substantially improved by measuring true deviation in performance from standardization sample norms. This work has important implications for standardized test development, clinical assessment, and research for which IQ is an important measure of interest in individuals with neurodevelopmental disorders and other forms of cognitive impairment.
Appendix
Available only for authorised users
Literature
1.
go back to reference Carroll JB: Psychometrics, intelligence, and public perception. Intelligence. 1997, 24: 25-52. 10.1016/S0160-2896(97)90012-X.CrossRef Carroll JB: Psychometrics, intelligence, and public perception. Intelligence. 1997, 24: 25-52. 10.1016/S0160-2896(97)90012-X.CrossRef
2.
go back to reference American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 2013, Arlington, VA: American Psychiatric Publishing, 5 American Psychiatric Association: Diagnostic and Statistical Manual of Mental Disorders. 2013, Arlington, VA: American Psychiatric Publishing, 5
3.
go back to reference Hay D: Does IQ decline with age in fragile X? A methodological critique. Am J Med Genet. 1994, 51: 358-363. 10.1002/ajmg.1320510412.PubMedCrossRef Hay D: Does IQ decline with age in fragile X? A methodological critique. Am J Med Genet. 1994, 51: 358-363. 10.1002/ajmg.1320510412.PubMedCrossRef
4.
go back to reference Hessl D, Nguyen DV, Green C, Senturk D, Schneider A, Lightbody A, Reiss AL, Hall S: A solution to limitations of cognitive testing in children with intellectual disabilities: the case of fragile X syndrome. J Neurodev Disord. 2009, 1: 33-45. 10.1007/s11689-008-9001-8.PubMedPubMedCentralCrossRef Hessl D, Nguyen DV, Green C, Senturk D, Schneider A, Lightbody A, Reiss AL, Hall S: A solution to limitations of cognitive testing in children with intellectual disabilities: the case of fragile X syndrome. J Neurodev Disord. 2009, 1: 33-45. 10.1007/s11689-008-9001-8.PubMedPubMedCentralCrossRef
5.
go back to reference Whitaker S, Wood C: The distribution of scaled scores and possible floor effects on the WISC-III and WAIS-III. J Appl Res Intellect Disabil. 2008, 21: 136-141. 10.1111/j.1468-3148.2007.00378.x.CrossRef Whitaker S, Wood C: The distribution of scaled scores and possible floor effects on the WISC-III and WAIS-III. J Appl Res Intellect Disabil. 2008, 21: 136-141. 10.1111/j.1468-3148.2007.00378.x.CrossRef
6.
go back to reference Couzens D, Cuskelly M, Jobling A: The Stanford Binet fourth edition and its use with individuals with Down syndrome: cautions for clinicians. Int J Disabil Dev Educ. 2004, 51: 39-56. 10.1080/1034912042000182193.CrossRef Couzens D, Cuskelly M, Jobling A: The Stanford Binet fourth edition and its use with individuals with Down syndrome: cautions for clinicians. Int J Disabil Dev Educ. 2004, 51: 39-56. 10.1080/1034912042000182193.CrossRef
7.
go back to reference Whitaker S, Gordon S: Floor effects on the WISC-IV. Int J Dev Disabil. 2012, 58: 111-119. 10.1179/2047387711Y.0000000012.CrossRef Whitaker S, Gordon S: Floor effects on the WISC-IV. Int J Dev Disabil. 2012, 58: 111-119. 10.1179/2047387711Y.0000000012.CrossRef
8.
go back to reference Facon B: A cross-sectional test of the similar-trajectory hypothesis among adults with mental retardation. Res Dev Disabil. 2008, 29: 29-44. 10.1016/j.ridd.2006.10.003.PubMedCrossRef Facon B: A cross-sectional test of the similar-trajectory hypothesis among adults with mental retardation. Res Dev Disabil. 2008, 29: 29-44. 10.1016/j.ridd.2006.10.003.PubMedCrossRef
9.
go back to reference Van der Molen MJW, Huizinga M, Huizenga HM, Ridderinkhof KR, Van der Molen MW, Hamel BJC, Curfs LMG, Ramakers GJA: Profiling fragile X syndrome in males: strengths and weaknesses in cognitive abilities. Res Dev Disabil. 2010, 31: 426-439. 10.1016/j.ridd.2009.10.013.PubMedCrossRef Van der Molen MJW, Huizinga M, Huizenga HM, Ridderinkhof KR, Van der Molen MW, Hamel BJC, Curfs LMG, Ramakers GJA: Profiling fragile X syndrome in males: strengths and weaknesses in cognitive abilities. Res Dev Disabil. 2010, 31: 426-439. 10.1016/j.ridd.2009.10.013.PubMedCrossRef
11.
go back to reference Devys D, Lutz Y, Rouyer N, Bellocq JP, Mandel JL: The FMR-1 protein is cytoplasmic, most abundant in neurons and appears normal in carriers of a fragile X premutation. Nat Genet. 1993, 4: 335-340. 10.1038/ng0893-335.PubMedCrossRef Devys D, Lutz Y, Rouyer N, Bellocq JP, Mandel JL: The FMR-1 protein is cytoplasmic, most abundant in neurons and appears normal in carriers of a fragile X premutation. Nat Genet. 1993, 4: 335-340. 10.1038/ng0893-335.PubMedCrossRef
12.
go back to reference Comery TA, Harris JB, Willems PJ, Oostra BA, Irwin SA, Weiler IJ, Greenough WT: Abnormal dendritic spines in fragile X knockout mice: maturation and pruning deficits. Proc Natl Acad Sci U S A. 1997, 94: 5401-5404. 10.1073/pnas.94.10.5401.PubMedPubMedCentralCrossRef Comery TA, Harris JB, Willems PJ, Oostra BA, Irwin SA, Weiler IJ, Greenough WT: Abnormal dendritic spines in fragile X knockout mice: maturation and pruning deficits. Proc Natl Acad Sci U S A. 1997, 94: 5401-5404. 10.1073/pnas.94.10.5401.PubMedPubMedCentralCrossRef
13.
go back to reference Irwin S, Galvez R, Greenough W: Dendritic spine structural anomalies in fragile-X mental retardation syndrome. Cereb Cortex. 2000, 10: 1038-1044. 10.1093/cercor/10.10.1038.PubMedCrossRef Irwin S, Galvez R, Greenough W: Dendritic spine structural anomalies in fragile-X mental retardation syndrome. Cereb Cortex. 2000, 10: 1038-1044. 10.1093/cercor/10.10.1038.PubMedCrossRef
14.
go back to reference Matson JL, Smith KRM: Current status of intensive behavioral interventions for young children with autism and PDD-NOS. Res Autism Spectr Disord. 2008, 2: 60-74. 10.1016/j.rasd.2007.03.003.CrossRef Matson JL, Smith KRM: Current status of intensive behavioral interventions for young children with autism and PDD-NOS. Res Autism Spectr Disord. 2008, 2: 60-74. 10.1016/j.rasd.2007.03.003.CrossRef
15.
go back to reference Ben IE, Lahat E, Burgin R, Zachor A: Cognitive, behavior and intervention outcome in young children with autism. Res Dev Disabil. 2008, 29: 447-458. 10.1016/j.ridd.2007.08.003.CrossRef Ben IE, Lahat E, Burgin R, Zachor A: Cognitive, behavior and intervention outcome in young children with autism. Res Dev Disabil. 2008, 29: 447-458. 10.1016/j.ridd.2007.08.003.CrossRef
16.
go back to reference Fombonne E: Epidemiological surveys of autism and other pervasive developmental disorders: an update. J Autism Dev Disord. 2003, 33: 365-382. 10.1023/A:1025054610557.PubMedCrossRef Fombonne E: Epidemiological surveys of autism and other pervasive developmental disorders: an update. J Autism Dev Disord. 2003, 33: 365-382. 10.1023/A:1025054610557.PubMedCrossRef
18.
go back to reference Taylor A, Safanda J, Fall M: Molecular predictors of cognitive involvement in female carriers of fragile X syndrome. J Am Med Genet. 1994, 271: 507-514. Taylor A, Safanda J, Fall M: Molecular predictors of cognitive involvement in female carriers of fragile X syndrome. J Am Med Genet. 1994, 271: 507-514.
19.
go back to reference Lord C, Rutter M, Couteur A: Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994, 24: 659-685. 10.1007/BF02172145.PubMedCrossRef Lord C, Rutter M, Couteur A: Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994, 24: 659-685. 10.1007/BF02172145.PubMedCrossRef
20.
go back to reference Lord C, Rutter M, DiLavore P, Risi S: Autism Diagnostic Observation Schedule. 1999, Los Angeles: Western Psychological Services Lord C, Rutter M, DiLavore P, Risi S: Autism Diagnostic Observation Schedule. 1999, Los Angeles: Western Psychological Services
21.
go back to reference Roid G: Stanford-Binet Intelligence Scales - Examiner’s Manual. 2003, Itasca, IL: Riverside Publishing, 5 Roid G: Stanford-Binet Intelligence Scales - Examiner’s Manual. 2003, Itasca, IL: Riverside Publishing, 5
22.
go back to reference McGrew KS, Flanagan DP, Keith TZ, Vanderwood M: Beyond g: the impact of Gf-Gc specific cognitive abilities research on the future use and interpretation of intelligence tests in the schools. Sch Psychol Rev. 1997, 26: 189-210. McGrew KS, Flanagan DP, Keith TZ, Vanderwood M: Beyond g: the impact of Gf-Gc specific cognitive abilities research on the future use and interpretation of intelligence tests in the schools. Sch Psychol Rev. 1997, 26: 189-210.
23.
go back to reference Sparrow S, Balla D, Cicchetti D: Vineland Adaptive Behavior Scales-Interview Edition. 1984, Circle Pines, MN: American Guidance Service Sparrow S, Balla D, Cicchetti D: Vineland Adaptive Behavior Scales-Interview Edition. 1984, Circle Pines, MN: American Guidance Service
24.
go back to reference Dunn L: Peabody Picture Vocabulary Test. 1997, Circle Pines, MN: American Guidance Service, 3 Dunn L: Peabody Picture Vocabulary Test. 1997, Circle Pines, MN: American Guidance Service, 3
25.
go back to reference Raven J, Raven J, Court J: Manual for Raven’s Progressive Matrices and Vocabulary Scales. 2003, San Antonio, TX, US: Pearson Assessment Raven J, Raven J, Court J: Manual for Raven’s Progressive Matrices and Vocabulary Scales. 2003, San Antonio, TX, US: Pearson Assessment
26.
go back to reference R Core Team: R: A Language and Environment for Statistical Computing. 2013 R Core Team: R: A Language and Environment for Statistical Computing. 2013
27.
go back to reference Haynes SN, Lench HC: Incremental validity of new clinical assessment measures. Psychol Assess. 2003, 15: 456-466.PubMedCrossRef Haynes SN, Lench HC: Incremental validity of new clinical assessment measures. Psychol Assess. 2003, 15: 456-466.PubMedCrossRef
28.
go back to reference Coolican J, Bryson SE, Zwaigenbaum L: Brief report: data on the Stanford-Binet Intelligence Scales (5th ed.) in children with autism spectrum disorder. J Autism Dev Disord. 2008, 38: 190-197. 10.1007/s10803-007-0368-2.PubMedCrossRef Coolican J, Bryson SE, Zwaigenbaum L: Brief report: data on the Stanford-Binet Intelligence Scales (5th ed.) in children with autism spectrum disorder. J Autism Dev Disord. 2008, 38: 190-197. 10.1007/s10803-007-0368-2.PubMedCrossRef
29.
go back to reference Fisch G: Cognitive-behavioral profiles of females with the fragile X mutation. Am J Med Genet Part A. 2006, 677: 673-677.CrossRef Fisch G: Cognitive-behavioral profiles of females with the fragile X mutation. Am J Med Genet Part A. 2006, 677: 673-677.CrossRef
30.
go back to reference Backes M, Genç B, Schreck J, Doerfler W, Lehmkuhl G, von Gontard A: Cognitive and behavioral profile of fragile X boys: correlations to molecular data. Am J Med Genet. 2000, 95: 150-156. 10.1002/1096-8628(20001113)95:2<150::AID-AJMG11>3.0.CO;2-1.PubMedCrossRef Backes M, Genç B, Schreck J, Doerfler W, Lehmkuhl G, von Gontard A: Cognitive and behavioral profile of fragile X boys: correlations to molecular data. Am J Med Genet. 2000, 95: 150-156. 10.1002/1096-8628(20001113)95:2<150::AID-AJMG11>3.0.CO;2-1.PubMedCrossRef
31.
go back to reference Lewis P, Abbeduto L, Murphy M, Richmond E, Giles N, Bruno L, Schroeder S: Cognitive, language and social-cognitive skills of individuals with fragile X syndrome with and without autism. J Intellect Disabil Res. 2006, 50: 532-545. 10.1111/j.1365-2788.2006.00803.x.PubMedCrossRef Lewis P, Abbeduto L, Murphy M, Richmond E, Giles N, Bruno L, Schroeder S: Cognitive, language and social-cognitive skills of individuals with fragile X syndrome with and without autism. J Intellect Disabil Res. 2006, 50: 532-545. 10.1111/j.1365-2788.2006.00803.x.PubMedCrossRef
32.
go back to reference Mullen EM: Mullen Scales of Early Learning. 1995, Circle Pines, MN: American Guidance Service Mullen EM: Mullen Scales of Early Learning. 1995, Circle Pines, MN: American Guidance Service
Metadata
Title
Improving IQ measurement in intellectual disabilities using true deviation from population norms
Authors
Stephanie M Sansone
Andrea Schneider
Erika Bickel
Elizabeth Berry-Kravis
Christina Prescott
David Hessl
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Journal of Neurodevelopmental Disorders / Issue 1/2014
Print ISSN: 1866-1947
Electronic ISSN: 1866-1955
DOI
https://doi.org/10.1186/1866-1955-6-16

Other articles of this Issue 1/2014

Journal of Neurodevelopmental Disorders 1/2014 Go to the issue