Skip to main content
Top
Published in: Child and Adolescent Psychiatry and Mental Health 1/2013

Open Access 01-12-2013 | Research

Inter-rater reliability and aspects of validity of the parent-infant relationship global assessment scale (PIR-GAS)

Authors: Jörg M Müller, Sandra Achtergarde, Hanna Frantzmann, Kathrin Steinberg, Olena Skorozhenina, Thomas Beyer, Tilman Fürniss, Christian Postert

Published in: Child and Adolescent Psychiatry and Mental Health | Issue 1/2013

Login to get access

Abstract

Background

The Parent-Infant Relationship Global Assessment Scale (PIR-GAS) signifies a conceptually relevant development in the multi-axial, developmentally sensitive classification system DC:0-3R for preschool children. However, information about the reliability and validity of the PIR-GAS is rare. A review of the available empirical studies suggests that in research, PIR-GAS ratings can be based on a ten-minute videotaped interaction sequence. The qualification of raters may be very heterogeneous across studies.

Methods

To test whether the use of the PIR-GAS still allows for a reliable assessment of the parent-infant relationship, our study compared a PIR-GAS ratings based on a full-information procedure across multiple settings with ratings based on a ten-minute video by two doctoral candidates of medicine. For each mother-child dyad at a family day hospital (N = 48), we obtained two video ratings and one full-information rating at admission to therapy and at discharge. This pre-post design allowed for a replication of our findings across the two measurement points. We focused on the inter-rater reliability between the video coders, as well as between the video and full-information procedure, including mean differences and correlations between the raters. Additionally, we examined aspects of the validity of video and full-information ratings based on their correlation with measures of child and maternal psychopathology.

Results

Our results showed that a ten-minute video and full-information PIR-GAS ratings were not interchangeable. Most results at admission could be replicated by the data obtained at discharge. We concluded that a higher degree of standardization of the assessment procedure should increase the reliability of the PIR-GAS, and a more thorough theoretical foundation of the manual should increase its validity.
Literature
1.
go back to reference Zero To Three/National Center for Infants: Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC:0–3. 1994, Washington, DC: Zero To Three Zero To Three/National Center for Infants: Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC:0–3. 1994, Washington, DC: Zero To Three
2.
go back to reference Zero To Three/National Center for Infants: Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC: 0-3R. 2005, Washington, DC: Zero To Three Zero To Three/National Center for Infants: Diagnostic classification of mental health and developmental disorders of infancy and early childhood: DC: 0-3R. 2005, Washington, DC: Zero To Three
3.
go back to reference Postert C, Averbeck-Holocher M, Beyer T, Müller J, Fürniss T: Five systems of psychiatric classification for preschool children: do differences in validity, usefulness and reliability make for competitive or complimentary constellations?. Child Psychiat Hum D. 2009, 40: 25-41. 10.1007/s10578-008-0113-x.CrossRef Postert C, Averbeck-Holocher M, Beyer T, Müller J, Fürniss T: Five systems of psychiatric classification for preschool children: do differences in validity, usefulness and reliability make for competitive or complimentary constellations?. Child Psychiat Hum D. 2009, 40: 25-41. 10.1007/s10578-008-0113-x.CrossRef
4.
go back to reference Equit M, Paulus F, Fuhrmann Niemczyk J, Von Gontard A: Comparison of ICD-10 and DC: 0-3R diagnoses in infants, toddlers and preschoolers. Child Psychiat Hum D. 2011, 42: 623-633. 10.1007/s10578-011-0237-2.CrossRef Equit M, Paulus F, Fuhrmann Niemczyk J, Von Gontard A: Comparison of ICD-10 and DC: 0-3R diagnoses in infants, toddlers and preschoolers. Child Psychiat Hum D. 2011, 42: 623-633. 10.1007/s10578-011-0237-2.CrossRef
5.
go back to reference DelCarmen-Wiggins R, Carter A: Handbook of infant, toddler, and preschool mental health assessment. 2004, Oxford: Oxford University Press DelCarmen-Wiggins R, Carter A: Handbook of infant, toddler, and preschool mental health assessment. 2004, Oxford: Oxford University Press
6.
go back to reference Olson SL, Bates JE, Sandy JM, Lanthier R: Early development precursors of externalizing behavior in middle childhood and adolescence. J Abnorm Child Psych. 2000, 28: 119-133. 10.1023/A:1005166629744.CrossRef Olson SL, Bates JE, Sandy JM, Lanthier R: Early development precursors of externalizing behavior in middle childhood and adolescence. J Abnorm Child Psych. 2000, 28: 119-133. 10.1023/A:1005166629744.CrossRef
7.
go back to reference Shaw DS, Owens EB, Giovannelli J, Winslow EB: Infant and toddler pathways leading to early externalizing disorders. J Am Acad Child Psy. 2001, 40: 36-43. 10.1097/00004583-200101000-00014.CrossRef Shaw DS, Owens EB, Giovannelli J, Winslow EB: Infant and toddler pathways leading to early externalizing disorders. J Am Acad Child Psy. 2001, 40: 36-43. 10.1097/00004583-200101000-00014.CrossRef
8.
go back to reference Minde K, Tidmarsh L: The changing practices of an infant psychiatry program: the McGill experience. Infant Ment Health J. 1997, 18: 135-144. 10.1002/(SICI)1097-0355(199722)18:2<135::AID-IMHJ3>3.0.CO;2-O.CrossRef Minde K, Tidmarsh L: The changing practices of an infant psychiatry program: the McGill experience. Infant Ment Health J. 1997, 18: 135-144. 10.1002/(SICI)1097-0355(199722)18:2<135::AID-IMHJ3>3.0.CO;2-O.CrossRef
9.
go back to reference Keren M, Feldman R, Tyano S: A five-year Israeli experience with the DC:0–3 classification system. Infant Ment Health J. 2003, 24: 3337-3348. Keren M, Feldman R, Tyano S: A five-year Israeli experience with the DC:0–3 classification system. Infant Ment Health J. 2003, 24: 3337-3348.
10.
go back to reference Skovgaard AM, Houmann T, Christiansen E, Landorph S, Jørgensen T, CCC 2000 Study Team: The prevalence of mental health problems in children 1½ years of age – the Copenhagen child cohort 2000. J Child Psychol Psyc. 2007, 48: 62-70. 10.1111/j.1469-7610.2006.01659.x.CrossRef Skovgaard AM, Houmann T, Christiansen E, Landorph S, Jørgensen T, CCC 2000 Study Team: The prevalence of mental health problems in children 1½ years of age – the Copenhagen child cohort 2000. J Child Psychol Psyc. 2007, 48: 62-70. 10.1111/j.1469-7610.2006.01659.x.CrossRef
11.
go back to reference Thomas JM, Clark R: Disruptive behavior in the in the very young child: diagnostic classification 0–3 guides identification of risk factors and relational interventions. Infant Ment Health J. 1998, 19: 229-244. 10.1002/(SICI)1097-0355(199822)19:2<229::AID-IMHJ10>3.0.CO;2-#.CrossRef Thomas JM, Clark R: Disruptive behavior in the in the very young child: diagnostic classification 0–3 guides identification of risk factors and relational interventions. Infant Ment Health J. 1998, 19: 229-244. 10.1002/(SICI)1097-0355(199822)19:2<229::AID-IMHJ10>3.0.CO;2-#.CrossRef
12.
go back to reference Donenberg G, Baker B: The impact of young children with externalizing behaviors on their families. J Abnorm Child Psych. 1993, 21: 179-198. 10.1007/BF00911315.CrossRef Donenberg G, Baker B: The impact of young children with externalizing behaviors on their families. J Abnorm Child Psych. 1993, 21: 179-198. 10.1007/BF00911315.CrossRef
13.
go back to reference Emde RN, Wise BK: The cup is half full: initial clinical trials of DC: 0–3 and a recommendation for revision. Infant Ment Health J. 2003, 24: 437-446. 10.1002/imhj.10067.CrossRef Emde RN, Wise BK: The cup is half full: initial clinical trials of DC: 0–3 and a recommendation for revision. Infant Ment Health J. 2003, 24: 437-446. 10.1002/imhj.10067.CrossRef
14.
go back to reference Skovgaard AM, Houmann T, Christiansen E, Andreasen AH: The reliability of the ICD-10 and the DC 0–3 in an epidemiological sample of children 1½ years of age. Infant Ment Health J. 2005, 26: 470-480. 10.1002/imhj.20065.CrossRef Skovgaard AM, Houmann T, Christiansen E, Andreasen AH: The reliability of the ICD-10 and the DC 0–3 in an epidemiological sample of children 1½ years of age. Infant Ment Health J. 2005, 26: 470-480. 10.1002/imhj.20065.CrossRef
15.
go back to reference Cantwell DP: Classification of child and adolescent psychopathology. J Child Psychol Psyc. 1996, 37: 3-12. 10.1111/j.1469-7610.1996.tb01377.x.CrossRef Cantwell DP: Classification of child and adolescent psychopathology. J Child Psychol Psyc. 1996, 37: 3-12. 10.1111/j.1469-7610.1996.tb01377.x.CrossRef
16.
go back to reference Dunitz-Scheer M, Scheer PJ, Kvas E, Macari S: Psychiatric diagnoses in infancy: a comparison. Infant Ment Health J. 1996, 17: 12-24. 10.1002/(SICI)1097-0355(199621)17:1<12::AID-IMHJ2>3.0.CO;2-3.CrossRef Dunitz-Scheer M, Scheer PJ, Kvas E, Macari S: Psychiatric diagnoses in infancy: a comparison. Infant Ment Health J. 1996, 17: 12-24. 10.1002/(SICI)1097-0355(199621)17:1<12::AID-IMHJ2>3.0.CO;2-3.CrossRef
17.
go back to reference Frankel KA, Boyum LA, Harmon RJ: Diagnoses and presenting symptoms in an infant psychiatric clinic: a comparison of two diagnostic systems. J Am Acad Child Psy. 2004, 43: 578-587. 10.1097/00004583-200405000-00011.CrossRef Frankel KA, Boyum LA, Harmon RJ: Diagnoses and presenting symptoms in an infant psychiatric clinic: a comparison of two diagnostic systems. J Am Acad Child Psy. 2004, 43: 578-587. 10.1097/00004583-200405000-00011.CrossRef
18.
go back to reference Guedeney N, Guedeney A, Rabouam C, Mintz AS, Danon G, Huet M, Jacquemain F: The zero-to-three diagnostic classification: a contribution to the validation of this classification from a sample of 85 under-threes. Infant Ment Health J. 2003, 24: 313-336. 10.1002/imhj.10059.CrossRef Guedeney N, Guedeney A, Rabouam C, Mintz AS, Danon G, Huet M, Jacquemain F: The zero-to-three diagnostic classification: a contribution to the validation of this classification from a sample of 85 under-threes. Infant Ment Health J. 2003, 24: 313-336. 10.1002/imhj.10059.CrossRef
19.
go back to reference Aoki Y, Zeanah CH, Scott Heller S, Bakshi S: Parent-infant relationship Global assessment scale: a study of its predictive validity. Psychiat Clin Neuros. 2002, 56: 493-497. 10.1046/j.1440-1819.2002.01044.x.CrossRef Aoki Y, Zeanah CH, Scott Heller S, Bakshi S: Parent-infant relationship Global assessment scale: a study of its predictive validity. Psychiat Clin Neuros. 2002, 56: 493-497. 10.1046/j.1440-1819.2002.01044.x.CrossRef
20.
go back to reference Salomonsson B, Sandell R: A randomized controlled trial of mother–infant psychoanalytic treatment: I. outcomes on self-report questionnaires and external ratings. Infant Ment Health J. 2011, 32: 207-231. 10.1002/imhj.20291.CrossRef Salomonsson B, Sandell R: A randomized controlled trial of mother–infant psychoanalytic treatment: I. outcomes on self-report questionnaires and external ratings. Infant Ment Health J. 2011, 32: 207-231. 10.1002/imhj.20291.CrossRef
21.
go back to reference Salomonsson B, Sandell R: A randomized controlled trial of mother–infant psychoanalytic treatment: II. predictive and moderating influences of qualitative patient factors. Infant Ment Health J. 2011, 32: 377-404. 10.1002/imhj.20302.CrossRef Salomonsson B, Sandell R: A randomized controlled trial of mother–infant psychoanalytic treatment: II. predictive and moderating influences of qualitative patient factors. Infant Ment Health J. 2011, 32: 377-404. 10.1002/imhj.20302.CrossRef
22.
go back to reference Boris NW, Zeanah CH, Larrieu JA, Scheeringa MS, Heller SS: Attachment disorders in infancy and early childhood: a preliminary investigation of diagnostic criteria. Am J Psychiatry. 1998, 155: 295-297.PubMed Boris NW, Zeanah CH, Larrieu JA, Scheeringa MS, Heller SS: Attachment disorders in infancy and early childhood: a preliminary investigation of diagnostic criteria. Am J Psychiatry. 1998, 155: 295-297.PubMed
23.
go back to reference von Hofacker N, Papoušek M: Disorders of excessive crying, feeding, and sleeping: the Munich interdisciplinary research and intervention program. Inf Ment Health J. 1998, 19: 180-201. 10.1002/(SICI)1097-0355(199822)19:2<180::AID-IMHJ7>3.0.CO;2-S.CrossRef von Hofacker N, Papoušek M: Disorders of excessive crying, feeding, and sleeping: the Munich interdisciplinary research and intervention program. Inf Ment Health J. 1998, 19: 180-201. 10.1002/(SICI)1097-0355(199822)19:2<180::AID-IMHJ7>3.0.CO;2-S.CrossRef
24.
go back to reference Achenbach TM, Rescorla LA: Manual for the ASEBA preschool forms and profiles. 2000, Burlington, VT: University of Vermont Department of Psychiatry Achenbach TM, Rescorla LA: Manual for the ASEBA preschool forms and profiles. 2000, Burlington, VT: University of Vermont Department of Psychiatry
25.
go back to reference Arbeitsgruppe Deutsche Child Behavior Checklist: Elternfragebogen für Klein- und Vorschulkinder (CBCL/1,5-5) [Questionary for parents of toddlers und preschool children (CBCL/1,5-5)]. 2002, Arbeitsgruppe Kinder-, Jugend- und Familiendiagnostik: Köln Arbeitsgruppe Deutsche Child Behavior Checklist: Elternfragebogen für Klein- und Vorschulkinder (CBCL/1,5-5) [Questionary for parents of toddlers und preschool children (CBCL/1,5-5)]. 2002, Arbeitsgruppe Kinder-, Jugend- und Familiendiagnostik: Köln
26.
go back to reference Rescorla LA: Assessment of young children using the Achenbach system of empirically based assessment (ASEBA). Ment Retard Dev D R. 2005, 11: 226-237. 10.1002/mrdd.20071.CrossRef Rescorla LA: Assessment of young children using the Achenbach system of empirically based assessment (ASEBA). Ment Retard Dev D R. 2005, 11: 226-237. 10.1002/mrdd.20071.CrossRef
27.
go back to reference Derogatis LR: SCL-90-R, administration, scoring and procedures manual-II for the R(evised) version and other instruments of the psychopathology rating scale series. 1992, Townson: Clinical Psychometric Research Inc. Derogatis LR: SCL-90-R, administration, scoring and procedures manual-II for the R(evised) version and other instruments of the psychopathology rating scale series. 1992, Townson: Clinical Psychometric Research Inc.
28.
go back to reference Franke GH: SCL-90-R - Symptom-Checkliste von L.R. Derogatis. 2002, Beltz Test GmbH: Weinheim Franke GH: SCL-90-R - Symptom-Checkliste von L.R. Derogatis. 2002, Beltz Test GmbH: Weinheim
29.
go back to reference Wilson S, Durbin CE: The laboratory parenting assessment battery: development and preliminary validation of an observational parenting rating system. Psychol Assessment. 2012, 24: 823-832.CrossRef Wilson S, Durbin CE: The laboratory parenting assessment battery: development and preliminary validation of an observational parenting rating system. Psychol Assessment. 2012, 24: 823-832.CrossRef
30.
go back to reference Biringen Z, Easterbrooks MA: Emotional availability: concept, research, and window on developmental psychopathology. Dev Psychopathol. 2012, 24: 1-8. 10.1017/S0954579411000617.CrossRefPubMed Biringen Z, Easterbrooks MA: Emotional availability: concept, research, and window on developmental psychopathology. Dev Psychopathol. 2012, 24: 1-8. 10.1017/S0954579411000617.CrossRefPubMed
31.
go back to reference Clark R: The parent–child early relational assessment: instrument and manual. 1985, Madison, WI: University of Wisconsin Medical School, Department of Psychiatry Clark R: The parent–child early relational assessment: instrument and manual. 1985, Madison, WI: University of Wisconsin Medical School, Department of Psychiatry
32.
go back to reference Carter AS, Briggs-Gowan MJ, Davis NO: Assessment of young children’s social-emotional development and psychopathology: Recent advances and recommendations for practice. J Child Psychol Psyc. 2004, 45: 109-134. 10.1046/j.0021-9630.2003.00316.x.CrossRef Carter AS, Briggs-Gowan MJ, Davis NO: Assessment of young children’s social-emotional development and psychopathology: Recent advances and recommendations for practice. J Child Psychol Psyc. 2004, 45: 109-134. 10.1046/j.0021-9630.2003.00316.x.CrossRef
33.
go back to reference Christensen M, Emde Fleming C: Cultural Perspectives for assessing infants and young children. Handbook of infant, toddler and preschool mental health assessment. Edited by: DelCarmen Wiggins R, Carter A. 2004, Oxford: Oxford University Press, 7-23. Christensen M, Emde Fleming C: Cultural Perspectives for assessing infants and young children. Handbook of infant, toddler and preschool mental health assessment. Edited by: DelCarmen Wiggins R, Carter A. 2004, Oxford: Oxford University Press, 7-23.
Metadata
Title
Inter-rater reliability and aspects of validity of the parent-infant relationship global assessment scale (PIR-GAS)
Authors
Jörg M Müller
Sandra Achtergarde
Hanna Frantzmann
Kathrin Steinberg
Olena Skorozhenina
Thomas Beyer
Tilman Fürniss
Christian Postert
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Child and Adolescent Psychiatry and Mental Health / Issue 1/2013
Electronic ISSN: 1753-2000
DOI
https://doi.org/10.1186/1753-2000-7-17

Other articles of this Issue 1/2013

Child and Adolescent Psychiatry and Mental Health 1/2013 Go to the issue