Skip to main content
Top
Published in: Prevention Science 3/2017

01-04-2017

The Validation of Macro and Micro Observations of Parent–Child Dynamics Using the Relationship Affect Coding System in Early Childhood

Authors: Thomas J. Dishion, Chung Jung Mun, Jenn-Yun Tein, Hanjoe Kim, Daniel S. Shaw, Frances Gardner, Melvin N. Wilson, Jenene Peterson

Published in: Prevention Science | Issue 3/2017

Login to get access

Abstract

This study examined the validity of micro social observations and macro ratings of parent–child interaction in early to middle childhood. Seven hundred and thirty-one families representing multiple ethnic groups were recruited and screened as at risk in the context of Women, Infant, and Children (WIC) Nutritional Supplement service settings. Families were randomly assigned to the Family Checkup (FCU) intervention or the control condition at age 2 and videotaped in structured interactions in the home at ages 2, 3, 4, and 5. Parent–child interaction videotapes were micro-coded using the Relationship Affect Coding System (RACS) that captures the duration of two mutual dyadic states: positive engagement and coercion. Macro ratings of parenting skills were collected after coding the videotapes to assess parent use of positive behavior support and limit setting skills (or lack thereof). Confirmatory factor analyses revealed that the measurement model of macro ratings of limit setting and positive behavior support was not supported by the data, and thus, were excluded from further analyses. However, there was moderate stability in the families’ micro social dynamics across early childhood and it showed significant improvements as a function of random assignment to the FCU. Moreover, parent–child dynamics were predictive of chronic behavior problems as rated by parents in middle childhood, but not emotional problems. We conclude with a discussion of the validity of the RACS and on methodological advantages of micro social coding over the statistical limitations of macro rating observations. Future directions are discussed for observation research in prevention science.
Appendix
Available only for authorised users
Footnotes
1
Note that the recently developed three-step approach (Asparouhov and Muthén 2013) was not feasible in this study because the main predictor variable was a latent variable. It is not yet possible to include a latent variable in the auxiliary variable command in the new three-step approach.
 
2
The CFA result of this model at age 5 also had a poor fit of the data, χ 2 (89) = 1296.19, p < .001, RMSEA = 0.16, CFI = 0.70, and SRMR = 0.14
 
3
Additionally, we tested FCU intervention effects on parent–child dynamics at age 3 and 4, respectively. There was a significant intervention effect on parent–child dynamics at age 3 but not at age 4.
 
Literature
go back to reference Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the Child Behavior Checklist and revised behavior profile. Burlington: University of Vermont Department of Psychiatry. Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the Child Behavior Checklist and revised behavior profile. Burlington: University of Vermont Department of Psychiatry.
go back to reference Bank, L., Dishion, T. J., Skinner, M., & Patterson, G. R. (1990). Method variance in structural equation modeling: Living with “glop”. In G. R. Patterson (Ed.), Aggression and depression in family interactions (pp. 247–280). Hillsdale: Erlbaum. Bank, L., Dishion, T. J., Skinner, M., & Patterson, G. R. (1990). Method variance in structural equation modeling: Living with “glop”. In G. R. Patterson (Ed.), Aggression and depression in family interactions (pp. 247–280). Hillsdale: Erlbaum.
go back to reference Bell, R. Q. (1979). Parent, child, and reciprocal influences. American Psychologist, 34, 821.CrossRef Bell, R. Q. (1979). Parent, child, and reciprocal influences. American Psychologist, 34, 821.CrossRef
go back to reference Bolck, A., Croon, M. A., & Hagenaars, J. A. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12, 3–27. doi:10.1093/pan/mph001.CrossRef Bolck, A., Croon, M. A., & Hagenaars, J. A. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12, 3–27. doi:10.​1093/​pan/​mph001.CrossRef
go back to reference Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef
go back to reference Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin Co. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin Co.
go back to reference Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: An ecological, family-centered approach to mental health care. Washington, DC: American Psychological Association. doi:10.1037/11485-000.CrossRef Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: An ecological, family-centered approach to mental health care. Washington, DC: American Psychological Association. doi:10.​1037/​11485-000.CrossRef
go back to reference Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2014). Prevention of problem behavior through annual family check-ups in early childhood: Intervention effects from the home to early elementary school. Journal of Abnormal Child Psychology, 42, 343–354. doi:10.1007/s10802-013-9768-2.CrossRefPubMedPubMedCentral Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2014). Prevention of problem behavior through annual family check-ups in early childhood: Intervention effects from the home to early elementary school. Journal of Abnormal Child Psychology, 42, 343–354. doi:10.​1007/​s10802-013-9768-2.CrossRefPubMedPubMedCentral
go back to reference Dishion, T. J., Forgatch, M. S., Van Ryzin, M. J., & Winter, C. (2012). The nonlinear dynamics of family problem solving in adolescence: The predictive validity of a peaceful resolution attractor. Nonlinear Dynamics, Psychology, and Life Sciences, 16, 331–352.PubMedPubMedCentral Dishion, T. J., Forgatch, M. S., Van Ryzin, M. J., & Winter, C. (2012). The nonlinear dynamics of family problem solving in adolescence: The predictive validity of a peaceful resolution attractor. Nonlinear Dynamics, Psychology, and Life Sciences, 16, 331–352.PubMedPubMedCentral
go back to reference Dishion, T. J., Stormshak, E. A., & Kavanagh, K. (2011). Everyday parenting: A therapist’s guide for supporting family management practices. Champaign: Research Press. Dishion, T. J., Stormshak, E. A., & Kavanagh, K. (2011). Everyday parenting: A therapist’s guide for supporting family management practices. Champaign: Research Press.
go back to reference Dwyer, J. H. (1983). Statistical models for the social and behavioral sciences. New York: Oxford University Press. Dwyer, J. H. (1983). Statistical models for the social and behavioral sciences. New York: Oxford University Press.
go back to reference Eisenberg, N., Zhou, Q., Spinrad, T. L., Valiente, C., Fabes, R. A., & Liew, J. (2005). Relations among positive parenting, children’s effortful control, and externalizing problems: A three-wave longitudinal study. Child Development, 76, 1055–1071.CrossRefPubMedPubMedCentral Eisenberg, N., Zhou, Q., Spinrad, T. L., Valiente, C., Fabes, R. A., & Liew, J. (2005). Relations among positive parenting, children’s effortful control, and externalizing problems: A three-wave longitudinal study. Child Development, 76, 1055–1071.CrossRefPubMedPubMedCentral
go back to reference Fiske, D. W. (1986). Specificity of method and knowledge in social science. In D. W. Fiske & R. A. Shweder (Eds.), Metatheory in social science: Pluralisms and subjectivities (pp. 61–82). Chicago: University of Chicago Press. Fiske, D. W. (1986). Specificity of method and knowledge in social science. In D. W. Fiske & R. A. Shweder (Eds.), Metatheory in social science: Pluralisms and subjectivities (pp. 61–82). Chicago: University of Chicago Press.
go back to reference Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.CrossRefPubMed Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.CrossRefPubMed
go back to reference Forgatch, M. S., & Patterson, G. R. (2010). Parent management training-Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 159–178). New York: Guilford Press. doi:10.1080/07317107.2011.596010. Forgatch, M. S., & Patterson, G. R. (2010). Parent management training-Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 159–178). New York: Guilford Press. doi:10.​1080/​07317107.​2011.​596010.
go back to reference Gardner, F. (2000). Methodological issues in the use of observational methods for measuring parent child interaction. Clinical Child and Family Psychology Review, 3, 185–198.CrossRefPubMed Gardner, F. (2000). Methodological issues in the use of observational methods for measuring parent child interaction. Clinical Child and Family Psychology Review, 3, 185–198.CrossRefPubMed
go back to reference Gardner, F., Sonuga-Barke, E., & Sayal, K. (1999). Parents anticipating misbehaviour: An observational study of strategies parents use to prevent conflict with behaviour problem children. Journal of Child Psychology and Psychiatry, 40, 1185–1196.CrossRefPubMed Gardner, F., Sonuga-Barke, E., & Sayal, K. (1999). Parents anticipating misbehaviour: An observational study of strategies parents use to prevent conflict with behaviour problem children. Journal of Child Psychology and Psychiatry, 40, 1185–1196.CrossRefPubMed
go back to reference Glueck, S., & Glueck, E. (1950). Unraveling juvenile delinquency. New York: Commonwealth Fund. Glueck, S., & Glueck, E. (1950). Unraveling juvenile delinquency. New York: Commonwealth Fund.
go back to reference Gonzales, N. A., Hiraga, Y., & Cauce, A. M. (1995). Observing mother-daughter interaction in African-American and Asian-American families. In H. I. McCubbin, E. A. Thompson, A. I. Thompson, & J. E. Fromer (Eds.), Resiliency in African-American families (Vol. 3, pp. 259–285). Thousand Oaks: SAGE. Gonzales, N. A., Hiraga, Y., & Cauce, A. M. (1995). Observing mother-daughter interaction in African-American and Asian-American families. In H. I. McCubbin, E. A. Thompson, A. I. Thompson, & J. E. Fromer (Eds.), Resiliency in African-American families (Vol. 3, pp. 259–285). Thousand Oaks: SAGE.
go back to reference Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experiences of young American children. Baltimore: Brookes Publishing Co. Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experiences of young American children. Baltimore: Brookes Publishing Co.
go back to reference Hollenstein, T. (2013). State space grids: Depicting dynamics across development. New York: Springer.CrossRef Hollenstein, T. (2013). State space grids: Depicting dynamics across development. New York: Springer.CrossRef
go back to reference Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118.CrossRef Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.​1080/​1070551990954011​8.CrossRef
go back to reference Loeber, R., & Dishion, T. J. (1984). Boys who fight at home and school: Family conditions influencing cross-setting consistency. Journal of Consulting and Clinical Psychology, 52(5), 759. Loeber, R., & Dishion, T. J. (1984). Boys who fight at home and school: Family conditions influencing cross-setting consistency. Journal of Consulting and Clinical Psychology, 52(5), 759.
go back to reference Miller, W. R., & Rollnick, S. (2002). Motivational interviewing. New York: The Guilford Press. Miller, W. R., & Rollnick, S. (2002). Motivational interviewing. New York: The Guilford Press.
go back to reference Muthén, L. K., & Muthén, B. O. (2012a). Mplus (version 7.1). Los Angeles: Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (2012a). Mplus (version 7.1). Los Angeles: Muthén & Muthén.
go back to reference Technology, N. I. (2012). The Observer XT reference manual 11.0. Wageningen: Author. Technology, N. I. (2012). The Observer XT reference manual 11.0. Wageningen: Author.
go back to reference Patterson, G. R. (1974b). Interventions for boys with conduct problems: Multiple settings, treatments, and criteria. Journal of Consulting and Clinical Psychology, 42, 471–481. doi:10.1037/h0036731.CrossRefPubMed Patterson, G. R. (1974b). Interventions for boys with conduct problems: Multiple settings, treatments, and criteria. Journal of Consulting and Clinical Psychology, 42, 471–481. doi:10.​1037/​h0036731.CrossRefPubMed
go back to reference Patterson, G. R. (1982). A social learning approach: III. Coercive family process. Eugene, OR: Castalia. Patterson, G. R. (1982). A social learning approach: III. Coercive family process. Eugene, OR: Castalia.
go back to reference Patterson, G. R., & Moore, D. R. (1979). Interactive patterns of units of behavior. In M. E. Lamb, S. J. Suomi, & G. R. Stevenson (Eds.), Social interaction analysis: Methodological issues. Madison: University of Wisconsin Press. Patterson, G. R., & Moore, D. R. (1979). Interactive patterns of units of behavior. In M. E. Lamb, S. J. Suomi, & G. R. Stevenson (Eds.), Social interaction analysis: Methodological issues. Madison: University of Wisconsin Press.
go back to reference Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys. Eugene: Castalia. Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys. Eugene: Castalia.
go back to reference Pitts, S. C., West, S. G., & Tein, J.-Y. (1996). Longitudinal measurement models in evaluation research: Examining stability and change. Evaluation and Program Planning, 19, 333–350.CrossRef Pitts, S. C., West, S. G., & Tein, J.-Y. (1996). Longitudinal measurement models in evaluation research: Examining stability and change. Evaluation and Program Planning, 19, 333–350.CrossRef
go back to reference Ramaswamy, V., DeSarbo, W., Reibstein, D., & Robinson, W. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124. doi:10.1287/mksc.12.1.103.CrossRef Ramaswamy, V., DeSarbo, W., Reibstein, D., & Robinson, W. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124. doi:10.​1287/​mksc.​12.​1.​103.CrossRef
go back to reference Reid, J. B. (1978). The development of specialized observation systems. In J. B. Reid (Ed.), A social learning approach to family intervention. II. Observation in home settings (pp. 43–49). Eugene: Castalia. Reid, J. B. (1978). The development of specialized observation systems. In J. B. Reid (Ed.), A social learning approach to family intervention. II. Observation in home settings (pp. 43–49). Eugene: Castalia.
go back to reference Shaw, D. S., & Bell, R. Q. (1993). Developmental theories of parental contributors to antisocial behavior. Journal of Abnormal Child Psychology, 21, 493–518.CrossRefPubMed Shaw, D. S., & Bell, R. Q. (1993). Developmental theories of parental contributors to antisocial behavior. Journal of Abnormal Child Psychology, 21, 493–518.CrossRefPubMed
go back to reference Shaw, D. S., Dishion, T. J., Supplee, L., Gardner, F., & Arnds, K. (2006). Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the Family Check-Up in early childhood. Journal of Consulting and Clinical Psychology, 74, 1–9. doi:10.1037/0022-006x.74.1.1.CrossRefPubMed Shaw, D. S., Dishion, T. J., Supplee, L., Gardner, F., & Arnds, K. (2006). Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the Family Check-Up in early childhood. Journal of Consulting and Clinical Psychology, 74, 1–9. doi:10.​1037/​0022-006x.​74.​1.​1.CrossRefPubMed
go back to reference Sitnick, S. L., Shaw, D. S., Gill, A., Dishion, T., Winter, C., Waller, R., Gardner, F., & Wilson, M. (2014). Parenting and the Family Check-Up: Changes in observed parent–child interaction following early childhood intervention. Journal of Clinical Child and Adolescent Psychology, 44, 970–984. doi:10.1080/15374416.2014.940623.CrossRefPubMedPubMedCentral Sitnick, S. L., Shaw, D. S., Gill, A., Dishion, T., Winter, C., Waller, R., Gardner, F., & Wilson, M. (2014). Parenting and the Family Check-Up: Changes in observed parent–child interaction following early childhood intervention. Journal of Clinical Child and Adolescent Psychology, 44, 970–984. doi:10.​1080/​15374416.​2014.​940623.CrossRefPubMedPubMedCentral
go back to reference Snyder, J., Edwards, P., McGraw, K., Kilgore, K., & Holton, A. (1994). Escalation and reinforcement in mother–child conflict: Social processes associated with the development of physical aggression. Development and Psychopathology, 6, 305–321. doi:10.1017/s0954579400004600.CrossRef Snyder, J., Edwards, P., McGraw, K., Kilgore, K., & Holton, A. (1994). Escalation and reinforcement in mother–child conflict: Social processes associated with the development of physical aggression. Development and Psychopathology, 6, 305–321. doi:10.​1017/​s095457940000460​0.CrossRef
go back to reference Tein, J.-Y., Coxe, S., Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural equation modeling, 20, 640–657. NIHMS359239. DOI: 10.1080/10705511.2013.824781 Tein, J.-Y., Coxe, S., Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural equation modeling, 20, 640–657. NIHMS359239. DOI: 10.​1080/​10705511.​2013.​824781
go back to reference Webster-Stratton, C., & Reid, M. J. (2010). The incredible years parents, teachers, and children training series: A multifacted treatment approach for children with conduct problems. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 194–210). New York: Guilford Press. Webster-Stratton, C., & Reid, M. J. (2010). The incredible years parents, teachers, and children training series: A multifacted treatment approach for children with conduct problems. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 194–210). New York: Guilford Press.
go back to reference Weinrott, M. R., Reid, J. B., Bauske, B. W., & Brummett, B. (1981). Supplementing naturalistic observations with observer impressions. Behavioral Assessment, 3, 151–159. Weinrott, M. R., Reid, J. B., Bauske, B. W., & Brummett, B. (1981). Supplementing naturalistic observations with observer impressions. Behavioral Assessment, 3, 151–159.
go back to reference West, S., Finch, J., & Curran, P. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 56–75). Thousand Oaks: Sage. West, S., Finch, J., & Curran, P. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 56–75). Thousand Oaks: Sage.
Metadata
Title
The Validation of Macro and Micro Observations of Parent–Child Dynamics Using the Relationship Affect Coding System in Early Childhood
Authors
Thomas J. Dishion
Chung Jung Mun
Jenn-Yun Tein
Hanjoe Kim
Daniel S. Shaw
Frances Gardner
Melvin N. Wilson
Jenene Peterson
Publication date
01-04-2017
Publisher
Springer US
Published in
Prevention Science / Issue 3/2017
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-016-0697-5

Other articles of this Issue 3/2017

Prevention Science 3/2017 Go to the issue