Skip to main content
Top
Published in: Maternal and Child Health Journal 8/2013

Open Access 01-10-2013

UpStart Parent Survey: A New Psychometrically Valid Tool for the Evaluation of Prevention-focused Parenting Programs

Authors: Karen Benzies, Dawn Clarke, Leslie Barker, Richelle Mychasiuk

Published in: Maternal and Child Health Journal | Issue 8/2013

Login to get access

Abstract

Parents are the most significant influence on the growth and development of young children. All parents can increase their knowledge of developmental milestones and parenting practices by participating in effective programs that offer information and support. However, there is limited outcome evaluation of programs offering these services. Prevention-focused parenting programs (P-FPPs) are key frontline services designed to educate parents and improve the overall well-being of children. Evaluation of these programs is currently weak; this is not to say they are ineffective, rather that their effectiveness has been poorly evaluated. Rigorous evaluation of P-FPPs would support informed funding and evidence-based policy decisions. The purpose of this study was to conduct a preliminary psychometric analysis of the UpStart Parent Survey (USPS)—a tool developed specifically for evaluating this type of program. Preliminary analysis revealed uni-dimensionality of each scale, strong internal consistency and temporal stability, as well as strong concurrent validity on 9 of the 11 items examined with an urban Canadian population. In its first round of psychometric evaluation, the USPS demonstrated promise as a brief, easy to administer, scientifically rigorous tool for the evaluation of prevention-focused parenting programs.
Literature
1.
go back to reference McLennan, J. D., MacMillan, H. L., & Jamieson, E. (2004). Canada’s programs to prevent mental health problems in children: The research practice gap. Canadian Medical Association Journal, 171(9), 1069–1071.PubMedCrossRef McLennan, J. D., MacMillan, H. L., & Jamieson, E. (2004). Canada’s programs to prevent mental health problems in children: The research practice gap. Canadian Medical Association Journal, 171(9), 1069–1071.PubMedCrossRef
2.
go back to reference McLennan, J. D., & Lavis, J. N. (2006). What is the evidence for parenting interventions offered in a Canadian Community? Canadian Journal of Public Health, 97(6), 454–458.PubMed McLennan, J. D., & Lavis, J. N. (2006). What is the evidence for parenting interventions offered in a Canadian Community? Canadian Journal of Public Health, 97(6), 454–458.PubMed
3.
go back to reference Karoly, L. A., Kilburn, M. R., & Bigelow, J. H., et al. (2001). Assessing costs and benefits of early childhood intervention programs: Overview and application to the Starting Early Starting Smart Program. Executive Summary. Seattle, WA: Casey Family Programs. Karoly, L. A., Kilburn, M. R., & Bigelow, J. H., et al. (2001). Assessing costs and benefits of early childhood intervention programs: Overview and application to the Starting Early Starting Smart Program. Executive Summary. Seattle, WA: Casey Family Programs.
4.
go back to reference Temple, J. A., & Reynolds, A. J. (2007). Benefits and costs of investments in preschool education: Evidence from the Child–Parent Centers and related programs. Economics of Education Review, 26, 126–144.CrossRef Temple, J. A., & Reynolds, A. J. (2007). Benefits and costs of investments in preschool education: Evidence from the Child–Parent Centers and related programs. Economics of Education Review, 26, 126–144.CrossRef
5.
go back to reference National Scientific Council on the Developing Child. (2010). The foundations of lifelong health are built in early childhood. Boston, MA: Center on the Developing Child at Harvard University. National Scientific Council on the Developing Child. (2010). The foundations of lifelong health are built in early childhood. Boston, MA: Center on the Developing Child at Harvard University.
8.
go back to reference Benzies, K., Trute, B., & Worthington, C., et al. (2010) Assessing psychological well-being in mothers of children with disabilities: Evaluation of the Parenting Morale Index and Family Impact of Childhood Disability Scale. Journal of Pediatric Psychology. Advanced Access: September 15, 2010. Benzies, K., Trute, B., & Worthington, C., et al. (2010) Assessing psychological well-being in mothers of children with disabilities: Evaluation of the Parenting Morale Index and Family Impact of Childhood Disability Scale. Journal of Pediatric Psychology. Advanced Access: September 15, 2010.
9.
go back to reference Bloomfield, L., & Kendall, S. (2007). Testing a parenting programme evaluation tool as a pre- and post-course measure of parenting self-efficacy. Journal of Advanced Nursing, 60(5), 487–493.PubMedCrossRef Bloomfield, L., & Kendall, S. (2007). Testing a parenting programme evaluation tool as a pre- and post-course measure of parenting self-efficacy. Journal of Advanced Nursing, 60(5), 487–493.PubMedCrossRef
10.
go back to reference Abidin, R. R. (1997). Parenting Stress Index: A measure of the parent–child system. In C. P. Zalaquett & R. J. Wood (Eds.), Evaluating stress: A book of resources (pp. 277–291). Lanham, MD: Scarecrow Press. Abidin, R. R. (1997). Parenting Stress Index: A measure of the parent–child system. In C. P. Zalaquett & R. J. Wood (Eds.), Evaluating stress: A book of resources (pp. 277–291). Lanham, MD: Scarecrow Press.
11.
go back to reference Wyatt Kaminski, J., Valle, A. L., Filene, J. H., et al. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589.CrossRef Wyatt Kaminski, J., Valle, A. L., Filene, J. H., et al. (2008). A meta-analytic review of components associated with parent training program effectiveness. Journal of Abnormal Child Psychology, 36, 567–589.CrossRef
12.
go back to reference Alberta Centre for Child Family & Community Research. (2007). Common outcomes initiative: Roundtable final report. Edmonton, AB: Author. Alberta Centre for Child Family & Community Research. (2007). Common outcomes initiative: Roundtable final report. Edmonton, AB: Author.
13.
go back to reference Allison, K. R., & Yoshida, K. K. (1989). Increasing response rates in community health surveys administered by telephone. Canadian Journal of Public Health, 80, 67–70.PubMed Allison, K. R., & Yoshida, K. K. (1989). Increasing response rates in community health surveys administered by telephone. Canadian Journal of Public Health, 80, 67–70.PubMed
14.
go back to reference Howard, G. S., Ralph, K. M., Gulanick, N. A., et al. (1979). Internal validity in pretest–posttest, self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23.CrossRef Howard, G. S., Ralph, K. M., Gulanick, N. A., et al. (1979). Internal validity in pretest–posttest, self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychological Measurement, 3(1), 1–23.CrossRef
15.
go back to reference Conger, R. D., Patterson, G. R., & Ge, X. (1995). It takes two to replicate: A mediational model for the impact of parents’ stress on adolescent adjustment. Child Development, 66(1), 80–97.PubMedCrossRef Conger, R. D., Patterson, G. R., & Ge, X. (1995). It takes two to replicate: A mediational model for the impact of parents’ stress on adolescent adjustment. Child Development, 66(1), 80–97.PubMedCrossRef
16.
go back to reference 3 Cheers for the Early Years. (June 12, 2009). Parenting Needs Assessment: Final Report. Calgary, AB: Author. 3 Cheers for the Early Years. (June 12, 2009). Parenting Needs Assessment: Final Report. Calgary, AB: Author.
17.
go back to reference Griner Hill, L., & Betz, D. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517.CrossRef Griner Hill, L., & Betz, D. (2005). Revisiting the retrospective pretest. American Journal of Evaluation, 26(4), 501–517.CrossRef
18.
go back to reference Skinner, H. A., Steinhauer, P., & Santa-Barbara, J. (1995). FAM-III manual. Toronto, ON: Multi-health Systems. Skinner, H. A., Steinhauer, P., & Santa-Barbara, J. (1995). FAM-III manual. Toronto, ON: Multi-health Systems.
19.
go back to reference Trute, B., & Hiebert-Murphy, D. (2005). Predicting family adjustment and parenting stress in childhood: Disability services using brief assessment tools. Journal of Intellectual & Developmental Disability, 30(4), 217–225.CrossRef Trute, B., & Hiebert-Murphy, D. (2005). Predicting family adjustment and parenting stress in childhood: Disability services using brief assessment tools. Journal of Intellectual & Developmental Disability, 30(4), 217–225.CrossRef
20.
go back to reference Dunst, C. J., Jenkins, V., & Trivette, C. M. (1984). The family support scale: Reliability and validity. Journal of Individual, Family and Community Wellness, 1, 45–52. Dunst, C. J., Jenkins, V., & Trivette, C. M. (1984). The family support scale: Reliability and validity. Journal of Individual, Family and Community Wellness, 1, 45–52.
21.
go back to reference Hanley, B., Tasse, M., Aman, M. G., et al. (1998). Psychometric properties of the Family Support Scale with Head Start families. Journal of Child and Family Studies, 7(1), 69–77.CrossRef Hanley, B., Tasse, M., Aman, M. G., et al. (1998). Psychometric properties of the Family Support Scale with Head Start families. Journal of Child and Family Studies, 7(1), 69–77.CrossRef
22.
go back to reference Ware, J., & Sherbourne, C. (1992). The MOS 36-item short form health survey (SF-36): Conceptual framework and item selection. Medical Care, 30, 473–483.PubMedCrossRef Ware, J., & Sherbourne, C. (1992). The MOS 36-item short form health survey (SF-36): Conceptual framework and item selection. Medical Care, 30, 473–483.PubMedCrossRef
23.
go back to reference Ware, J. E., Kosinski, M., Dewey, J. E., et al. (2001). SF-8 Health survey manual—how to score and interpret single-item health measures: A manual for users of the SF-8 health survey. Lincoln, RI: Quality Metric Incorporated. Ware, J. E., Kosinski, M., Dewey, J. E., et al. (2001). SF-8 Health survey manual—how to score and interpret single-item health measures: A manual for users of the SF-8 health survey. Lincoln, RI: Quality Metric Incorporated.
24.
go back to reference Kazdin, A. E. (2003). Methodological issues and strategies in clinical research (3rd ed.). Washington, D.C.: American Psychological Association. Kazdin, A. E. (2003). Methodological issues and strategies in clinical research (3rd ed.). Washington, D.C.: American Psychological Association.
25.
go back to reference Cohen, J. (1977). Statistical power for the behavioral sciences. New York: Academic Press. Cohen, J. (1977). Statistical power for the behavioral sciences. New York: Academic Press.
26.
go back to reference Lamb, T. (2005). The retrospective pretest: An imperfect but useful tool. The Evaluation Exchange, 11(2), 18–19. Lamb, T. (2005). The retrospective pretest: An imperfect but useful tool. The Evaluation Exchange, 11(2), 18–19.
Metadata
Title
UpStart Parent Survey: A New Psychometrically Valid Tool for the Evaluation of Prevention-focused Parenting Programs
Authors
Karen Benzies
Dawn Clarke
Leslie Barker
Richelle Mychasiuk
Publication date
01-10-2013
Publisher
Springer US
Published in
Maternal and Child Health Journal / Issue 8/2013
Print ISSN: 1092-7875
Electronic ISSN: 1573-6628
DOI
https://doi.org/10.1007/s10995-012-1152-2

Other articles of this Issue 8/2013

Maternal and Child Health Journal 8/2013 Go to the issue