Skip to main content
Top
Published in: Prevention Science 8/2015

01-11-2015

Individual and School Organizational Factors that Influence Implementation of the PAX Good Behavior Game Intervention

Authors: Celene E. Domitrovich, Elise T. Pas, Catherine P. Bradshaw, Kimberly D. Becker, Jennifer P. Keperling, Dennis D. Embry, Nicholas Ialongo

Published in: Prevention Science | Issue 8/2015

Login to get access

Abstract

Evidence-based interventions are being disseminated broadly in schools across the USA, but the implementation levels achieved in community settings vary considerably. The current study examined the extent to which teacher and school factors were associated with implementation dosage and quality of the PAX Good Behavior Game (PAX GBG), a universal classroom-based preventive intervention designed to improve student social-emotional competence and behavior. Specifically, dosage (i.e., number of games and duration of games) across the school year and quality (i.e., how well the game is delivered) of PAX GBG implementation across four time points in a school year were examined. Hierarchical linear modeling was used to examine the association between teacher-level factors (e.g., demographics, self-reports of personal resources, attitudes toward the intervention, and workplace perceptions) and longitudinal implementation data. We also accounted for school-level factors, including demographic characteristics of the students and ratings of the schools’ organizational health. Findings indicated that only a few teacher-level factors were significantly related to variation in implementation. Teacher perceptions (e.g., fit with teaching style, emotional exhaustion) were generally related to dosage, whereas demographic factors (e.g., teachers’ age) were related to quality. These findings highlight the importance of school contextual and proximal teacher factors on the implementation of classroom-based programs.
Literature
go back to reference Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. (2011). Multiple imputation by chained equations: What is it and how does it work? International Journal of Methods in Psychiatric Research, 20, 40--49. doi:10.1002/mpr.329. Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. (2011). Multiple imputation by chained equations: What is it and how does it work? International Journal of Methods in Psychiatric Research, 20, 40--49. doi:10.​1002/​mpr.​329.
go back to reference Baker, C. N., Kupersmidt, J. B., Voegler-Lee, M. E., Arnold, D. H., & Willoughby, M. T. (2010). Predicting teacher participation in a classroom-based, integrated preventive intervention for preschoolers. Early Childhood Research Quarterly, 25, 270–283.PubMedCentralCrossRefPubMed Baker, C. N., Kupersmidt, J. B., Voegler-Lee, M. E., Arnold, D. H., & Willoughby, M. T. (2010). Predicting teacher participation in a classroom-based, integrated preventive intervention for preschoolers. Early Childhood Research Quarterly, 25, 270–283.PubMedCentralCrossRefPubMed
go back to reference Barrish, H., Saunders, M., & Wolf, M. (1969). Good Behavior Game: Effects of individual contingencies for group consequences on disruptive behavior in a classroom. Journal of Applied Behavior Analysis, 2, 119–124.PubMedCentralCrossRefPubMed Barrish, H., Saunders, M., & Wolf, M. (1969). Good Behavior Game: Effects of individual contingencies for group consequences on disruptive behavior in a classroom. Journal of Applied Behavior Analysis, 2, 119–124.PubMedCentralCrossRefPubMed
go back to reference Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.1007/s11121-008-0100-2.CrossRefPubMed Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers’ beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.​1007/​s11121-008-0100-2.CrossRefPubMed
go back to reference Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33.CrossRefPubMed Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33.CrossRefPubMed
go back to reference Bradshaw, C. P., Sawyer, A. L., & O’Brennan, L. M. (2009). A social disorganization perspective on bullying-related attitudes and behaviors: The influence of school context. American Journal of Community Psychology, 43, 204–220. doi:10.1007/s10464-009-9240-1.CrossRefPubMed Bradshaw, C. P., Sawyer, A. L., & O’Brennan, L. M. (2009). A social disorganization perspective on bullying-related attitudes and behaviors: The influence of school context. American Journal of Community Psychology, 43, 204–220. doi:10.​1007/​s10464-009-9240-1.CrossRefPubMed
go back to reference Bryk, A. S., & Schneider, B. (2002). Trust in schools: A core resource for improvement. New York: Russell Sage. Bryk, A. S., & Schneider, B. (2002). Trust in schools: A core resource for improvement. New York: Russell Sage.
go back to reference Cameron, A. C., & Trivedi, P. K. (1998). Regression analysis of count data. New York: Cambridge Press.CrossRef Cameron, A. C., & Trivedi, P. K. (1998). Regression analysis of count data. New York: Cambridge Press.CrossRef
go back to reference Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15–34. Chen, H. T. (1998). Theory-driven evaluations. Advances in Educational Productivity, 7, 15–34.
go back to reference Choi, J. N. (2003). How does context influence individual behavior? Multilevel assessment of the implementation of social innovations. Prevention and Treatment, 6. Choi, J. N. (2003). How does context influence individual behavior? Multilevel assessment of the implementation of social innovations. Prevention and Treatment, 6.
go back to reference Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Belmont: Wadsworth Group. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Belmont: Wadsworth Group.
go back to reference Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.CrossRefPubMed Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.CrossRefPubMed
go back to reference Domitrovich, C., Ialongo, N. (2008a). The Teacher Perceptions of the Intervention Attributes (TPIA) scale. Unpublished technical report. Johns Hopkins University. Domitrovich, C., Ialongo, N. (2008a). The Teacher Perceptions of the Intervention Attributes (TPIA) scale. Unpublished technical report. Johns Hopkins University.
go back to reference Domitrovich, C., Ialongo, N. (2008b). The Perception of Administrative Support Scale (PASS). Unpublished technical report, Johns Hopkins University. Domitrovich, C., Ialongo, N. (2008b). The Perception of Administrative Support Scale (PASS). Unpublished technical report, Johns Hopkins University.
go back to reference Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K. E., Buckley, J. A., Olin, S., … Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28. Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K. E., Buckley, J. A., Olin, S., … Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28.
go back to reference Domitrovich, C., Poduska, J., & Bradshaw, C.P. (2008). The Teacher-Coach Alliance Scale. Unpublished technical report. Penn State University. Domitrovich, C., Poduska, J., & Bradshaw, C.P. (2008). The Teacher-Coach Alliance Scale. Unpublished technical report. Penn State University.
go back to reference Domitrovich, C. E., Gest, S. D., Gill, S., Jones, D. J., & DeRouise, R. S. (2009). Teacher factors related to the professional development process of the Head Start REDI intervention. Early Education and Development, 20, 402–430.CrossRef Domitrovich, C. E., Gest, S. D., Gill, S., Jones, D. J., & DeRouise, R. S. (2009). Teacher factors related to the professional development process of the Head Start REDI intervention. Early Education and Development, 20, 402–430.CrossRef
go back to reference Domitrovich, C., Bradshaw, C., Greenberg, M., Embry, D., Poduska, J., & Ialongo, N. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47, 71–88. Domitrovich, C., Bradshaw, C., Greenberg, M., Embry, D., Poduska, J., & Ialongo, N. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47, 71–88.
go back to reference Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMed Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.CrossRefPubMed
go back to reference Embry, D., Staatemeier, G., Richardson, C., Lauger, K., & Mitich, J. (2003). The PAX Good Behavior Game (1st ed.). Center City: Hazelden. Embry, D., Staatemeier, G., Richardson, C., Lauger, K., & Mitich, J. (2003). The PAX Good Behavior Game (1st ed.). Center City: Hazelden.
go back to reference Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.CrossRefPubMed Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.CrossRefPubMed
go back to reference Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research on Crime and Delinquency, 39, 3–35.CrossRef Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research on Crime and Delinquency, 39, 3–35.CrossRef
go back to reference Greenberg, M., & Kusché, C. (2006). Building social and emotional competence: The PATHS Curriculum. In S. Jimerson & M. J. Furlong (Eds.), Handbook of school violence and safety (pp. 395–412). New York: Lawrence Erlbaum Associates. Greenberg, M., & Kusché, C. (2006). Building social and emotional competence: The PATHS Curriculum. In S. Jimerson & M. J. Furlong (Eds.), Handbook of school violence and safety (pp. 395–412). New York: Lawrence Erlbaum Associates.
go back to reference Greenberg, M. T., Domitrovich, C., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research and practice. Promotion of mental health and prevention of mental behavioral disorders, 3, 1–62. Greenberg, M. T., Domitrovich, C., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research and practice. Promotion of mental health and prevention of mental behavioral disorders, 3, 1–62.
go back to reference Greenberg, M. T., Kusché, C. A., & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (Grades 3–5). South Deerfield: Channing-Bete Co. Greenberg, M. T., Kusché, C. A., & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (Grades 3–5). South Deerfield: Channing-Bete Co.
go back to reference Han, S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33, 665–679.CrossRefPubMed Han, S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33, 665–679.CrossRefPubMed
go back to reference Hoy, W. K., & Feldman, J. (1987). Organizational health: The concept and its measure. Journal of Research and Development in Education, 20, 30–38. Hoy, W. K., & Feldman, J. (1987). Organizational health: The concept and its measure. Journal of Research and Development in Education, 20, 30–38.
go back to reference Hoy, W. K., & Tarter, C. J. (1997). The road to open and healthy schools: A handbook for change, elementary edition. Thousand Oaks: Corwin Press. Hoy, W. K., & Tarter, C. J. (1997). The road to open and healthy schools: A handbook for change, elementary edition. Thousand Oaks: Corwin Press.
go back to reference Ialongo, N.; Poduska, J.; Werthamer, L.; Kellam, S. (2001). The Distal Impact of Two First-Grade Preventive Interventions on Conduct Problems and Disorder in Early Adolescence. Journal of Emotional and Behavioral Disorders, 9(3):146. doi:10.1177/106342660100900301. Ialongo, N.; Poduska, J.; Werthamer, L.; Kellam, S. (2001). The Distal Impact of Two First-Grade Preventive Interventions on Conduct Problems and Disorder in Early Adolescence. Journal of Emotional and Behavioral Disorders, 9(3):146. doi:10.​1177/​1063426601009003​01.
go back to reference Ialongo, N., Wethamer, L., Kellam, S., Brown, C., Wang, S., & Lin, Y. (1999). Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and anti-social behavior. American Journal of Community Psychology, 27, 599–641.CrossRefPubMed Ialongo, N., Wethamer, L., Kellam, S., Brown, C., Wang, S., & Lin, Y. (1999). Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and anti-social behavior. American Journal of Community Psychology, 27, 599–641.CrossRefPubMed
go back to reference Kellam, S. G., Poduska, J. M., Ialongo, N. S., Wang, W., Toyinbo, P., Petras, H., Ford, C.,Windham, A., & Wilcox, H. C. (2007). Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug and Alcohol Dependence, 95, 5–28. Kellam, S. G., Poduska, J. M., Ialongo, N. S., Wang, W., Toyinbo, P., Petras, H., Ford, C.,Windham, A., & Wilcox, H. C. (2007). Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug and Alcohol Dependence, 95, 5–28.
go back to reference Kusché, C. A., Greenberg, M. T., & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (Grades 1–2). South Deerfield: Channing-Bete Co. Kusché, C. A., Greenberg, M. T., & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (Grades 1–2). South Deerfield: Channing-Bete Co.
go back to reference Land, K. C., McCall, P. L., & Nagin, D. (1996). A comparison of Poisson, negative binomial, and semiparametric mixed Poisson regression models: With empirical applications to criminal careers data. Sociological Methods and Research, 24, 387–442. doi:10.1177/0049124196024004001.CrossRef Land, K. C., McCall, P. L., & Nagin, D. (1996). A comparison of Poisson, negative binomial, and semiparametric mixed Poisson regression models: With empirical applications to criminal careers data. Sociological Methods and Research, 24, 387–442. doi:10.​1177/​0049124196024004​001.CrossRef
go back to reference Luke, D. (2004). Multilevel modeling. Thousand Oaks: Sage. Luke, D. (2004). Multilevel modeling. Thousand Oaks: Sage.
go back to reference Main, S., & Hammond, L. (2008). Best practice or most practiced? Pre-service teachers’ beliefs about effective behavior management strategies and reported self-efficacy. Australian Journal of Teacher Education, 33, 28–39.CrossRef Main, S., & Hammond, L. (2008). Best practice or most practiced? Pre-service teachers’ beliefs about effective behavior management strategies and reported self-efficacy. Australian Journal of Teacher Education, 33, 28–39.CrossRef
go back to reference Maslach, C., Jackson, S. E., & Leiter, M. P. (1997). Maslach burnout inventory: Third edition. In R. J. Wood (Ed.), Evaluating stress: A book of resources (pp. 191–218). MD US: Scarecrow Education: Lanham. Maslach, C., Jackson, S. E., & Leiter, M. P. (1997). Maslach burnout inventory: Third edition. In R. J. Wood (Ed.), Evaluating stress: A book of resources (pp. 191–218). MD US: Scarecrow Education: Lanham.
go back to reference Pas, E. T., Bradshaw, C. P., & Cash, A. (2014). Coaching classroom-based preventive interventions. In M. Weist, N. Lever, C. Bradshaw, & J. Owens (Eds.), Handbook of school mental health (2nd ed., pp. 255–268). New York: Springer.CrossRef Pas, E. T., Bradshaw, C. P., & Cash, A. (2014). Coaching classroom-based preventive interventions. In M. Weist, N. Lever, C. Bradshaw, & J. Owens (Eds.), Handbook of school mental health (2nd ed., pp. 255–268). New York: Springer.CrossRef
go back to reference Payne, A. A., Gottfredson, D. C., & Gottfredson, G. D. (2006). School predictors of the intensity of implementation of school-based prevention programs: Results from a national study. Prevention Science, 7, 225–237. doi:10.1007/s11121-006-0029-2.CrossRefPubMed Payne, A. A., Gottfredson, D. C., & Gottfredson, G. D. (2006). School predictors of the intensity of implementation of school-based prevention programs: Results from a national study. Prevention Science, 7, 225–237. doi:10.​1007/​s11121-006-0029-2.CrossRefPubMed
go back to reference Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532. Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532.
go back to reference Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical Linear Models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical Linear Models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
go back to reference Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., Congdon, R., & du Toit, M. (2011). HLM statistical software: Version 7. Lincolnwood: Scientific Software International, Inc. Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., Congdon, R., & du Toit, M. (2011). HLM statistical software: Version 7. Lincolnwood: Scientific Software International, Inc.
go back to reference Ringwalt, C. L., Ennett, S., Johnson, R., Rorhbach, L. A., Simons-Rudolph, A., Vincus, A., et al. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education and Behavior, 30, 375–391.CrossRefPubMed Ringwalt, C. L., Ennett, S., Johnson, R., Rorhbach, L. A., Simons-Rudolph, A., Vincus, A., et al. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education and Behavior, 30, 375–391.CrossRefPubMed
go back to reference Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.CrossRefPubMed Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.CrossRefPubMed
go back to reference Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRef Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRef
go back to reference Scaccia, J., Cook, B., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. (2015). A practical implementation science heuristic for organizational readiness: R =MC2. Journal of Community Psychology. in press. Scaccia, J., Cook, B., Lamont, A., Wandersman, A., Castellow, J., Katz, J., & Beidas, R. (2015). A practical implementation science heuristic for organizational readiness: R =MC2. Journal of Community Psychology. in press.
go back to reference Schaffer, K., Rouiller, S., Embry, D., & Ialongo, N. (2006). The PAX Good Behavior Game Implementation Rubric. Unpublished technical report. Johns Hopkins University. Schaffer, K., Rouiller, S., Embry, D., & Ialongo, N. (2006). The PAX Good Behavior Game Implementation Rubric. Unpublished technical report. Johns Hopkins University.
go back to reference Tout K, Zaslow M, Berry D. (2006) Quality and qualifications: Links between professional development and quality in early care and education settings. In: Zaslow M., Martinez-Beck I, (eds.) Critical issues in early childhood professional development. Baltimore: Brookes Publishing. Tout K, Zaslow M, Berry D. (2006) Quality and qualifications: Links between professional development and quality in early care and education settings. In: Zaslow M., Martinez-Beck I, (eds.) Critical issues in early childhood professional development. Baltimore: Brookes Publishing.
go back to reference Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L.,…, & Saul, J. (2008). Bridging the gap between prevention research and practice: The Interactive Systems Framework for Dissemination and Implementation. American Journal of Community Psychology, 41, 171–181. Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L.,…, & Saul, J. (2008). Bridging the gap between prevention research and practice: The Interactive Systems Framework for Dissemination and Implementation. American Journal of Community Psychology, 41, 171–181.
go back to reference White, I. R., Royston, P., & Wood, A. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30, 377--399. doi:10.1002/sim.4067. White, I. R., Royston, P., & Wood, A. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30, 377--399. doi:10.​1002/​sim.​4067.
go back to reference Wehby, J. H., Maggin, D. M., Moore Partin, T. C., & Robertson, R. (2011). The impact of working alliance, social validity, and teacher burnout on implementation fidelity of the Good Behavior Game. School Mental Health, 4, 22–33. doi:10.1007/s12310-011-9067-4.CrossRef Wehby, J. H., Maggin, D. M., Moore Partin, T. C., & Robertson, R. (2011). The impact of working alliance, social validity, and teacher burnout on implementation fidelity of the Good Behavior Game. School Mental Health, 4, 22–33. doi:10.​1007/​s12310-011-9067-4.CrossRef
Metadata
Title
Individual and School Organizational Factors that Influence Implementation of the PAX Good Behavior Game Intervention
Authors
Celene E. Domitrovich
Elise T. Pas
Catherine P. Bradshaw
Kimberly D. Becker
Jennifer P. Keperling
Dennis D. Embry
Nicholas Ialongo
Publication date
01-11-2015
Publisher
Springer US
Published in
Prevention Science / Issue 8/2015
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-015-0557-8

Other articles of this Issue 8/2015

Prevention Science 8/2015 Go to the issue