Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-05-2018 | Original Article

Promoting Teachers’ Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach–Teacher Relationship

Authors: Stacy R. Johnson, Elise T. Pas, Catherine P. Bradshaw, Nicholas S. Ialongo

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 3/2018

Abstract

There is growing awareness of the importance of implementation fidelity and the supports, such as coaching, to optimize it. This study examined how coaching activities (i.e., check-ins, needs assessment, modeling, and technical assistance) related directly and indirectly to implementation dosage and quality of the PAX Good Behavior Game, via a mediating pathway through working relationship. Mediation analyses of 138 teachers revealed direct effects of modeling and working relationship on implementation dosage, whereas needs assessment was associated with greater dosage indirectly, by higher ratings of the working relationship. Understanding how coaching activities promote implementation fidelity elements has implications for improving program effectiveness.

Aarons, G. A., Farahnak, L. R., & Ehrhart, M. G. (2014). Leadership and strategic organizational climate to support evidence-based practice implementation. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health (pp. 82–97). New York: Guildford Press.

Ackerman, S. J., & Hilsenroth, M. J. (2003). A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review, 23(1), 1–33. doi:10.1016/S0272-7358(02)00146-0.CrossRefPubMed

Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. J. (2011). Multiple imputation by chained equations: What is it and how does it work? International Journal of Methods in Psychiatric Research, 20(1), 40–49. doi:10.1002/mpr.329.CrossRefPubMedPubMedCentral

Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Bernstein, A. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 518–529. doi:10.1007/s10488-013-0485-5.CrossRefPubMedPubMedCentral

Becker, K. D., Bradshaw, C. P., Domitrovich, C. E., & Ialongo, N. S. (2013a). Coaching teachers to improve implementation of the good behavior game. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 482–493. doi:10.1007/s10488-013-0482-8.CrossRefPubMed

Becker, K. D., Darney, D., Domitrovich, C. E., Keperling, J. P., & Ialongo, N. S. (2013b). Supporting universal prevention programs: A two-phased coaching model. Clinical Child and Family Psychology Review, 16(2), 213–228. doi:10.1007/s10567-013-0134-2.CrossRefPubMedPubMedCentral

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606. doi:10.1037/0033-2909.88.3.588.CrossRef

Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12(3), 133–148. doi:10.1177/1098300709334798.CrossRef

Bradshaw, C. P., Pas, E. T., Goldweber, A., Rosenberg, M. S., & Leaf, P. J. (2012). Integrating school-wide positive behavioral interventions and supports with tier 2 coaching to student support teams: The PBISplus model. Advances in School Mental Health Promotion, 5(3), 177–193. doi:10.1080/1754730x.2012.707429.CrossRef

Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40. doi:10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral

Century, J., Rudnick, M., & Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31(2), 199–218. doi:10.1177/1098214010366173.CrossRef

Coles, E. K., Owens, J. S., Serrano, V. J., Slavec, J., & Evans, S. W. (2015). From consultation to student outcomes: The role of teacher knowledge, skills, and beliefs in increasing integrity in classroom management strategies. School Mental Health, 7(1), 34–48. doi:10.1007/s12310-015-9143-2.CrossRef

Cook, C. R., Lyon, A. R., Kubergovic, D., Browning Wright, D., & Zhang, Y. (2015). A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. School Mental Health, 7(1), 49–60. doi:10.1007/s12310-014-9139-3.CrossRef

Denton, C. A., & Hasbrouck, J. A. N. (2009). A description of instructional coaching and its relationship to consultation. Journal of Educational and Psychological Consultation, 19(2), 150–175. doi:10.1080/10474410802463296.CrossRef

Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47(1), 71–88. doi:10.1002/pits.20452.PubMedPubMedCentral

Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., … Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. doi:10.1080/1754730x.2008.9715730.CrossRefPubMedPubMedCentral

Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11, 193–221. doi:10.1207/s1532768xjepc1102_04.CrossRef

Domitrovich, C. E., Pas, E. T., Bradshaw, C. P., Becker, K. D., Keperling, J. P., Embry, D. D., & Ialongo, N. (2015). Individual and school organizational factors that influence implementation of the PAX good behavior game intervention. Prevention Science. doi:10.1007/s11121-015-0557-8.

Domitrovich, C. E., Poduska, J. M., & Bradshaw, C. P. (2008). The teacher-coach alliance scale. Unpublished technical report. Penn State University.

Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. doi:10.1007/s10464-008-9165-0.CrossRefPubMed

Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256. doi:10.1093/her/18.2.237.CrossRefPubMed

Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20(3), 308–313. doi:10.1093/her/cyg134.CrossRefPubMed

Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissberg, R. P. (2003). Implementation, sustainability, and scaling up of social-emotional and academic innovations in public schools. School Psychology Review, 32, 303–319.

Embry, D., Staatemeier, G., Richardson, C., Lauger, K., & Mitich, J. (2003). The PAX good behavior game (1st edn.). Center City, MN: Hazelden.

Frank, J. L., & Kratochwill, T. R. (2014). School-based problem-solving consultation: Plotting a new course for evidence-based research and practice in consultation. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (2 ed., pp. 13–30). New York: Taylor and Francis.

Garet, M. S., Heppen, J., Walters, K., Smith, T., & Yang, R. (2016). Does content-focused teacher professional development work? Findings from three Institute of Education Sciences Studies (Evaluation Brief NCEE 2017-4010). Retrieved from http://ies.ed.gov/ncee/pubs/20174010/pdf/20174010.pdf.

Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39, 3–35. doi:10.1177/002242780203900101.CrossRef

Greenberg, M., & Kusché, C. A. & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (grades 3–5). South Deerfield, MA: Channing-Bete Co.

Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36(2), 223–233. doi:10.1037/0022-0167.36.2.223.CrossRef

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi:10.1080/10705519909540118.CrossRef

Johnson, S. R., Pas, E. T., & Bradshaw, C. P. (2016). Understanding and measuring coach–teacher alliance: A glimpse inside the ‘black box’. Prevention Science, 17(4), 439–449. doi:10.1007/s11121-016-0633-8.CrossRefPubMedPubMedCentral

Joyce, B., & Showers, B. (1980). Improving inservice training: The message of research. Educational Leadership, 37(5), 379–385.

Kaftarian, S., Robertson, E., Compton, W., Davis, B. W., & Volkow, N. (2004). Blending prevention research and practice in schools: Critical issues and suggestions. Prevention Science, 5(1), 1–3. doi:10.1023/B:PREV.0000013975.74774.bc.CrossRefPubMed

Kratochwill, T., Elliott, S., & Rotto, P. C. (1995). Best practices in school-based behavioral consultation. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology III (pp. 519–535). Bethesda, MD: National Association of School Psychologists.

Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 33(4), 279–299. doi:10.1177/0888406410371643.CrossRef

Kusché, C. A., & Greenberg, M. & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (grades 1–2). South Deerfield, MD: Channing-Bete Co.

Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113. doi:10.1007/s12310-010-9038-1.CrossRefPubMedPubMedCentral

MacKinnon, D. (2008). Introduction to statistical mediation analysis. Mahwah, NJ: Erlbaum.

Marchese, D. D., Becker, K. D., Kaperlink, J. P., Domitrovich, C. E., Reinke, W. M., Embry, D. D., & Ialongo, N. S. (2017). A step-by-step guide for coaching classroom teachers in evidence-based interventions. New York: Oxford Press.CrossRef

Muthén, L. K., & Muthén, B. O. (1998–2014). Mplus user’s guide (Vol. 7). Los Angeles, CA: Muthén & Muthén.

Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health, 40(6), 439–450. doi:10.1007/s10488-013-0502-8.CrossRefPubMedPubMedCentral

Noell, G. H., & Gansle, K. A. (2014). Research examining the relationships between consultation procedures, treatment integrity, and outcomes. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (Vol. 2, pp. 386–408). New York: Routledge.

Owens, J. S., Schwartz, M. E., Erchul, W. P., Himawan, L. K., Evans, S. W., Coles, E. K., & Schulte, A. C. (2017). Teacher perceptions of school consultant social influence strategies: Replication and expansion. Journal of Educational and Psychological Consultation. doi:10.1080/10474412.2016.1275649.

Pas, E. T., Bradshaw, C. P., Becker, K. D., Domitrovich, C. E., Berg, J., Musci, R., & Ialongo, N. S. (2015). Identifying patterns of coaching to support the implementation of the good behavior game: The role of teacher characteristics. School Mental Health, 7(1), 61–73. doi:10.1007/s12310-015-9145-0.CrossRef

Pas, E. T., Bradshaw, C. P., & Cash, A. H. (2014). Coaching classroom-based preventive interventions. In M. D. Weist, N. A. Lever, C. P. Bradshaw & J. S. Owens (Eds.), Handbook of school mental health: research, training, practice, and policy (2 ed., pp. 255–267). New York: Springer.CrossRef

Pas, E. T., Larson, K., Reinke, W., Herman, K., & Bradshaw, C. P. (2016). Implementation and acceptability of an adapted classroom check-up coaching model to promote culturally-responsive classroom management. The Education & Treatment of Children, 39, 467–492. doi:10.1353/etc.2016.0021.CrossRef

Reinke, W. M., Herman, K. C., & Sprick, R. (2011). Motivational interviewing for effective classroom management: The classroom check-up. New York: Guilford Press.

Reinke, W. M., Herman, K. C., Stormont, M., Newcomer, L., & David, K. (2013). Illustrating the multiple facets and levels of fidelity of implementation to a teacher classroom management intervention. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 494–506. doi:10.1007/s10488-013-0496-2.CrossRefPubMed

Reinke, W. M., Lewis-Palmer, T., & Martin, E. (2007). The effect of visual performance feedback on teacher use of behavior-specific praise. Behavior Modification, 31(3), 247–263. doi:10.1177/0145445506288967.CrossRefPubMed

Ringwalt, C., Vincus, A. A., Hanley, S., Ennett, S. T., Bowling, J. M., & Rohrbach, L. A. (2009). The prevalence of evidence-based drug use prevention curricula in U.S. middle schools in 2005. Prevention Science, 10(1), 33–40. doi:10.1007/s11121-008-0112-y.CrossRefPubMedPubMedCentral

Saldana, L., Chamberlain, P., & Chapman, J. (2016). A supervisor-targeted implementation approach to promote system change: The R3 Model. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 879–892. doi:10.1007/s10488-016-0730-9.CrossRefPubMedPubMedCentral

Sanetti, L. M. H., Collier-Meek, M. A., Long, A. C. J., Kim, J., & Kratochwill, T. R. (2014). Using implementation planning to increase teachers’ adherence and quality behavior support plans. Psychology in the Schools, 51(8), 879–895. doi:10.1002/pits.21787.CrossRef

Schaffer, K., Rouiller, S., Embry, D., & Ialongo, N. (2006). The PAX good behavior game implementation rubric. Unpublished technical report. Johns Hopkins University.

Spoth, R., Rohrbach, L., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., … Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351. doi:10.1007/s11121-012-0362-6.CrossRefPubMedPubMedCentral

Stormont, M., & Reinke, W. M. (2014). Providing performance feedback for teachers to increase treatment fidelity. Intervention in School and Clinic, 49(4), 219–224. doi:10.1177/1053451213509487.CrossRef

Stormont, M., Reinke, W. M., Newcomer, L., Marchese, D., & Lewis, C. (2015). Coaching teachers’ use of social behavior interventions to improve children’s outcomes: A review of the literature. Journal of Positive Behavior Interventions, 17(2), 69–82. doi:10.1177/1098300714550657.CrossRef

Taylor, J. (2007). Instructional coaching: The state of the art. In M. Mangin & S. Stoelinga (Eds.), Effective teacher leadership: Using research to inform and reform. New York: Teachers College Press.

U.S. Department of Education. (2012). Prevalence and implementation fidelity of research-based prevention programs in public schools: Final report Retrieved from http://www2.ed.gov/rschstat/eval/other/research-based-prevention.pdf.

Wehby, J. H., Maggin, D. M., Partin, Moore, T. C., & Robertson, R. (2012). The impact of working alliance, social validity, and teacher burnout on implementation fidelity of the good behavior game. School Mental Health, 4(1), 22–33. doi:10.1007/s12310-011-9067-4.CrossRef

White, I. R., Royston, P., & Wood, A. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30(4), 377–399. doi:10.1002/sim.4067.CrossRefPubMed

Title: Promoting Teachers’ Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach–Teacher Relationship
Authors: Stacy R. Johnson
Elise T. Pas
Catherine P. Bradshaw
Nicholas S. Ialongo
Publication date: 01-05-2018
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 3/2018
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-017-0832-z

At a glance: The STEP trials

Springer Medicine

Promoting Teachers’ Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach–Teacher Relationship

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2018

Stepped Care Interpersonal Psychotherapy Treatment for Depressed Adolescents: A Pilot Study in Pediatric Clinics

Behavioural and Emotional Problems in Children and Educational Outcomes: A Dynamic Panel Data Analysis

Qualitative Evaluation of a Peer Navigator Program for Latinos with Serious Mental Illness

Impact of the New Mental Health Services on Rates of Suicide and Hospitalisations by Attempted Suicide, Psychiatric Problems, and Alcohol Problems in Brazil

Agreement and Discrepancy Between Supervisor and Clinician Alliance: Associations with Clinicians’ Perceptions of Psychological Climate and Emotional Exhaustion

Exploring Provider Use of a Digital Implementation Support System for School Mental Health: A Pilot Study