Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-11-2013 | Original Article

Illustrating the Multiple Facets and Levels of Fidelity of Implementation to a Teacher Classroom Management Intervention

Authors: Wendy M. Reinke, Keith C. Herman, Melissa Stormont, Lori Newcomer, Kimberly David

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2013

Abstract

Many school-based interventions to promote student mental health rely on teachers as implementers. Thus, understanding the interplay between the multiple domains of fidelity to the intervention and intervention support systems such as coaching and teacher implementation of new skills is an important aspect of implementation science. This study describes a systematic process for assessing multiple domains of fidelity. Data from a larger efficacy trial of the Incredible Years Teacher Classroom Management (IY TCM) program are utilized. Data on fidelity to the IY TCM workshop training sessions and onsite weekly coaching indicate that workshop leaders and the IY TCM coach implemented the training and coaching model with adequate adherence. Further, workshop leaders’ ratings of engagement were associated with teacher implementation of specific praise, following training on this content. Lastly, the IY TCM coach differentiation of teacher exposure to coaching was evaluated and found to be associated with teacher implementation of classroom management practices and student disruptive behavior.

Aarons, G., Hulburt, M., & Horwitz, S. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23. doi:10.1007/s10488-010-0327-7.PubMedCrossRef

Bandura, A. (1977). Social learning theory. Oxford England: Prentice-Hall.

Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37, 122–147. doi:10.1037/0003-066X.37.2.122.CrossRef

Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45.PubMedCrossRef

Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., et al. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28. doi:10.1080/1754730X.2008.9715730.CrossRef

Driscoll, K. C., Wang, L., Mashburn, A. J., & Pianta, R. C. (2011). Fostering supportive teacher–child relationships: Intervention implementation in a state-funded preschool program. Early Education and Development, 22, 593–619. doi:10.1080/10409289.2010.502015.CrossRef

Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0.PubMedCrossRef

Dusenbury, L., Brannigan, L., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.PubMedCrossRef

Forman, S. G., Olin, S., Hoagwood, K., Crowe, M., & Saka, N. (2009). Evidence-based intervention in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1, 26–36. doi:10.1007/s12310-008-9002-5.CrossRef

Greenwood, C., Kratochwill, T., & Clements, M. (2008). Schoolwide Prevention Models: Lessons Learned in Elementary School. New York, NY: Guilford Press.

Gresham, F. M. (2009). Evolution of the treatment integrity concept: Current status and future directions. School Psychology Review, 38, 533–540.

Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–272.

Ialongo, N., Poduska, J., Werthamer, L., & Kellam, S. (2001). The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional and Behavioral Disorders, 9(3), 146–160.CrossRef

Kellam, S. G., Ling, X., Merisca, R., Brown, C. H., & Ialongo, N. (1998). The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Development and Psychopathology, 10(2), 165–185.PubMedCrossRef

Landsverk, J., Brown, C., Rolls, R. J., Palinkas, L., & Horwitz, S. (2011). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research, 38, 54–63.PubMedCrossRef

Leff, S., Hoffman, J., & Gullan, R. (2009). Intervention integrity: New paradigms and applications. School Mental Health, 3, 103–106. doi:10.1007/s12310-009-9013-x.CrossRef

Leflot. G., van Lier, P. A. C., Onghena, P., & Colpin, H. (2010). The role of teacher behavior management in the development of disruptive behaviors: An intervention study with the good behavior game. Journal of Abnormal Child Psychology, 38, 869–882.PubMedCrossRef

National Research Council. (2002). Minority students in special and gifted education. Committee on Minority Representation in Special Education. Washington, DC.: National Academy Press.

Noell, G. H., Duhon, G. J., Gatti, S. L., & Connell, J. E. (2002). Consultation, follow-up, and implementation of behavior management interventions in general education. School Psychology Review, 31, 217–234.

Perepletchikova, F. (2011). On the topic of treatment integrity. Clinical Psychology: Science and Practice, 18, 148–153. doi:10.1111/j.1468-2850.2011.01246.x.CrossRef

Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi:10.1093/clipsy/bpi045.CrossRef

Power, T. J., Blom-Hoffman, J., Clarke, A. T., Riley-Tillman, T., Kelleher, C., & Manz, P. H. (2005). Reconceptualizing intervention integrity: A partnership-based framework for linking research with practice. Psychology in the Schools, 42, 495–507. doi:10.1002/pits.20087.CrossRef

Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532.

Reinke, W. M., Herman, K. C., & Stormont, M. (2013). Classroom level positive behavior supports in schools implementing SW-PBIS: Identifying areas for enhancement. Journal of Positive Behavior Interventions, 15, 51–60.CrossRef

Reinke, W. M., & Newcomer, L. (2010). Brief classroom interaction observation revised (BCIO-R). Cambridge: University of Missouri.

Reinke, W. M., Stormont, M., Herman, K. C., Puri, R., & Goel, N. (2011). Supporting children’s mental health in schools: Teacher perceptions of needs, roles, and barriers. School Psychology Quarterly, 26, 1–13. doi:10.1037/a0022714.CrossRef

Reinke, W. M., Stormont, M., Webster-Stratton, C., Newcomer, L., & Herman, K. C. (2012). The incredible years teacher training: Using coaching to support generalization to real world classroom settings. Psychology in the Schools, 49, 416–428.CrossRef

Rones, M., & Hoagwood, K. (2000). School-based mental health services: A research review. Clinical Child Family Psychology Review, 3, 223–241.PubMedCrossRef

Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190–1197. doi:10.1176/appi.ps.52.9.1190.PubMedCrossRef

Shepard, S. & Rivera, M. (2009). Therapist Impressions of Participation (unpublished).

Shernoff, E., Marinez-Lora, A., Frazier, S., Jakobsons, L., & Atkins, M. (2011). Teacher supporting teachers in urban schools: What iterative research designs can teach us. School Psychology Review, 40, 465–485.PubMed

Snyder, J., Low, S., Schultz, T., Barner, S., Moreno, D., Garst, M., et al. (2011). The impact of brief teacher training on classroom management and child behavior in at-risk preschool settings: Mediators and treatment utility. Journal of Applied Developmental Psychology, 32, 336–345. doi:10.1016/j.appdev.2011.06.001.CrossRef

Stormont, M., Reinke, W. M., Newcomer, L., Darney, D., Lewis, C. (2013). Coaching teachers’ use of social behavior interventions to improve children’s outcomes: A review of the literature. (submitted).

Tapp, J. (2004). Multi-option observation system for experimental studies (MOOSES). Retrieved from http://kc.vanderbilt.edu/mooses/mooses.html.

Walter, H. J., Gouze, K., & Lim, K. G. (2006). Teachers’ beliefs about mental health needs of inner city elementary schools. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 61–68. doi:10.1097/01.chi.0000187243.17824.6c.PubMedCrossRef

Webster-Stratton, C. (1994). The incredible years teacher training series. Seattle, WA: Incredible Years Press.

Webster-Stratton, C. (2001). The incredible years: Parents, teachers, and children training series. Residential Treatment for Children & Youth, 18(3), 31–45. doi:10.1300/J007v18n03_04.CrossRef

Webster-Stratton, C. (2010a). Incredible years teacher workshop evaluation. Seattle, WA: Incredible Years.

Webster-Stratton, C. (2010b). Incredible years teacher workshop satisfaction questionnaire. Seattle, WA: Incredible Years.

Webster-Stratton, C., Reid, M., & Hammond, M. (2001). Preventing conduct problems, promoting social competence: A parent and teacher training partnership in head start. Journal of Clinical Child Psychology, 30, 283–302. doi:10.1207/S15374424JCCP3003_2.PubMedCrossRef

Webster-Stratton, C., Reid, M., & Hammond, M. (2004). Treating children with early-onset conduct problems: Intervention outcomes for parent, child, and teacher training. Journal of Clinical Child and Adolescent Psychology, 33, 105–124. doi:10.1207/S15374424JCCP3301_11.PubMedCrossRef

Webster-Stratton, C., Reid, M., & Stoolmiller, M. (2008). Preventing conduct problems and improving school readiness: Evaluation of the incredible years teacher and child training programs in high-risk schools. Journal of Child Psychology and Psychiatry, 49, 471–488. doi:10.1111/j.1469-7610.2007.01861.x.PubMedCrossRef

Wehby, J. H. (2010). Teacher/consultant alliance scale. Nashville, TN: Vanderbilt University.

Weinstein, C. S. (2007). Middle and secondary classroom management: Lessons from research and practice (3rd ed.). New York, NY: McGraw-Hill.

Wenz-Gross, M., & Upshur, C. (2012). Implementing a primary prevention social skills intervention in urban preschools: Factors associated with quality and fidelity. Early Education and Development, 23, 427–450. doi:10.1080/10409289.2011.589043.PubMedCrossRef

World Health Organization. (2004). Prevention of mental disorders: Effective interventions and policy options. Summary report. World Health Organization: Geneva.

Title: Illustrating the Multiple Facets and Levels of Fidelity of Implementation to a Teacher Classroom Management Intervention
Authors: Wendy M. Reinke
Keith C. Herman
Melissa Stormont
Lori Newcomer
Kimberly David
Publication date: 01-11-2013
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2013
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-013-0496-2

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Illustrating the Multiple Facets and Levels of Fidelity of Implementation to a Teacher Classroom Management Intervention

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2013

The Role of Consultation Calls for Clinic Supervisors in Supporting Large-Scale Dissemination of Evidence-Based Treatments for Children

More Practice, Less Preach? The Role of Supervision Processes and Therapist Characteristics in EBP Implementation

“If It’s Worth My Time, I will Make the Time”: School-Based Providers’ Decision-Making About Participating in an Evidence-Based Psychotherapy Consultation Program

Therapists Perspectives on the Effective Elements of Consultation Following Training

Consultation as an Implementation Strategy for Evidence-Based Practices Across Multiple Contexts: Unpacking the Black Box

Unpacking the Black Box of Implementation: The Next Generation for Policy, Research and Practice