Skip to main content
Top
Published in: Prevention Science 1/2013

01-02-2013

Setting-Level Influences on Implementation of the Responsive Classroom Approach

Authors: Shannon B. Wanless, Christine L. Patton, Sara E. Rimm-Kaufman, Nancy L. Deutsch

Published in: Prevention Science | Issue 1/2013

Login to get access

Abstract

We used mixed methods to examine the association between setting-level factors and observed implementation of a social and emotional learning intervention (Responsive Classroom® approach; RC). In study 1 (N = 33 3rd grade teachers after the first year of RC implementation), we identified relevant setting-level factors and uncovered the mechanisms through which they related to implementation. In study 2 (N = 50 4th grade teachers after the second year of RC implementation), we validated our most salient Study 1 finding across multiple informants. Findings suggested that teachers perceived setting-level factors, particularly principal buy-in to the intervention and individualized coaching, as influential to their degree of implementation. Further, we found that intervention coaches’ perspectives of principal buy-in were more related to implementation than principals’ or teachers’ perspectives. Findings extend the application of setting theory to the field of implementation science and suggest that interventionists may want to consider particular accounts of school setting factors before determining the likelihood of schools achieving high levels of implementation.
Appendix
Available only for authorised users
Literature
go back to reference Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers' beliefs and attitudes associated with implementation of the Positive Action Program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.1007/s11121-008-0100-2.PubMedCrossRef Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers' beliefs and attitudes associated with implementation of the Positive Action Program: A diffusion of innovations model. Prevention Science, 9, 264–275. doi:10.​1007/​s11121-008-0100-2.PubMedCrossRef
go back to reference Berends, M., Bodilly, S. J., & Kirby, S. N. (2002). Facing the challenges of whole-school reform: New American schools after a decade. Santa Monica, CA: New American Schools and RAND. Berends, M., Bodilly, S. J., & Kirby, S. N. (2002). Facing the challenges of whole-school reform: New American schools after a decade. Santa Monica, CA: New American Schools and RAND.
go back to reference Borkenau, P., & Liebler, A. (1993). Convergence of stranger ratings of personality and intelligence with self-ratings, partner ratings, and measured intelligence. Journal of Personality and Social Psychology, 65, 546–553. doi:10.1037//0022-3514.65.3.546.CrossRef Borkenau, P., & Liebler, A. (1993). Convergence of stranger ratings of personality and intelligence with self-ratings, partner ratings, and measured intelligence. Journal of Personality and Social Psychology, 65, 546–553. doi:10.​1037/​/​0022-3514.​65.​3.​546.CrossRef
go back to reference Bryk, A. S., & Schneider, B. L. (2002). Trust in schools: A core resource for improvement. Russell Sage Foundation Publications. Bryk, A. S., & Schneider, B. L. (2002). Trust in schools: A core resource for improvement. Russell Sage Foundation Publications.
go back to reference Bryk, A. S., & Schneider, B. (2003). Trust in schools: A core resource for school reform. Educational Leadership, 60, 40–45. Retrieved from http://www.ascd.org. Bryk, A. S., & Schneider, B. (2003). Trust in schools: A core resource for school reform. Educational Leadership, 60, 40–45. Retrieved from http://​www.​ascd.​org.
go back to reference Century, J., Rudnick, M., & Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31, 199. doi:10.1177/1098214010366173.CrossRef Century, J., Rudnick, M., & Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31, 199. doi:10.​1177/​1098214010366173​.CrossRef
go back to reference Dariotis, J. K., Bumbarger, B. K., Duncan, L. G., & Greenberg, M. T. (2008). How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors. Journal of Community Psychology, 36, 744–760. doi:10.1002/jcop.20255.CrossRef Dariotis, J. K., Bumbarger, B. K., Duncan, L. G., & Greenberg, M. T. (2008). How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors. Journal of Community Psychology, 36, 744–760. doi:10.​1002/​jcop.​20255.CrossRef
go back to reference Desimone, L. M., Payne, B., Fedoravicius, N., Henrich, C. C., & Finn-Stevenson, M. (2004). Comprehensive school reform: An implementation study of preschool programs in elementary schools. The Elementary School Journal, 104, 369–389. doi:10.1086/499758.CrossRef Desimone, L. M., Payne, B., Fedoravicius, N., Henrich, C. C., & Finn-Stevenson, M. (2004). Comprehensive school reform: An implementation study of preschool programs in elementary schools. The Elementary School Journal, 104, 369–389. doi:10.​1086/​499758.CrossRef
go back to reference Downer, J. T., LoCasale-Crouch, J., Hamre, B. K., & Pianta, R. C. (2009). Teacher characteristics associated with responsiveness and exposure to consultation and online professional development resources. Early Education and Development, 20, 431–455. doi:10.1080/10409280802688626.CrossRef Downer, J. T., LoCasale-Crouch, J., Hamre, B. K., & Pianta, R. C. (2009). Teacher characteristics associated with responsiveness and exposure to consultation and online professional development resources. Early Education and Development, 20, 431–455. doi:10.​1080/​1040928080268862​6.CrossRef
go back to reference Durlak, J. A. (2010). The importance of doing well in whatever you do: A commentary on the special section, “Implementation research in early childhood education.” Early Childhood Research Quarterly, 25, 348–357. doi:10.1016/j.ecresq.2010.03.003. Durlak, J. A. (2010). The importance of doing well in whatever you do: A commentary on the special section, “Implementation research in early childhood education.” Early Childhood Research Quarterly, 25, 348–357. doi:10.​1016/​j.​ecresq.​2010.​03.​003.
go back to reference Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0.PubMedCrossRef Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.​1007/​s10464-008-9165-0.PubMedCrossRef
go back to reference Dusenbury, L., Hansen, W. B., Jackson-Newsom, J., Pittman, D. S., Wilson, C. V., Nelson-Simley, K., . . . Giles, S. M. (2010). Coaching to enhance quality of implementation in prevention. Health Education, 110, 43–60. doi:10.1108/09654281011008744 DOI:dx.doi.org Dusenbury, L., Hansen, W. B., Jackson-Newsom, J., Pittman, D. S., Wilson, C. V., Nelson-Simley, K., . . . Giles, S. M. (2010). Coaching to enhance quality of implementation in prevention. Health Education, 110, 43–60. doi:10.​1108/​0965428101100874​4 DOI:dx.doi.org
go back to reference Elmore, R. F., & McLaughlin, M. (1988). Steady work: Policy, practice, and the reform of American education. Santa Monica, CA: RAND Corp. Elmore, R. F., & McLaughlin, M. (1988). Steady work: Policy, practice, and the reform of American education. Santa Monica, CA: RAND Corp.
go back to reference Evans, R. (2001). The human side of school change: Reform, resistance, and the real-life problems of innovations. San Francisco: Jossey-Bass. Evans, R. (2001). The human side of school change: Reform, resistance, and the real-life problems of innovations. San Francisco: Jossey-Bass.
go back to reference Fixsen, D. L., Blase, K. A., Horner, R., & Sugai, G. (2009). Scaling-up brief: Intensive technical assistance state implementation & scaling-up of evidence-based practices. Frank Porter Graham Child Development Institute, The University of North Carolina at Chapel Hill. Fixsen, D. L., Blase, K. A., Horner, R., & Sugai, G. (2009). Scaling-up brief: Intensive technical assistance state implementation & scaling-up of evidence-based practices. Frank Porter Graham Child Development Institute, The University of North Carolina at Chapel Hill.
go back to reference Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research, and practice (Vol. 3). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration. Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research, and practice (Vol. 3). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.
go back to reference Grierson, A., & Gallagher, T. (2009). Seeing is believing: Creating a catalyst for teacher change through a demonstration classroom professional development initiative. Professional Development in Education, 35, 567–584. doi:10.1080/19415250902930726.CrossRef Grierson, A., & Gallagher, T. (2009). Seeing is believing: Creating a catalyst for teacher change through a demonstration classroom professional development initiative. Professional Development in Education, 35, 567–584. doi:10.​1080/​1941525090293072​6.CrossRef
go back to reference Joyce, B. R., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision & Curriculum Development. Joyce, B. R., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision & Curriculum Development.
go back to reference Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33, 279–299. doi:10.1177/0888406410371643.CrossRef Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33, 279–299. doi:10.​1177/​0888406410371643​.CrossRef
go back to reference Landry, S. H., Anthony, J. L., Swank, P. R., & Monseque-Bailey, P. (2009). Effectiveness of comprehensive professional development for teachers of at-risk preschoolers. Journal of Educational Psychology, 101, 448–465. doi:10.1037/a0013842.CrossRef Landry, S. H., Anthony, J. L., Swank, P. R., & Monseque-Bailey, P. (2009). Effectiveness of comprehensive professional development for teachers of at-risk preschoolers. Journal of Educational Psychology, 101, 448–465. doi:10.​1037/​a0013842.CrossRef
go back to reference Leithwood, K., & Jantzi, D. (2005). Transformational leadership. In B. Davies (Ed.), The essentials of school leadership (pp. 31–43). London, UK: Chapman Educational Publishing. Leithwood, K., & Jantzi, D. (2005). Transformational leadership. In B. Davies (Ed.), The essentials of school leadership (pp. 31–43). London, UK: Chapman Educational Publishing.
go back to reference Lillehoj, C. J., Griffin, K. W., & Spoth, R. (2004). Program provider and observer ratings of school-based prevention intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31, 242–257. doi:10.1177/1090198103260514.CrossRef Lillehoj, C. J., Griffin, K. W., & Spoth, R. (2004). Program provider and observer ratings of school-based prevention intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31, 242–257. doi:10.​1177/​1090198103260514​.CrossRef
go back to reference Mancini, A. D., Moser, L. L., Whitlet, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60, 189–195. doi:10.1176/appi.ps.60.2.189.PubMedCrossRef Mancini, A. D., Moser, L. L., Whitlet, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., & Burns, B. J. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60, 189–195. doi:10.​1176/​appi.​ps.​60.​2.​189.PubMedCrossRef
go back to reference Marshall, C., & Rossman, G. B. (1999). Designing qualitative research (3rd ed.). Thousand Oaks, CA: Sage. Marshall, C., & Rossman, G. B. (1999). Designing qualitative research (3rd ed.). Thousand Oaks, CA: Sage.
go back to reference Marshall, J. C., & Caldwell, S. D. (2007). Caring School CommunityTM implementation study: Four year evaluation report: Marshall Consulting and International Learning Services. Marshall, J. C., & Caldwell, S. D. (2007). Caring School CommunityTM implementation study: Four year evaluation report: Marshall Consulting and International Learning Services.
go back to reference Mashburn, A. J., Hamre, B. K., Downer, J. T., & Pianta, R. C. (2006). Teacher and classroom characteristics associated with teachers’ ratings of prekindergarteners’ relationships and behaviors. Journal of Psychoeducational Assessment, 24, 367–380. doi:10.1177/0734282906290594.CrossRef Mashburn, A. J., Hamre, B. K., Downer, J. T., & Pianta, R. C. (2006). Teacher and classroom characteristics associated with teachers’ ratings of prekindergarteners’ relationships and behaviors. Journal of Psychoeducational Assessment, 24, 367–380. doi:10.​1177/​0734282906290594​.CrossRef
go back to reference McCormick, K. M., & Brennan, S. (2001). Mentoring the new professional in interdisciplinary early childhood education: The Kentucky Teacher Internship Program. Topics in Early Childhood Special Education, 21, 131–150. doi:10.1177/027112140102100301.CrossRef McCormick, K. M., & Brennan, S. (2001). Mentoring the new professional in interdisciplinary early childhood education: The Kentucky Teacher Internship Program. Topics in Early Childhood Special Education, 21, 131–150. doi:10.​1177/​0271121401021003​01.CrossRef
go back to reference Metz, A. J. R. (2007). A 10-step guide to adopting and sustaining evidence-based practices in out-of-school time programs. Research to results practice brief. Washington, DC: Child Trends. Metz, A. J. R. (2007). A 10-step guide to adopting and sustaining evidence-based practices in out-of-school time programs. Research to results practice brief. Washington, DC: Child Trends.
go back to reference Miles, M. B., & Huberman, A. M. (1994). An expanded sourcebook: Qualitative data analysis (2nd ed.). Thousand Oaks, DC: Sage. Miles, M. B., & Huberman, A. M. (1994). An expanded sourcebook: Qualitative data analysis (2nd ed.). Thousand Oaks, DC: Sage.
go back to reference Muthén, B., & Muthén, L. K. (2010). Mplus (Version 6.1). Los Angeles, CA: Author. Muthén, B., & Muthén, L. K. (2010). Mplus (Version 6.1). Los Angeles, CA: Author.
go back to reference Northeast Foundation for Children (NEFC). (2003). The responsive classroom level 1 workbook. Greenfield, AR: Author. Northeast Foundation for Children (NEFC). (2003). The responsive classroom level 1 workbook. Greenfield, AR: Author.
go back to reference O'Donnell, C. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research. Review of Educational Research, 78, 33. O'Donnell, C. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research. Review of Educational Research, 78, 33.
go back to reference Ottmar, E., Rimm-Kaufman, S. E., & Berry, R. Q. (2012). Results from a randomized controlled trial: Does the Responsive Classroom approach impact the use of standards-based methematics teaching practices? Manuscript under review. Ottmar, E., Rimm-Kaufman, S. E., & Berry, R. Q. (2012). Results from a randomized controlled trial: Does the Responsive Classroom approach impact the use of standards-based methematics teaching practices? Manuscript under review.
go back to reference Powell, D. R., Diamond, K. E., & Koehler, M. J. (2012). Use of a case-based hypermedia resource in an early literacy coaching intervention with pre-kindergarten teachers Topics in Early Childhood Special Education. doi:10.1177/0271121409353610 Powell, D. R., Diamond, K. E., & Koehler, M. J. (2012). Use of a case-based hypermedia resource in an early literacy coaching intervention with pre-kindergarten teachers Topics in Early Childhood Special Education. doi:10.​1177/​0271121409353610​
go back to reference Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532. Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., & Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38, 510–532.
go back to reference Richardson, V., & Placier, P. (2001). Teacher change. In V. Richardson (Ed.), Handbook on research on teaching (4th ed., pp. 905–947). Washington, DC: AERA. Richardson, V., & Placier, P. (2001). Teacher change. In V. Richardson (Ed.), Handbook on research on teaching (4th ed., pp. 905–947). Washington, DC: AERA.
go back to reference Rimm-Kaufman, S. E., & Sawyer, B. (2004). Primary-grade teachers’ self-efficacy beliefs, Attitudes toward teaching, and discipline and teaching practice priorities in relation to the RC® approach. The Elementary School Journal, 104, 321–341. doi:10.1086/499756.CrossRef Rimm-Kaufman, S. E., & Sawyer, B. (2004). Primary-grade teachers’ self-efficacy beliefs, Attitudes toward teaching, and discipline and teaching practice priorities in relation to the RC® approach. The Elementary School Journal, 104, 321–341. doi:10.​1086/​499756.CrossRef
go back to reference Rimm-Kaufman, S. E., Fan, X., Chiu, Y., & You, W. (2007). The contribution of the RC® approach on children’s academic achievement: Results from a three year longitudinal study. Journal of School Psychology, 45, 401–421. doi:10.1016/j.jsp.2006.10.003.CrossRef Rimm-Kaufman, S. E., Fan, X., Chiu, Y., & You, W. (2007). The contribution of the RC® approach on children’s academic achievement: Results from a three year longitudinal study. Journal of School Psychology, 45, 401–421. doi:10.​1016/​j.​jsp.​2006.​10.​003.CrossRef
go back to reference Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30, 375–391. doi:10.1177/1090198103030003010.CrossRef Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30, 375–391. doi:10.​1177/​1090198103030003​010.CrossRef
go back to reference Rogers, E. M. (2003). Diffusion of innovations. New York: The Free Press. Rogers, E. M. (2003). Diffusion of innovations. New York: The Free Press.
go back to reference Schein, E. H. (2004). Organizational culture and leadership. San Francisco, DC: Jossey-Bass. Schein, E. H. (2004). Organizational culture and leadership. San Francisco, DC: Jossey-Bass.
go back to reference Wallace, F., Blase, K., Fixsen, D., & Naoom, S. (2008). Implementing the findings of research: Bridging the gap between knowledge and practice. Alexandria, VA: Educational Research Service. Wallace, F., Blase, K., Fixsen, D., & Naoom, S. (2008). Implementing the findings of research: Bridging the gap between knowledge and practice. Alexandria, VA: Educational Research Service.
go back to reference Webb, E. J., Campbell, D. T., Schwartz, R. D., & Sechrest, L. (1966). Unobtrusive measures: Nonreactive measures in the social sciences. Chicago, IL: Rand McNally. Webb, E. J., Campbell, D. T., Schwartz, R. D., & Sechrest, L. (1966). Unobtrusive measures: Nonreactive measures in the social sciences. Chicago, IL: Rand McNally.
go back to reference Zvoch, K. (2009). Treatment fidelity in multisite evaluation: A multilevel longitudinal examination of provider adherence status and change. American Journal of Evaluation, 30, 44–61. doi:10.1177/1098214008329523.CrossRef Zvoch, K. (2009). Treatment fidelity in multisite evaluation: A multilevel longitudinal examination of provider adherence status and change. American Journal of Evaluation, 30, 44–61. doi:10.​1177/​1098214008329523​.CrossRef
Metadata
Title
Setting-Level Influences on Implementation of the Responsive Classroom Approach
Authors
Shannon B. Wanless
Christine L. Patton
Sara E. Rimm-Kaufman
Nancy L. Deutsch
Publication date
01-02-2013
Publisher
Springer US
Published in
Prevention Science / Issue 1/2013
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-012-0294-1

Other articles of this Issue 1/2013

Prevention Science 1/2013 Go to the issue