Abstract
The current study represents a preliminary examination of school-level beliefs and attitudes as they relate to the implementation of universal evidence-based practices (EBPs) within a multi-tiered system of support (MTSS) targeting student’s social, emotional, and behavioral problems. This study was organized around three primary objectives: (a) assess coaches’ perceptions of the utility and importance of targeting educator beliefs to improve adoption and use of EBPs, (b) demonstrate the association between educator beliefs and degree of MTSS implementation, and (c) conduct a preliminary pre–posttest of a supportive belief intervention (SBI) to enhance educators’ beliefs and examine whether changes in beliefs were associated with improved implementation. To accomplish these objectives, data were collected from 62 elementary schools across five school districts involved in a collaborative consultative partnership to design and implement a school-wide MTSS framework. Collectively, the results provided preliminary support for the importance of beliefs: (a) coaches reported beliefs were critical to implementation and facilitative of their roles working with teachers, (b) educator beliefs predicted initial implementation fidelity on a global measure of MTSS practices and specific measure of school-wide positive behavior interventions and supports, and (c) the SBI was associated with significant changes in educator beliefs and these changes were associated with improved implementation. The implications, limitations, and future directions of this research are discussed.
Similar content being viewed by others
References
Aarons, G. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57(8), 1162–1169.
Aarons, G. A., Erhart, M. G., & Farahnak, L. R. (2014). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 45.
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23.
Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health & Mental Health Services Research, 34, 411–419.
Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301.
Ajzen, I., & Manstead, A. S. R. (2007). Changing health-related behaviors: An approach based on the theory of planned behavior. In K. van den Bos, M. Hewstone, J. de Wit, H. Schut, & M. Stroebe (Eds.), The scope of social psychology: Theory and applications (pp. 43–63). New York: Psychology Press.
Aronson, E. (1999). The power of self-persuasion. American Psychologist, 54, 875–884.
Atkins, M. S., Frazier, S. L., Leathers, S. J., Graczyk, P. A., Talbott, E., Jakobsons, L., … & Bell, C. C. (2008). Teacher key opinion leaders and mental health consultation in low-income urban schools. Journal of Consulting and Clinical Psychology, 76, 905–908.
Beesdo-Baum, K., & Knappe, S. (2012). Developmental epidemiology of anxiety disorders. Child and Adolescent Psychiatric Clinics of North America, 21(3), 457–478.
Bowden, R. G., Lanning, B. A., Pippin, G., & Tanner, Jr., J. (2003). Teachers’ attitudes towards abstinence-only sex education curricula. Education, 123(4), 780–788.
Brackett, M. A., Rivers, S. E., Reyes, M. R., & Salovey, P. (2012). Enhancing academic performance and social and emotional competence with the RULER feeling words curriculum. Learning and Individual Differences, 22(2), 218–224.
Bradshaw, C. P., Pas, E. T., Bloom, J., Barrett, S., Hershfeldt, P., Alexander, A., … & Leaf, P. J. (2012). A state-wide partnership to promote safe and supportive schools: The PBIS Maryland initiative. Administration and Policy in Mental Health, 39(4), 225–237.
Browning-Wright, D. & Cook, C. R. (2008). Behavior and RTI: Integrating behavioral and academic support [PowerPoint Slides]. Retrieved from http://www.pent.ca.gov/pos/rti/behaviorandrti_wright-cook.pdf.
Cialdini, R. (2001). Harnessing the science of persuasion. Harvard Business Review, 79, 72–79.
Cialdini, R. (2009). Influence: Science and practice (5th ed.). Pearson: Boston.
Cook, C. R. (2013). Measuring implementation of a comprehensive, integrated MTSS framework targeting student behavior. Paper presented at the National Association of School Psychologists Annual Conference in Washington, DC.
Cook, C. R., Burns, M., Browning-Wright, D., & Gresham, F. M. (2010a). Transforming school psychology in the RTI era: A guide for administrators and school psychologists. Palm Beach: LRP Publications.
Cook, C. R., Mayer, G. R., Browning-White, D., Kraemer, B., Gale, B., & Wallace, M. D. (2012). Exploring the link between evidence-based quality of behavior intervention plans, treatment integrity and student outcomes under natural educational conditions. The Journal of Special Education, 46, 3–16.
Cook, C. R., Volpe, R. J., & Livanis, A. (2010b). Constructing a roadmap for future universal screening research beyond academics. Assessment for Effective Intervention, 35, 197–205.
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., & Angold, A. (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844.
Dart, E. H., Cook, C. R., Collins, T. A., Gresham, F. M., & Chenier, J. S. (2012). Test-driving interventions to increase treatment integrity and student outcomes. School Psychology Review, 41(4), 467–481.
Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47, 71–88.
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432.
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20(3), 308–313.
Eccles, M., Grimshaw, J., Walker, A., Johnston, M., & Pitts, N. (2005). Changing the behaviour of healthcare professionals: The use of theory in promoting the uptake of research findings. Journal of Clinical Epidemiology, 58, 107–112.
Eccles, R., Pedersen, A., Regberg, D., Tulento, H., Borum, P., & Stjarne, P. (2007). Efficacy and safety of topical combinations of ipratropium and xylometazoline for the treatment of symptoms of runny nose and nasal congestion associated with acute upper respiratory tract infection. American Journal of Rhinolology, 21(1), 40–45.
Elias, M. J., Zins, J. E., Weissberg, R. P., Frey, K. S., Greenberg, M. T., Haynes, N. M., … & Shriver, T. P. (1997). Promoting social and emotional learning: Guidelines for educators. Alexandria, VA: Association for Supervision and Curriculum Development.
Feifer, C., Ornstein, S. M., Jenkins, R. G., Wessell, A. M., Corley, S. T., Nemeth, L. S., … & Liszka, H. (2006). The logic behind a multi-method intervention to improve adherence to clinical practice guidelines in a nationwide network of primary care practices. Evaluation and the Health Professions. 29(1), 65–88.
Fishbein, M., & Ajzen, I. (1975). Belief, attitude, intention, and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley.
Fishbein, M., Triandis, H. C., Kanfer, F. H., Becker, M., Middlestadt, S. E., & Eichler, A. (2001). Factors influencing behavior and behavior change. In A. Baum, T. A. Revenson, & J. E. Singer (Eds.), Handbook of health psychology. Mahwah, New Jersey: Lawrence Erlbaum Associates.
Fixsen, D. L., & Blase, K. A. (1993). Creating new realities: Program development and dissemination. Journal of Applied Behavior Analysis, 26, 597–615.
Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531–540.
Forman, S. G., Fagley, N. S., Chu, B. C., & Walkup, J. T. (2012). Factors influencing school psychologists’ willingness to implement interventions. School Mental Health, 4, 207–218.
Forman, S. G., Shapiro, E. S., Codding, R. S., Gonzales, J. E., Reddy, L. A., Rosenfield, S. A., … & Stoiber, K. C. (2013). Implementation science and school psychology, 28(2), 77–100. doi:10.1037/spq0000019.
Gonzalez, J. E., Nelson, J. R., Gutkin, T. B., & Shwery, C. S. (2004). Teacher resistance to school-based consultation with school psychologists: A survey of teacher perceptions. Journal of Emotional and Behavioral Disorders, 12, 30–37.
Goodman, A., Joyce, R., & Smith, J. P. (2011). The long shadow cast by childhood physical and mental problems on adult life. Proceedings of the National Academy of Sciences, 108, 6032–6037.
Guskey, T. R. (1986). Staff developmental and the process of teacher change. Educational Researcher, 15(5), 5–12.
Haney, J. J., Czerniak, C. M., & Lumpe, A. T. (1996). Teacher beliefs and intentions regarding the implementation of science education reform strands. Journal of Research in Science Teaching, 33, 971–993.
Haskins, R., & Loeb, S. (2007). A plan to improve the quality of teaching in American schools. Future of Children, 17(1), 1–8.
Horner, R. H., Todd, A. W., Lewis-Palmer, T., Irvin, L. K., Sugai, G., & Boland, J. B. (2004). The school-wide evaluation tool (SET): A research instrument for assessing school-wide positive behavior support. Journal of Positive Behavior Interventions, 6(1), 3–12.
Joyce, B., & Showers, B. (2002). Student achievement through staff development (3rd ed.). Alexandria, VA: Association for Supervision and Curriculum Development.
Kincaid, D., Childs, K., Blase, K. A., & Wallace, F. (2007). Identifying barriers and facilitators in implementing school-wide positive behavior support. Journal of Positive Behavior Interventions, 9, 174–184.
Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33, 279–299.
Lyon, A. R., Stirman, S. W., Kerns, S. E. U., & Bruns, E. J. (2011). Developing the mental health workforce: Review and application of training strategies from multiple disciplines. Administration and Policy in Mental Health and Mental Health Services Research, 38, 238–253.
Maag, J. W. (2001). Management of surface behavior: A new look at an old approach. Counseling and Human Development, 33(9), 1–10.
Nelson, T. D., & Steele, R. F. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34, 319–330.
Nunnally, J. S., & Bernstein, I. H. (1994). Psychological theory (3rd ed.). New York: McGraw-Hillrobust.
Organ, D. W., Podsakoff, P. M., & MacKenzie, S. B. (2006). Foundations for organizational science: Organizational citizenship behavior: Its nature, antecedents, and consequences. Thousand Oaks, CA: SAGE.
Owens, D. K., Lohr, K. N., Atkins, D., Treadwell, J. R., Reston, J. T., Bass, E. B., … & Helfand, M. (2014). Grading the strength of a body of evidence when comparing medical interventions: AHRQ and the effective health care program. In Agency for Healthcare Research and Quality. Methods Guide for Comparative Effectiveness Reviews: Rockville, MD.
Pancucci, S. (2007). Train the trainer: The bricks in the learning community scaffold of professional development. International Journal of Humanities and Social Science, 2(1), 14–21.
Parcel, G. S., O’Hara-Tompkins, N. M., Harrist, R. B., & Basen-Engquist, K. M. (1995). Diffusion of an effective tobacco prevention program. Part II: Evaluation of the adoption phase. Center for Health Promotion Research and Development, 10(3), 297–307.
Penuel, W., Fishman, B., Yamaguchi, R., & Gallagher, L. (2007). What makes professional development effective? Strategies that foster curriculum implementation. American Educational Research Journal, 44(4), 921–958.
Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T, Bunger, A. C., … & York, J. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157.
Pratkanis, A. R. (2007). The science of social influence: Advances and future progress. New York: Psychology Press.
Slavin, R. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31(7), 15–21.
Sprague, J., Cook, C. R., Browning-Wright, D., & Sadler, C. (2008). Response to intervention for behavior: Integrating academic and behavior supports. Palm Beach: LRP Publications.
Strein, W., Hoagwood, K., & Cohn, A. (2003). School psychology: A public health perspective: Prevention, populations, and system change. Journal of School Psychology, 41, 23–38.
Sugai, G., Horner, R. H., Dunlap, G., Hieneman, M., Lewis, T. J., Nelson, C. M., … & Ruef, M. (2000). Applying positive behavior support and functional behavioral assessment in schools. Journal of Positive Behavior Interventions, 2(3), 131–143.
Sundle, J., Cialdini, R., Griskevicius, V., & Kenrick, D. (2012). The world’s (truly) oldest profession: Social influence in evolutionary perspective. Social Influence, 7, 134–153.
Trout, A. K., Nordness, P. D., Pierce, C. D., & Epstein, M. H. (2003). Research on the academic status of children with emotional and behavioral disorders: A review of the literature from 1961 to 2000. Journal of Emotional and Behavioral Disorders, 11(4), 198.
Acknowledgments
This publication was made possible in part by funding from Grant Number K08 MH095939, awarded by the National Institute of Mental Health (NIMH) to the second author. Dr. Lyon is an investigator with the Implementation Research Institute (IRI), at the George Warren Brown School of Social Work, Washington University in St. Louis, through an award from the National Institute of Mental Health (R25 MH080916) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cook, C.R., Lyon, A.R., Kubergovic, D. et al. A Supportive Beliefs Intervention to Facilitate the Implementation of Evidence-Based Practices Within a Multi-Tiered System of Supports. School Mental Health 7, 49–60 (2015). https://doi.org/10.1007/s12310-014-9139-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12310-014-9139-3