Top

Published in:

Open Access 01-04-2018

Implementing Intervention Research into Public Policy—the “I³-Approach”

Authors: Christiane Spiel, Barbara Schober, Dagmar Strohmeier

Published in: Prevention Science | Issue 3/2018

Abstract

Evidence-based intervention programs have become highly important in recent years, especially in educational contexts. However, transferring these programs into practice and into the wider field of public policy often fails. As a consequence, the field of implementation research has emerged, several implementation frameworks have been developed, and implementation studies conducted. However, intervention research and implementation research have not yet been connected systematically and different traditions and research groups are involved. Implementation researchers are mostly given mandates by politicians to take on the implementation of already existing interventions. This might be one of the key reasons why there are still many problems in translating programs into widespread community practice. In this paper, we argue for a systematic integration of intervention and implementation research (“I³-Approach”) and recommend a six-step procedure (PASCIT). This requires researchers to design and develop intervention programs using a field-oriented and participative approach. In particular, the perspective of policymakers has to be included as well as an analysis of which factors support or hinder evidence-based policy in contrast to opinion-based policy. How this systematic connection between intervention and implementation research can be realized, is illustrated by means of the development and implementation of the ViSC school program, which intends to reduce aggressive behavior and bullying and to foster social and intercultural competencies.

Atria, M., & Spiel, C. (2003). The Austrian situation: Many initiatives, few evaluations. In P. Smith (Ed.), Violence in Schools: The Response in Europe (pp. 83–99). London: RoutledgeFalmer.

Atria, M., & Spiel, C. (2007). Viennese Social Competence (ViSC) Training for Students: Program and evaluation. In J. E. Zins, M. J. Elias, & C. A. Maher (Eds.), Bullying, Victimization, and Peer Harassment. A Handbook of Prevention and Intervention (pp. 179–197). New York: Haworth Press.

Beelmann, A., & Karing, C. (2014). Implementationsfaktoren und -prozesse in der Präventionsforschung: Strategien, Probleme, Ergebnisse, Perspektiven [Implementation factors and processes in prevention research: Strategies, problems, findings, prospects]. Psychologische Rundschau, 65, 129–139. doi:10.1026/0033-3042/a000215.CrossRef

Craig, W., & Harel, Y. (2004). Bullying, physical fighting and victimization. In C. Currie (Ed.), Health behaviour in school-aged children: A WHO cross national study (pp. 133–144). Geneva: World Health Organization.

Datnow, A. (2002). Can we transplant educational reform, and does it last? Journal of Educational Change, 3, 215–239. doi:10.1023/A.1021221627854.CrossRef

Datnow, A. (2005). The sustainability of comprehensive school reform models in changing district and state contexts. Educational Administration Quarterly, 41, 121–153. doi:10.1177/0013161X04269578.CrossRef

Davies, P. (2004). Is Evidence-Based Government Possible? Jerry Lee Lecture 2004. Paper presented at the 4th Annual Campbell Collaboration Colloquium, Washington, DC.

Davies, P. (2012). The State of Evidence-Based Policy Evaluation and its Role in Policy Formation. National Institute Economic Review, 219, 41–52. doi:10.1177/002795011221900105.CrossRef

Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1, 1. doi:10.1186/1748-5908-1-1.CrossRefPubMedCentral

Ferguson, C. J., San Miguel, C., Kilburn, J. C., & Sanchez, P. (2007). The effectiveness of school-based anti-bullying programs. Criminal Justice Review, 32, 401–414.CrossRef

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network (FMHI Publication No. 231). Retrieved from http://nirn.fpg.unc.edu/resources/implementation-research-synthesis-literature

Fixsen, D. L., Blase, K. A., Naoom, S. F., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531. doi:10.1177/1049731509335549.CrossRef

Fixsen, D. L., Blase, K., & Van Dyke, M. (2011). Mobilizing communities for implementing evidence-based youth violence prevention programming: A Commentary. American Journal of Community Psychology (Special Issue), 48, 133–137.CrossRef

Fixsen, D. L., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children (Special Issue), 79, 213–230.CrossRef

Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., . . . Ji, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175.

Forman, S. G., Shapiro, E. S., Codding, R. S., Gonzales, J. E., Reddy, L. A., Rosenfield, . . . Stoiber, K. C. (2013). Implementation Science and School Psychology. School Psychology Quarterly, 28, 77–100. doi:10.1037/spq0000019

Fox, B. H., Farrington, D. P., & Ttofi, M. M. (2012). Successful bullying prevention programs: Influence of research design, implementation features, and program components. International Journal of Conflict and Violence, 6, 273–282.

Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi:10.2105/AJPH.89.9.1322.CrossRefPubMedPubMedCentral

Gollwitzer, M., Eisenbach, K., Atria, M., Strohmeier, D., & Banse, R. (2006). Evaluation of Aggression-Reducing Effects of the “Viennese Social Competence Training.”. Swiss Journal of Psychology, 65, 125–135.CrossRef

Gollwitzer, M., Banse, R., Eisenbach, K., & Naumann, A. (2007). Effectiveness of the Vienna Social Competence Training on Explicit and Implicit Aggression. European Journal of Psychological Assessment, 23, 150–156.CrossRef

Gradinger, P., Yanagida, T., Strohmeier, D., & Spiel, C. (2014). Prevention of Cyberbullying and Cybervictimization: Evaluation of the ViSC Social Competence Program. Journal of School Violence, 14, 87–110. doi:10.1080/15388220.2014.963231.CrossRef

Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82, 581–629. doi:10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral

Kennedy, M. M. (1997). The connection between research and practice. Educational Researcher, 26, 4–12. doi:10.3102/0013189X026007004.CrossRef

Kratochwill, T. R., & Shernoff, E. S. (2003). Evidence-based practice: Promoting evidence-based interventions in school psychology. School Psychology Quarterly, 18, 389–408.CrossRef

Meyers, D. C., Durlak, J. A., & Wandersmann, A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50, 462–480. doi:10.1007/s10464-012-9522-x.CrossRefPubMed

Nutley, S. M., Walter, I., & Davies, H. T. O. (2007). Using evidence. How research can inform public service. Bristol: The Policy Press.CrossRef

Ogden, T., & Fixsen, D. L. (2014). Implementation Science: A brief overview and a look ahead. Zeitschrift für Psychologie, 222, 4–11. doi:10.1027/2151-2604/a000160.CrossRef

Olweus, D. (2004). The Olweus Bullying Prevention Programme: Design and implementation issues and a new national initiative in Norway. In P. K. Smith, D. J. Pepler, & K. Rigby (Eds.), Bullying in Schools: How Successful Can Interventions Be? (pp. 13–36). Cambridge: Cambridge University Press.CrossRef

Petrosino, A., Boruch, R. F., Soydan, H., Duggan, L., & Sanchez-Meca, J. (2001). Meeting the challenges of evidence-based policy: The Campbell Collaboration. Annuals of the American Academy of Political and Social Science, 578, 14–34.CrossRef

Roland, E. (2000). Bullying in schools: Three national innovations in Norwegian schools in 15 years. Aggressive Behavior, 26, 135–143.CrossRef

Rossi, P. H., & Wright, J. D. (1984). Evaluation research: An assessment. Annual Review of Sociology, 10, 331–352.CrossRef

Salmivalli, C., Poskiparta, E., Ahtola, A., & Haataja, A. (2013). The implementation and effectiveness of the KiVa Antibullying Program in Finland. European Psychologist, 18, 79–88. doi:10.1027/1016-9040/a000140.CrossRef

Schultes, M.-T., Strohmeier, D., Burger, C., & Spiel, C. (2011). Fostering evidence-based prevention in schools through self-evaluation: The Austrian Violence Evaluation Online-Tool (AVEO). Poster presented at the Evidence-Based Prevention of Bullying and Youth Violence Conference in Cambridge, Great Britain.

Schultes, M.-T., Stefanek, E., van de Schoot, R., Strohmeier, D., & Spiel, C. (2014). Measuring implementation of a school-based violence prevention program: Fidelity and teachers’ responsiveness as predictors of proximal outcomes. Zeitschrift für Psychologie, 222, 49–57. doi:10.1027/2151-2604/a000165.CrossRef

Shonkoff, J. P. (2000). Science, policy, and practice: Three cultures in search of a shared mission. Child Development, 71, 181–187. doi:10.1111/1467-8624.00132.CrossRefPubMed

Slavin, R. E. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31, 15–21.CrossRef

Slavin, R. E. (2008). Evidence-based reform in education: Which evidence counts? Educational Researcher, 37, 47–50.CrossRef

Smith, P. K., Pepler, D., & Rigby, K. (2004). Bullying in schools: How successful can interventions be? Cambridge: Cambridge University Press.CrossRef

Spiel, C. (2009a). Evidence-based practice: A challenge for European developmental psychology. European Journal of Developmental Psychology, 6, 11–33.CrossRef

Spiel, C. (2009b). Evidenzbasierte Bildungspolitik und Bildungspraxis – eine Fiktion? Problemaufriss, Thesen, Anregungen [Evidence-based education policy and educational practice – a fiction? Problem, theses, suggestions]. Psychologische Rundschau, 60, 255–256.CrossRef

Spiel, C., & Strohmeier, D. (2011). National strategy for violence prevention in the Austrian public school system: Development and implementation. International Journal of Behavioral Development, 35, 412–418. doi:10.1177/0165025411407458.CrossRef

Spiel, C., & Strohmeier, D. (2012). Evidence-based practice and policy: When researchers, policy makers, and practitioners learn how to work together. European Journal of Developmental Psychology, 9, 150–162.CrossRef

Spiel, C., Lösel, F., & Wittmann, W. W. (2009). Transfer psychologischer Erkenntnisse – eine notwendige, jedoch schwierige Aufgabe [Transfer psychological findings – a necessary but difficult task]. Psychologische Rundschau, 60, 257–258.CrossRef

Spiel, C., Salmivalli, C., & Smith, P. K. (2011a). Translational research: National strategies for violence prevention in school. International Journal of Behavioral Development, 35, 381–382. doi:10.1177/0165025411407556.CrossRef

Spiel, C., Schober, B., Strohmeier, D., & Finsterwald, M. (2011b). Cooperation among researchers, policy makers, administrators, and practitioners: Challenges and recommendations. ISSBD Bulletin 2011, 2, 11–14.

Spiel, C., Strohmeier, D., Schultes, M.-T., & Burger, C. (2011c). Nachhaltigkeit von Gewaltprävention in Schulen: Erstellung und Erprobung eines Selbstevaluations-instruments [Sustainable violence prevention in schools: Development and evaluation of a self-evaluation tool for schools]. Vienna: University of Vienna.

Spiel, C., Wagner, P., & Strohmeier, D. (2012). Violence prevention in Austrian schools: Implementation and evaluation of a national strategy. International Journal of Conflict and Violence, 6, 176–186.

Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., . . . Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The Translation Science to Population Impact (TSci Impact) Framework. Prevention Science, 14, 319–351. doi:10.1007/s11121-012-0362-6

Stokes, D. E. (1997). Pasteur’s quadrant. Basic science and technological innovation. Washington, DC: Brookings Institution Press.

Strohmeier, D., Hoffmann, C., Schiller, E.-M., Stefanek, E., & Spiel, C. (2012). ViSC Social Competence Program. New Directions for Youth Development, 133, 71–80. doi:10.1002/yd.20008.CrossRef

Ttofi, M. M., & Farrington, D. P. (2009). What works in preventing bullying: Effective elements of anti-bullying programmes. Journal of Aggression, Conflict and Peace Research, 1, 13–24.CrossRef

Ttofi, M. M., & Farrington, D. P. (2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27–56. doi:10.1007/s11292-010-9109-1.CrossRef

Title: Implementing Intervention Research into Public Policy—the “I3-Approach”
Authors: Christiane Spiel
Barbara Schober
Dagmar Strohmeier
Publication date: 01-04-2018
Publisher: Springer US
Published in: Prevention Science / Issue 3/2018
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI: https://doi.org/10.1007/s11121-016-0638-3

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Implementing Intervention Research into Public Policy—the “I³-Approach”

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 3/2018

Can We Trust Positive Findings of Intervention Research? The Role of Conflict of Interest

The Ultimate Goal of Prevention and the Larger Context for Translation

Innovation and Integrity: Desiderata and Future Directions for Prevention and Intervention Science

Transfer Entails Communication: The Public Understanding of (Social) Science as a Stage and a Play for Implementing Evidence-Based Prevention Knowledge and Programs

Knowing Every Child: Validation of the Holistic Student Assessment (HSA) as a Measure of Social-Emotional Development

Standards of Evidence for Conducting and Reporting Economic Evaluations in Prevention Science