Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Prevention Science
Published in: Prevention Science 3/2009

01-09-2009

Antibullying Programs in Schools: How Effective are Evaluation Practices?

Authors: Wendy Ryan, J. David Smith

Published in: Prevention Science | Issue 3/2009

Login to get access

Abstract

Bullying is a problem for schools around the world, and is an important topic for research because it has been associated with negative outcomes on numerous social, psychological, and academic measures. Antibullying prevention and intervention programs have varied greatly in their outcomes, with some studies reporting positive results while others have reported little or no positive impacts. Prompted by accountability demands, many agencies have developed standards with which to assess whether social programs are effective. Antibullying program evaluations have not been systematically reviewed to determine whether these types of standards are being applied. The purpose of this study was to assess the rigor of recent peer-reviewed antibullying program evaluations. Thirty-one peer-reviewed evaluations of antibullying programs, published within the last 10 years, were identified and coded for study characteristics. Shortcomings were identified in many of these program evaluations. In order to improve evaluation practices, researchers should consider using more rigorous designs to identify cause-effect relationships, including control conditions and random assignment, using more appropriate pre-post intervals, using more advanced methods of analyses such as hierarchical linear modeling, and systematically verifying program integrity to obtain dosage data that can be used in the outcome analyses.
Literature
Alsaker, F. D. (2004). Bernese programme against victimization in kindergarten and elementary school. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 289–306). New York: Cambridge University Press.
Alsaker, F. D., & Valkanover, S. (2001). Early diagnosis and prevention of victimization in kindergarten. In J. Juvonen & S. Graham (Eds.), Peer harassment in school: The plight of the vulnerable and victimized (pp. 175–195). New York: Guilford Press.
American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
Baldry, A. C., & Farrington, D. P. (2004). Evaluation of an intervention program for the reduction of bullying and victimization in schools. Aggressive Behavior, 30, 1–15. doi:10.​1002/​ab.​20000.CrossRef
Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
Chatterji, M. (2007). Grades of evidence: Variability in quality of findings in effectiveness studies of complex field interventions. The American Journal of Evaluation, 28, 239–255. doi:10.​1177/​1098214007304884​.CrossRef
Coie, J. D. (2004). The impact of negative social experiences on the development of antisocial behavior. In J. B. Kupersmidt & K. A. Dodge (Eds.), Children’s peer relations: From development to intervention (pp. 243–267). Washington, DC: American Psychological Association.
Cowie, H., & Olafsson, R. (2000). The role of peer support in helping the victims of bullying in a school with high levels of aggression. School Psychology International, 21, 79–95. doi:10.​1177/​0143034300211006​.CrossRef
Cross, D., Hall, M., Hamilton, G., Pintabona, Y., & Erceg, E. (2004). Australia: The Friendly Schools Project. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 187–210). New York: Cambridge University Press.
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151–175. doi:10.​1007/​s11121-005-5553-y.PubMedCrossRef
Frey, K. S., Hirschstein, M. K., Snell, J. L., Edstrom, L. V. S., MacKenzie, E. P., & Broderick, C. J. (2005). Reducing playground bullying and supporting beliefs: An experimental trial of the Steps to Respect program. Developmental Psychology, 41, 479–491. doi:10.​1037/​0012-1649.​41.​3.​479.PubMedCrossRef
Gollwitzer, M., Eisenbach, K., Atria, M., Strohmeier, D., & Banse, R. (2006). Evaluation of aggression-reducing effects of the “Viennese Social Competence Training.” Swiss Journal of Psychology, 65, 125–135. doi:10.​1024/​1421-0185.​65.​2.​125.CrossRef
Greenberg, M. T., Domitrovich, C. E., Graczyk, P. A., & Zins, J. E. (2005). The study of implementation in school-based preventive interventions: Theory, research, and practice (Vol. 3). Rockville, MD: Center for Mental Health Services, Substance Abuse and Mental Health Services Administration.
Hall, G. E., & Hord, S. M. (2006). Implementing change: Patterns, principles, and potholes (2nd ed.). New York: Pearson.
Heydenberk, R. A., Heydenberk, W. R., & Tzenova, V. (2006). Conflict resolution and bully prevention: Skills for school success. Conflict Resolution Quarterly, 24, 55–69. doi:10.​1002/​crq.​157.CrossRef
Jennifer, D., & Shaughnessy, J. (2005). Promoting non-violence in schools: The role of cultural, organisational and managerial factors. Educational and Child Psychology, 22, 58–66.
Kim, J. (2006). The effect of a bullying prevention program on responsibility and victimization of bullied children in Korea. International Journal of Reality Therapy, 26, 4–8.
Leadbeater, B., & Hoglund, W. (2006). Changing the social contexts of peer victimization. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 15, 21–26.PubMed
Leadbeater, B., Hoglund, W., & Wood, T. (2003). Changing contexts? The effects of a primary prevention program on classroom levels of peer relational and physical victimization. Journal of Community Psychology, 31, 397–418. doi:10.​1002/​jcop.​10057.CrossRef
Leff, S. S., Power, T. J., & Goldstein, A. B. (2004). Outcome measures to assess the effectiveness of bullying prevention programs in schools. In D. L. Espelage & S. M. Swearer (Eds.), Bullying in American schools: A social-ecological perspective on prevention and intervention (pp. 269–293). Mahwah, NJ: Lawrence Erlbaum.
Limber, S. P., & Small, M. A. (2003). State laws and policies to address bullying in schools. School Psychology Review, 32, 445–455.
Limber, S. P., Nation, M., Tracy, A. J., Melton, G. G., & Flerx, V. (2004). Implementation of the Olweus Bullying Prevention programme in the Southeastern United States. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 55–79). New York: Cambridge University Press.
McLaughlin, L., Laux, J. M., & Pescara-Kovach, L. (2006). Using multimedia to reduce bullying and victimization in third-grade urban schools. Professional School Counseling, 10, 153–160.
Menesini, E., Codecasa, E., Benelli, B., & Cowie, H. (2003). Enhancing children’s responsibility to take action against bullying: Evaluation of a befriending intervention in Italian middle schools. Aggressive Behavior, 29, 10–14.
Merrell, K. W., Gueldner, B. A., Ross, S. W., & Isava, D. M. (2008). How effective are school bullying intervention programs? A meta-analysis of intervention research. School Psychology Quarterly, 23, 26–42. doi:10.​1037/​1045-3830.​23.​1.​26.CrossRef
Meyer, N., & Lesch, E. (2000). An analysis of the limitations of a behavioural programme for bullying boys from a subeconomic environment. South African Journal of Child and Adolescent Mental Health, 12, 59–69.
Nansel, T. R., Overpeck, M., Pilla, R. S., Ruan, W. J., Simons-Marton, B., & Scheidt, P. (2001). Bullying behaviors among US youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association, 285, 2094–2100. doi:10.​1001/​jama.​285.​16.​2094.PubMedCrossRef
Newman-Carlson, D., & Horne, A. M. (2004). Bully Busters: A psychoeducational intervention for reducing bullying behavior in middle school students. Journal of Counseling and Development, 82, 259–267.
No Child Left Behind Act of 2001, P.L. 107-110, 115 Stat.1425 (2002).
Olweus, D. (1991). Bully/victim problems among school children: Basic facts and effects of a school-based intervention program. In D. Pepler & K. H. Rubin (Eds.), The development and treatment of childhood aggression (pp. 411–448). Hillsdale, NJ: Erlbaum.
Olweus, D. (1993). Bullying at school: What we know and what we can do. Malden, MA: Blackwell.
O’Moore, A. M., & Minton, S. J. (2004). Ireland: The Donegal Primary Schools’ anti-bullying project. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 275–287). New York: Cambridge University Press.
O’Moore, A. M., & Minton, S. J. (2005). Evaluation of the effectiveness of an anti-bullying programme in primary schools. Aggressive Behavior, 31, 609–622. doi:10.​1002/​ab.​20098.CrossRef
Orpinas, P., & Horne, A. M. (2006). Bullies: The problem and its impact. In P. Orpinas & A. M. Horne (Eds.), Bullying prevention: Creating a positive school climate and developing social competence (pp. 11–31). Washington, DC: American Psychological Association.CrossRef
Orpinas, P., Home, A. M., & Staniszewski, D. (2003). School bullying: Changing the problem by changing the school. School Psychology Review, 32, 431–444.
Ortega, R., Del Rey, R., & Mora-Merchan, J. A. (2004). SAVE model: An anti-bullying intervention in Spain. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 167–185). New York: Cambridge University Press.
Rahey, L., & Craig, W. M. (2002). Evaluation of an ecological program to reduce bullying in schools. Canadian Journal of Counselling, 36, 281–296.
Rosenbluth, B., Whitaker, D. J., Sanchez, E., & Valle, L. A. (2004). The Expect Respect project: Preventing bullying and sexual harassment in US elementary schools. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 211–233). New York: Cambridge University Press.
Salmivalli, C., Kaukiainen, A., Voeten, M., & Sinisammal, M. (2004). Targeting the group as a whole: The Finnish anti-bullying intervention. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 251–273). New York: Cambridge University Press.
Smith, P. K., Pepler, D., & Rigby, K. (Eds.) (2004). Bullying in schools: How successful can interventions be? New York: Cambridge University Press.
Smith, J. D., Schneider, B. H., Smith, P. K., & Ananiadou, K. (2004). The effectiveness of whole-school anti-bullying programs: A synthesis of evaluation research. School Psychology Review, 33, 548–561.
Stevens, V., Van Oost, P., & De Bourdeaudhuij, I. (2001). Implementation process of the Flemish antibullying intervention and relation with program effectiveness. Journal of School Psychology, 39, 303–317. doi:10.​1016/​S0022-4405(01)00073-5.CrossRef
Stevens, V., Van Oost, P., & De Bourdeaudhuij, I. (2004). Interventions against bullying in Flemish schools: Programme development and evaluation. In P. K. Smith, D. Pepler, & K. Rigby (Eds.), Bullying in schools: How successful can interventions be? (pp. 141–165). New York: Cambridge University Press.
Whitaker, D. J., Rosenbluth, B., Valle, L. A., & Sanchez, E. (2004). Expect Respect: A school-based intervention to promote awareness and effective responses to bullying and sexual harassment. In D. L. Espelage & S. M. Swearer (Eds.), Bullying in American schools: A social-ecological perspective on prevention and intervention (pp. 327–350). Mahwah, NJ: Erlbaum.
Metadata
Title
Antibullying Programs in Schools: How Effective are Evaluation Practices?
Authors
Wendy Ryan
J. David Smith
Publication date
01-09-2009
Publisher
Springer US
Published in
Prevention Science / Issue 3/2009
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-009-0128-y

Other articles of this Issue 3/2009

Prevention Science 3/2009 Go to the issue

OriginalPaper

Individual and Contextual Effects of School Adjustment on Adolescent Alcohol Use

OriginalPaper

Threats of Cross-Contamination on Effects of a Sexual Risk Reduction Intervention: Fact or Fiction

OriginalPaper

An Adaptive Approach to Family-Centered Intervention in Schools: Linking Intervention Engagement to Academic Outcomes in Middle and High School

OriginalPaper

Enhancing Coparenting, Parenting, and Child Self-Regulation: Effects of Family Foundations 1 Year after Birth

OriginalPaper

Integrated Gender-Based Violence and HIV Risk Reduction Intervention for South African Men: Results of a Quasi-Experimental Field Trial

OriginalPaper

Evaluating Mediators of the Impact of the Linking the Interests of Families and Teachers (LIFT) Multimodal Preventive Intervention on Substance Use Initiation and Growth Across Adolescence