Evaluation of the Olweus Bully Prevention Program in an Urban School System in the USA
This study evaluated the Olweus Bully Prevention Program (OBPP) in urban middle schools serving a mostly African American student population. Participants were 1791 students from three communities with high rates of crime and poverty. We evaluated the impact of the OBPP using a multiple-baseline experimental design in which we randomized the order and timing of intervention activities across three schools. We assessed the frequency of violence and victimization using self-report and teachers’ ratings of students collected every 3 months over 5 years. Initiation of the OBPP was associated with reductions in teachers’ ratings of students’ frequency of aggression, with effects emerging in different years of implementation for different forms of aggression. Whereas reductions in teachers’ ratings of students’ verbal and relational aggression and victimization were evident during the second implementation year, reductions in physical aggression did not appear until the third year. Effects were consistent across gender and schools, with variability across grades for relational and verbal aggression and victimization. In contrast, there were no intervention effects on students’ reports of their behavior. Positive outcomes for teachers’, but not students’ ratings, suggest the intervention’s effects may have been limited to the school context. Variation in when effects emerged across outcomes suggests that changes in physical aggression may require more sustained intervention efforts. The intervention was also associated with increases in teachers’ concerns about school safety problems, which may indicate that teachers were more attuned to recognizing problem behaviors following exposure to the OBPP.
KeywordsOlweus Bully Prevention Program Violence prevention School intervention Evaluation Aggression
The authors are grateful to John Ferron for his input on this project’s design and analysis, and to Anne Greene who served as project coordinator.
This study was funded by the National Center for Injury Prevention and Control, Centers for Disease Control and Prevention, CDC Cooperative Agreement 5U01CE001956. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.
Compliance with Ethical Standards
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants in the study.
Conflict of Interest
The authors declare that they have no conflict of interest.
- Crone, D. A., Hawken, L. S., & Horner, R. H. (2010). Responding to problem behavior in schools: The behavior education program (2nd ed.). New York: Guilford.Google Scholar
- Farrell, A. D., Mays, S., Bettencourt, A., Erwin, E. H., Vulin-Reynolds, M., & Allison, K. W. (2010). Environmental influences on fighting versus nonviolent behavior in peer situations: A qualitative study with urban African American adolescents. American Journal of Community Psychology, 46, 19–35. https://doi.org/10.1007/s10464-010-9331-z.CrossRefPubMedPubMedCentralGoogle Scholar
- Farrell, A. D., Sullivan, T. N., Goncy, E. A., & Le, A. T. H. (2016). Assessment of adolescents’ victimization, aggression, and problem behaviors: Evaluation of the Problem Behavior Frequency Scale. Psychological Assessment, 28, 702–714. https://doi.org/10.1037/pas0000225.CrossRefPubMedGoogle Scholar
- Farrell, A. D., Thompson, E. L., Sullivan, T. N., & Goncy, E. A. (2017). Assessment of adolescents’ victimization, aggression, and problem behaviors: Evaluation of the Problem Behavior Frequency Scale - Adolescent Report. Manuscript submitted for publication.Google Scholar
- Farrell, A. D., Goncy, E. A., Sullivan, T. N., & Thompson, E. L. (2018). Evaluation of the problem behavior frequency scale—teacher report form for assessing behavior in a sample of urban adolescents. Psychological Assessment. https://doi.org/10.1037/pas0000571.
- Goncy, L. A., Sutherland, K. S., Farrell, A. D., Sullivan, T. N., & Doyle, S. T. (2015). Measuring teacher implementation in delivery of a bullying prevention program: The impact of instructional and protocol adherence and competence on student responsiveness. Prevention Science, 16, 440–450. https://doi.org/10.1007/s11121-014-0508-9.CrossRefPubMedGoogle Scholar
- Matjasko, J. L., Vivolo-Kantor, A. M., Massetti, G. M., Holland, K. M., Holt, M. K., & Cruz, J. D. (2012). A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews. Aggression and Violent Behavior, 17, 540–552. https://doi.org/10.1016/j.dr.2011.10.001.CrossRefPubMedPubMedCentralGoogle Scholar
- Matjasko, J. L., Massetti, G. M., & Bacon, S. (2016). Implementing and evaluating comprehensive evidence-based approaches to prevent youth violence: Partnering to create communities where youth are safe from violence. Journal of Primary Prevention, 37, 109–119. https://doi.org/10.1007/s10935-016-0422-y.CrossRefPubMedPubMedCentralGoogle Scholar
- Melton, G. B., Limber, S. P., Cunningham, P., Osgood, D. W., Chambers, J., Flerx, V., et al. (1998). Violence among rural youth. Final report to the Office of Juvenile Justice and Delinquency Prevention. Washington, DC: Office of Juvenile Justice and Delinquency Prevention.Google Scholar
- Olweus, D., & Alsaker, F. D. (1991). Assessing change in a cohort longitudinal study with hierarchical data. In D. Magnusson, L. R. Bergman, G. Rudinger, & B. Torestad (Eds.), Problems and methods in longitudinal research (pp. 107–132). New York: Cambridge University Press. https://doi.org/10.1017/CBO9780511663260.008.CrossRefGoogle Scholar
- Schroeder, B. A., Messina, A., Schroeder, D., Good, K., Barto, S., Saylor, J., & Masiello, M. (2012). The implementation of a statewide bullying prevention program: Preliminary findings from the field and the importance of coalitions. Health Promotion Practice, 13, 489–495. https://doi.org/10.1177/1524839910386887.CrossRefPubMedGoogle Scholar
- Sullivan, T. N., Sutherland, K. S., Farrell, A. D., & Taylor, K. A. (2016). School as venues for prevention programming. In K. Bosworth (Ed.), Prevention science in school settings: Complex relationships and processes (pp. 201–226). Springer: New York.Google Scholar
- Zimmerman, M. A., Stewart, S. E., Morrel-Samuels, S., Franzen, S., & Reischl, T. M. (2011). Youth empowerment solutions for peaceful communities: Combining theory and practice in a community-level violence prevention curriculum. Health Promotion Practice, 12, 425–439. https://doi.org/10.1177/1524839909357316.CrossRefPubMedGoogle Scholar