Skip to main content

Advertisement

SpringerLink
Log in

Examining Contextual Influences on Classroom-Based Implementation of Positive Behavior Support Strategies: Findings from a Randomized Controlled Effectiveness Trial

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

Although it is widely recognized that variation in implementation fidelity influences the impact of preventive interventions, little is known about how specific contextual factors may affect the implementation of social and behavioral interventions in classrooms. Theoretical research highlights the importance of multiple contextual influences on implementation, including factors at the classroom and school level (Domitrovich et al., Advances in School Mental Health Promotion, 1, 6–28, 2008). The current study used multi-level modeling to empirically examine the influence of teacher, classroom, and school characteristics on the implementation of classroom-based positive behavior support strategies over the course of 4 years. Data were collected in the context of a 37-school randomized controlled trial examining the effectiveness of school-wide Positive Behavioral Interventions and Supports. Multi-level results identified several school-level contextual factors (e.g., school size, behavioral disruptions) and teacher-level factors (perceptions of school organizational health and grade level taught) associated with variability in the implementation of classroom-based positive behavior supports. Implications for prevention research and practice are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adelman, H. S., & Taylor, L. (1997). Toward a scale-up model for replicating new approaches to schooling. Journal of Educational & Psychological Consultation, 8, 197–230.

    Article  Google Scholar 

  • Barrett, S. B., Bradshaw, C. P., & Lewis-Palmer, T. (2008). Maryland statewide PBIS initiative: Systems, evaluation, and next steps. Journal of Positive Behavior Interventions, 10, 105–114.

    Article  Google Scholar 

  • Beets, M. W., Flay, B. R., Vuchinich, S., Acock, A. C., Li, K.-K., & Allred, C. (2008). School climate and teachers? Beliefs and attitudes associated with implementation of the positive action program: A diffusion of innovations model. Prevention Science, 9, 264–275.

    Article  PubMed  Google Scholar 

  • Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33.

    Article  PubMed  Google Scholar 

  • Bohanon, H., Fenning, P., Carney, K. L., Minnis-Kim, M. J., Anderson-Harriss, S., Moroz, K. B., & Pigott, T. D. (2006). Schoolwide application of positive behavior support in an urban high school: A case study. Journal of Positive Behavior Interventions, 8, 131–145.

    Article  Google Scholar 

  • Bradshaw, C. P., Koth, C. W., Bevans, K. B., Ialongo, N. S., & Leaf, P. J. (2008a). The impact of school-wide Positive Behavioral Interventions and Supports (PBIS) on the organizational health of elementary schools. School Psychology Quarterly, 23, 462–473.

    Article  Google Scholar 

  • Bradshaw, C. P., Koth, C. W., Thornton, L. A., & Leaf, P. J. (2009). Altering school climate through school-wide Positive Behavioral Interventions and Supports: Findings from a group-randomized effectiveness trial. Prevention Science, 10, 100–115. doi:10.1007/s11121-008-0114-9.

    Article  PubMed  Google Scholar 

  • Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide Positive Behavioral Interventions and Supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12, 133–148.

    Article  Google Scholar 

  • Bradshaw, C. P., & Pas, E. T. (2011). A state-wide scale-up of Positive Behavioral Interventions and Supports (PBIS): A description of the development of systems of support and analysis of adoption and implementation. School Psychology Review, 40, 530–548.

    Google Scholar 

  • Bradshaw, C. P., Pas, E. T., Barrett, S., Bloom, J., Hershfeldt, P., Alexander, A., & Leaf, P. (2012a). A state-wide partnership to promote safe and supportive schools: The PBIS Maryland Initiative. Administration and Policy in Mental Health and Mental Health Services Research, 39, 225–237. doi:10.1007/s10488-011-0384-6.

    Article  PubMed  Google Scholar 

  • Bradshaw, C. P., Reinke, W. M., Brown, L. D., Bevans, K. B., & Leaf, P. J. (2008b). Implementation of school-wide Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education & Treatment of Children 31, 1–26. doi:10.1353/etc.0.0025.

  • Bradshaw, C. P., Waasdorp, T. E., & Leaf, P. J. (2012b). Effects of school-wide Positive Behavioral Interventions and Supports on child behavior problems. Pediatrics, 130, 1136–1145. doi:10.1542/peds.2012-0243.

    Article  Google Scholar 

  • Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi:10.1016/s0272-7358(97)00043-3.

    Article  CAS  PubMed  Google Scholar 

  • Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K. E., Buckley, J. A., Olin, S., & Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28.

    Article  Google Scholar 

  • Domitrovich, C. E., Gest, S. D., Gill, S., Bierman, K. L., Welsh, J. A., & Jones, D. (2009). Fostering high-quality teaching with an enriched curriculum and professional development support: The Head Start REDI Program. American Educational Research Journal, 46, 567–597. doi:10.3102/0002831208328089.

    Article  Google Scholar 

  • Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational & Psychological Consultation, 11, 193–221.

    Article  Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.

    Article  PubMed  Google Scholar 

  • Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256. doi:10.1093/her/18.2.237.

    Article  PubMed  Google Scholar 

  • Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12, 121–138.

    Article  PubMed  Google Scholar 

  • Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems. Administration and Policy in Mental Health and Mental Health Services Research, 33, 433–448.

    Article  PubMed  Google Scholar 

  • Gottfredson, G. D., Jones, E. M., & Gore, T. W. (2002). Implementation and evaluation of a cognitive-behavioral intervention to prevent problem behavior in a disorganized school. Prevention Science, 3, 43–56.

    Article  PubMed  Google Scholar 

  • Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–272.

    Google Scholar 

  • Hagan-Burke, S., Burke, M. D., Martin, E., Boon, R. T., Fore, C., III, & Kirkendoll, D. (2005). The internal consistency of the school-wide subscales of the Effective Behavioral Support survey. Education and Treatment of Children, 28, 400–413.

    Google Scholar 

  • Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33, 665–679. doi:10.1007/s10802-005-7646-2.

    Article  PubMed  Google Scholar 

  • Horner, R. H., Sugai, G., & Anderson, C. M. (2010). Examining the evidence base for schoolwide positive behavior support. Focus on Exceptional Children, 42, 1–14.

    Google Scholar 

  • Horner, R. H., Sugai, G., Todd, A. W., & Lewis-Palmer, T. (2005). School-wide positive behavior support. In L. Bambara & L. Kern (Eds.), Individualized supports for students with problem behaviors: Designing positive behavior plans (pp. 359–390). New York: Guilford.

    Google Scholar 

  • Horner, R. H., Todd, A. W., Lewis-Palmer, T., Irvin, L. K., Sugai, G., & Boland, J. B. (2004). The school-wide evaluation tool (SET): A research instrument for assessing school-wide positive behavior support. Journal of Positive Behavior Interventions, 6, 3–12.

    Article  Google Scholar 

  • Hoy, W. K., & Feldman, J. (1987). Organizational health: The concept and its measure. Journal of Research and Development in Education, 20, 30–38.

    Google Scholar 

  • Hoy, W. K., & Tarter, C. J. (1997). The road to open and healthy schools: A handbook for change (Elementaryth ed.). Thousand Oaks: Corwin.

    Google Scholar 

  • Hoy, W. K., Tarter, J., & Kottkamp, R. (1991). Open schools/healthy schools measuring organizational climate. Columbus: Arlington Writers, Ltd.

    Google Scholar 

  • Ialongo, N. S., Werthamer, L., Kellam, S. G., Brown, C. H., Wang, S., & Lin, Y. (1999). Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and antisocial behavior. American Journal of Community Psychology, 27, 599–641. doi:10.1023/a:1022137920532.

    Article  CAS  PubMed  Google Scholar 

  • Kellam, S. G., Ling, X. G., Merisca, R., Brown, C. H., & Ialongo, N. S. (1998). The effect of the level of aggression in the first grade classroom on the course and malleability of aggressive behavior into middle school. Development and Psychopathology, 10, 165–185.

    Article  CAS  PubMed  Google Scholar 

  • Koth, C. W., Bradshaw, C. P., & Leaf, P. J. (2009). Teacher Observation of Classroom Adaptation-Checklist: Development and factor structure. Measurement and Evaluation in Counseling and Development, 42, 15–30.

    Article  Google Scholar 

  • Luke, D. (2004). Multilevel modeling. Thousand Oaks: Sage.

    Google Scholar 

  • Mitchell, M. M., & Bradshaw, C. P. (2013). Examining classroom influences on student perceptions of school climate: The role of classroom management and exclusionary discipline strategies. Journal of School Psychology, 51, 599–610. doi:10.1016/j.jsp.2013.05.005.

    Article  PubMed  Google Scholar 

  • Murray, D. M. (1998). Design and analysis of group-randomized trials. New York: Oxford.

    Google Scholar 

  • Pankratz, M., Hallfors, D., & Cho, H. (2002). Measuring perceptions of innovation adoption: The diffusion of a federal drug prevention policy. Health Education Research, 17, 315–326. doi:10.1093/her/17.3.315.

    Article  CAS  PubMed  Google Scholar 

  • Pas, E. T., & Bradshaw, C. P. (2012). Examining the association between implementation and outcomes: State-wide scale-up of school-wide Positive Behavior Intervention and Supports. Journal of Behavioral Health Services and Research, 39, 417–433. doi:10.1007/s11414-012-9290-2.

    Article  PubMed Central  PubMed  Google Scholar 

  • Payne, A. A., Gottfredson, D. C., & Gottfredson, G. D. (2006). School predictors of the intensity of implementation of school-based prevention programs: Results from a national study. Prevention Science, 7, 225–237. doi:10.1007/s11121-006-0029-2.

    Article  PubMed  Google Scholar 

  • Petras, H., Chilcoat, H. D., Leaf, P. J., Ialongo, N. S., & Kellam, S. G. (2004). Utility of TOCA-R scores during the elementary school years in identifying later violence among adolescent males. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 88–96.

    Article  PubMed  Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks: Sage.

    Google Scholar 

  • Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., Congdon, R., & du Toit, M. (2011). HLM statistical software: Version 7. Lincolnwood: Scientific Software International, Inc.

    Google Scholar 

  • Reimers, T. M., Wacker, D. P., & Koeppl, G. (1987). Acceptability of behavioral interventions: A review of the literature. School Psychology Review, 16, 212–227.

    Google Scholar 

  • Ringeisen, H., Henderson, K., & Hoagwood, K. (2003). Context matters: Schools and the ‘research to practice gap’ in children’s mental health. School Psychology Review, 32, 153–168.

    Google Scholar 

  • Ringwalt, C. L., Ennett, S., Johnson, R., Rohrbach, L. A., Simons-Rudolph, A., Vincus, A., & Thorne, J. (2003). Factors associated with fidelity to substance use prevention curriculum guides in the nation’s middle schools. Health Education & Behavior, 30, 375–391. doi:10.1177/1090198103030003010.

    Article  Google Scholar 

  • Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.

    Article  CAS  PubMed  Google Scholar 

  • Safran, S. P. (2006). Using the Effective Behavior Supports survey to guide development of schoolwide positive behavior support. Journal of Positive Behavior Interventions, 8, 3–9.

    Article  Google Scholar 

  • Spoth, R., Rohrbach, L., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., & Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351. doi:10.1007/s11121-012-0362-6.

    Article  PubMed Central  PubMed  Google Scholar 

  • Sugai, G., & Horner, R. H. (2002). The evolution of discipline practices: School-wide positive behavior supports. Child & Family Behavior Therapy, 24, 23–50. doi:10.1300/J019v24n01_03.

    Article  Google Scholar 

  • Sugai, G., & Horner, R. H. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review, 35, 245–259.

    Google Scholar 

  • Sugai, G., Lewis-Palmer, T., Todd, A. W., & Horner, R. H. (2001). School-wide Evaluation Tool (SET). Eugene: Center for Positive Behavioral Supports, University of Oregon.

    Google Scholar 

  • Sugai, G., Todd, A. W., & Horner, R. H. (2000). Effective Behavior Support (EBS) survey: Assessing and planning behavior supports in schools. Eugene: University of Oregon.

    Google Scholar 

  • Tabachnick, B. G., & Fiddell, L. S. (2001). Using multivariate statistics (4th ed.). Needham Heights: Allyn.

    Google Scholar 

Download references

Acknowledgments

Support for this project comes from the National Institute of Mental Health (R01MH67948-1A1), the Centers for Disease Control and Prevention (1U49CE000728, K01CE001333-01), and the Institute of Education Sciences (R305A090307).

Author information

Authors and Affiliations

  1. Johns Hopkins Bloomberg School of Public Health, Center for the Prevention of Youth Violence, Baltimore, USA

    Elise T. Pas, Tracy E. Waasdorp & Catherine P. Bradshaw

Authors
  1. Elise T. Pas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tracy E. Waasdorp
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Catherine P. Bradshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Elise T. Pas.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pas, E.T., Waasdorp, T.E. & Bradshaw, C.P. Examining Contextual Influences on Classroom-Based Implementation of Positive Behavior Support Strategies: Findings from a Randomized Controlled Effectiveness Trial. Prev Sci 16, 1096–1106 (2015). https://doi.org/10.1007/s11121-014-0492-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11121-014-0492-0

Keywords

Search

Navigation