Promoting Teachers’ Implementation of Classroom-Based Prevention Programming Through Coaching: The Mediating Role of the Coach–Teacher Relationship

  • Stacy R. Johnson
  • Elise T. Pas
  • Catherine P. Bradshaw
  • Nicholas S. Ialongo
Original Article

Abstract

There is growing awareness of the importance of implementation fidelity and the supports, such as coaching, to optimize it. This study examined how coaching activities (i.e., check-ins, needs assessment, modeling, and technical assistance) related directly and indirectly to implementation dosage and quality of the PAX Good Behavior Game, via a mediating pathway through working relationship. Mediation analyses of 138 teachers revealed direct effects of modeling and working relationship on implementation dosage, whereas needs assessment was associated with greater dosage indirectly, by higher ratings of the working relationship. Understanding how coaching activities promote implementation fidelity elements has implications for improving program effectiveness.

Keywords

Evidence-based programs Implementation Coaching activities Working relationship Mediation 

Notes

Acknowledgements

We thank Celene Domitrovich and Kimberly Becker for their contributions to the collection of these data.

Funding

This work was funded in part by grants from the Institute of Education Sciences awarded to Catherine Bradshaw (R305A130701 and R305A150221) and Nicholas Ialongo (R305A080326), and the National Institute of Mental Health (T32 MH019545-23) awarded to Philip Leaf.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all participants included in the study.

References

  1. Aarons, G. A., Farahnak, L. R., & Ehrhart, M. G. (2014). Leadership and strategic organizational climate to support evidence-based practice implementation. In R. S. Beidas & P. C. Kendall (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health (pp. 82–97). New York: Guildford Press.Google Scholar
  2. Ackerman, S. J., & Hilsenroth, M. J. (2003). A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review, 23(1), 1–33. doi: 10.1016/S0272-7358(02)00146-0.CrossRefPubMedGoogle Scholar
  3. Azur, M. J., Stuart, E. A., Frangakis, C., & Leaf, P. J. (2011). Multiple imputation by chained equations: What is it and how does it work? International Journal of Methods in Psychiatric Research, 20(1), 40–49. doi: 10.1002/mpr.329.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Bernstein, A. (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 518–529. doi: 10.1007/s10488-013-0485-5.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Becker, K. D., Bradshaw, C. P., Domitrovich, C. E., & Ialongo, N. S. (2013a). Coaching teachers to improve implementation of the good behavior game. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 482–493. doi: 10.1007/s10488-013-0482-8.CrossRefPubMedGoogle Scholar
  6. Becker, K. D., Darney, D., Domitrovich, C. E., Keperling, J. P., & Ialongo, N. S. (2013b). Supporting universal prevention programs: A two-phased coaching model. Clinical Child and Family Psychology Review, 16(2), 213–228. doi: 10.1007/s10567-013-0134-2.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606. doi: 10.1037/0033-2909.88.3.588.CrossRefGoogle Scholar
  8. Bradshaw, C. P., Mitchell, M. M., & Leaf, P. J. (2010). Examining the effects of schoolwide positive behavioral interventions and supports on student outcomes: Results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12(3), 133–148. doi: 10.1177/1098300709334798.CrossRefGoogle Scholar
  9. Bradshaw, C. P., Pas, E. T., Goldweber, A., Rosenberg, M. S., & Leaf, P. J. (2012). Integrating school-wide positive behavioral interventions and supports with tier 2 coaching to student support teams: The PBISplus model. Advances in School Mental Health Promotion, 5(3), 177–193. doi: 10.1080/1754730x.2012.707429.CrossRefGoogle Scholar
  10. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 40. doi: 10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentralGoogle Scholar
  11. Century, J., Rudnick, M., & Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31(2), 199–218. doi: 10.1177/1098214010366173.CrossRefGoogle Scholar
  12. Coles, E. K., Owens, J. S., Serrano, V. J., Slavec, J., & Evans, S. W. (2015). From consultation to student outcomes: The role of teacher knowledge, skills, and beliefs in increasing integrity in classroom management strategies. School Mental Health, 7(1), 34–48. doi: 10.1007/s12310-015-9143-2.CrossRefGoogle Scholar
  13. Cook, C. R., Lyon, A. R., Kubergovic, D., Browning Wright, D., & Zhang, Y. (2015). A supportive beliefs intervention to facilitate the implementation of evidence-based practices within a multi-tiered system of supports. School Mental Health, 7(1), 49–60. doi: 10.1007/s12310-014-9139-3.CrossRefGoogle Scholar
  14. Denton, C. A., & Hasbrouck, J. A. N. (2009). A description of instructional coaching and its relationship to consultation. Journal of Educational and Psychological Consultation, 19(2), 150–175. doi: 10.1080/10474410802463296.CrossRefGoogle Scholar
  15. Domitrovich, C. E., Bradshaw, C. P., Greenberg, M. T., Embry, D., Poduska, J. M., & Ialongo, N. S. (2010). Integrated models of school-based prevention: Logic and theory. Psychology in the Schools, 47(1), 71–88. doi: 10.1002/pits.20452.PubMedPubMedCentralGoogle Scholar
  16. Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., … Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. doi: 10.1080/1754730x.2008.9715730.CrossRefPubMedPubMedCentralGoogle Scholar
  17. Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11, 193–221. doi: 10.1207/s1532768xjepc1102_04.CrossRefGoogle Scholar
  18. Domitrovich, C. E., Pas, E. T., Bradshaw, C. P., Becker, K. D., Keperling, J. P., Embry, D. D., & Ialongo, N. (2015). Individual and school organizational factors that influence implementation of the PAX good behavior game intervention. Prevention Science. doi: 10.1007/s11121-015-0557-8.Google Scholar
  19. Domitrovich, C. E., Poduska, J. M., & Bradshaw, C. P. (2008). The teacher-coach alliance scale. Unpublished technical report. Penn State University.Google Scholar
  20. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. doi: 10.1007/s10464-008-9165-0.CrossRefPubMedGoogle Scholar
  21. Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256. doi: 10.1093/her/18.2.237.CrossRefPubMedGoogle Scholar
  22. Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20(3), 308–313. doi: 10.1093/her/cyg134.CrossRefPubMedGoogle Scholar
  23. Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissberg, R. P. (2003). Implementation, sustainability, and scaling up of social-emotional and academic innovations in public schools. School Psychology Review, 32, 303–319.Google Scholar
  24. Embry, D., Staatemeier, G., Richardson, C., Lauger, K., & Mitich, J. (2003). The PAX good behavior game (1st edn.). Center City, MN: Hazelden.Google Scholar
  25. Frank, J. L., & Kratochwill, T. R. (2014). School-based problem-solving consultation: Plotting a new course for evidence-based research and practice in consultation. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (2 ed., pp. 13–30). New York: Taylor and Francis.Google Scholar
  26. Garet, M. S., Heppen, J., Walters, K., Smith, T., & Yang, R. (2016). Does content-focused teacher professional development work? Findings from three Institute of Education Sciences Studies (Evaluation Brief NCEE 2017-4010). Retrieved from http://ies.ed.gov/ncee/pubs/20174010/pdf/20174010.pdf.
  27. Gottfredson, D. C., & Gottfredson, G. D. (2002). Quality of school-based prevention programs: Results from a national survey. Journal of Research in Crime and Delinquency, 39, 3–35. doi: 10.1177/002242780203900101.CrossRefGoogle Scholar
  28. Greenberg, M., & Kusché, C. A. & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (grades 3–5). South Deerfield, MA: Channing-Bete Co.Google Scholar
  29. Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36(2), 223–233. doi: 10.1037/0022-0167.36.2.223.CrossRefGoogle Scholar
  30. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. doi: 10.1080/10705519909540118.CrossRefGoogle Scholar
  31. Johnson, S. R., Pas, E. T., & Bradshaw, C. P. (2016). Understanding and measuring coach–teacher alliance: A glimpse inside the ‘black box’. Prevention Science, 17(4), 439–449. doi: 10.1007/s11121-016-0633-8.CrossRefPubMedPubMedCentralGoogle Scholar
  32. Joyce, B., & Showers, B. (1980). Improving inservice training: The message of research. Educational Leadership, 37(5), 379–385.Google Scholar
  33. Kaftarian, S., Robertson, E., Compton, W., Davis, B. W., & Volkow, N. (2004). Blending prevention research and practice in schools: Critical issues and suggestions. Prevention Science, 5(1), 1–3. doi: 10.1023/B:PREV.0000013975.74774.bc.CrossRefPubMedGoogle Scholar
  34. Kratochwill, T., Elliott, S., & Rotto, P. C. (1995). Best practices in school-based behavioral consultation. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology III (pp. 519–535). Bethesda, MD: National Association of School Psychologists.Google Scholar
  35. Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education: The Journal of the Teacher Education Division of the Council for Exceptional Children, 33(4), 279–299. doi: 10.1177/0888406410371643.CrossRefGoogle Scholar
  36. Kusché, C. A., & Greenberg, M. & Conduct Problems Prevention Research Group. (2011). Grade level PATHS (grades 1–2). South Deerfield, MD: Channing-Bete Co.Google Scholar
  37. Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010). Evidence-based mental health programs in schools: Barriers and facilitators of successful implementation. School Mental Health, 2(3), 105–113. doi: 10.1007/s12310-010-9038-1.CrossRefPubMedPubMedCentralGoogle Scholar
  38. MacKinnon, D. (2008). Introduction to statistical mediation analysis. Mahwah, NJ: Erlbaum.Google Scholar
  39. Marchese, D. D., Becker, K. D., Kaperlink, J. P., Domitrovich, C. E., Reinke, W. M., Embry, D. D., & Ialongo, N. S. (2017). A step-by-step guide for coaching classroom teachers in evidence-based interventions. New York: Oxford Press.CrossRefGoogle Scholar
  40. Muthén, L. K., & Muthén, B. O. (1998–2014). Mplus user’s guide (Vol. 7). Los Angeles, CA: Muthén & Muthén.Google Scholar
  41. Nadeem, E., Gleacher, A., & Beidas, R. S. (2013). Consultation as an implementation strategy for evidence-based practices across multiple contexts: Unpacking the black box. Administration and Policy in Mental Health, 40(6), 439–450. doi: 10.1007/s10488-013-0502-8.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Noell, G. H., & Gansle, K. A. (2014). Research examining the relationships between consultation procedures, treatment integrity, and outcomes. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (Vol. 2, pp. 386–408). New York: Routledge.Google Scholar
  43. Owens, J. S., Schwartz, M. E., Erchul, W. P., Himawan, L. K., Evans, S. W., Coles, E. K., & Schulte, A. C. (2017). Teacher perceptions of school consultant social influence strategies: Replication and expansion. Journal of Educational and Psychological Consultation. doi: 10.1080/10474412.2016.1275649.Google Scholar
  44. Pas, E. T., Bradshaw, C. P., Becker, K. D., Domitrovich, C. E., Berg, J., Musci, R., & Ialongo, N. S. (2015). Identifying patterns of coaching to support the implementation of the good behavior game: The role of teacher characteristics. School Mental Health, 7(1), 61–73. doi: 10.1007/s12310-015-9145-0.CrossRefGoogle Scholar
  45. Pas, E. T., Bradshaw, C. P., & Cash, A. H. (2014). Coaching classroom-based preventive interventions. In M. D. Weist, N. A. Lever, C. P. Bradshaw & J. S. Owens (Eds.), Handbook of school mental health: research, training, practice, and policy (2 ed., pp. 255–267). New York: Springer.CrossRefGoogle Scholar
  46. Pas, E. T., Larson, K., Reinke, W., Herman, K., & Bradshaw, C. P. (2016). Implementation and acceptability of an adapted classroom check-up coaching model to promote culturally-responsive classroom management. The Education & Treatment of Children, 39, 467–492. doi: 10.1353/etc.2016.0021.CrossRefGoogle Scholar
  47. Reinke, W. M., Herman, K. C., & Sprick, R. (2011). Motivational interviewing for effective classroom management: The classroom check-up. New York: Guilford Press.Google Scholar
  48. Reinke, W. M., Herman, K. C., Stormont, M., Newcomer, L., & David, K. (2013). Illustrating the multiple facets and levels of fidelity of implementation to a teacher classroom management intervention. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 494–506. doi: 10.1007/s10488-013-0496-2.CrossRefPubMedGoogle Scholar
  49. Reinke, W. M., Lewis-Palmer, T., & Martin, E. (2007). The effect of visual performance feedback on teacher use of behavior-specific praise. Behavior Modification, 31(3), 247–263. doi: 10.1177/0145445506288967.CrossRefPubMedGoogle Scholar
  50. Ringwalt, C., Vincus, A. A., Hanley, S., Ennett, S. T., Bowling, J. M., & Rohrbach, L. A. (2009). The prevalence of evidence-based drug use prevention curricula in U.S. middle schools in 2005. Prevention Science, 10(1), 33–40. doi: 10.1007/s11121-008-0112-y.CrossRefPubMedPubMedCentralGoogle Scholar
  51. Saldana, L., Chamberlain, P., & Chapman, J. (2016). A supervisor-targeted implementation approach to promote system change: The R3 Model. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 879–892. doi: 10.1007/s10488-016-0730-9.CrossRefPubMedGoogle Scholar
  52. Sanetti, L. M. H., Collier-Meek, M. A., Long, A. C. J., Kim, J., & Kratochwill, T. R. (2014). Using implementation planning to increase teachers’ adherence and quality behavior support plans. Psychology in the Schools, 51(8), 879–895. doi: 10.1002/pits.21787.CrossRefGoogle Scholar
  53. Schaffer, K., Rouiller, S., Embry, D., & Ialongo, N. (2006). The PAX good behavior game implementation rubric. Unpublished technical report. Johns Hopkins University.Google Scholar
  54. Spoth, R., Rohrbach, L., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., … Hawkins, J. D. (2013). Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14, 319–351. doi: 10.1007/s11121-012-0362-6.CrossRefPubMedPubMedCentralGoogle Scholar
  55. Stormont, M., & Reinke, W. M. (2014). Providing performance feedback for teachers to increase treatment fidelity. Intervention in School and Clinic, 49(4), 219–224. doi: 10.1177/1053451213509487.CrossRefGoogle Scholar
  56. Stormont, M., Reinke, W. M., Newcomer, L., Marchese, D., & Lewis, C. (2015). Coaching teachers’ use of social behavior interventions to improve children’s outcomes: A review of the literature. Journal of Positive Behavior Interventions, 17(2), 69–82. doi: 10.1177/1098300714550657.CrossRefGoogle Scholar
  57. Taylor, J. (2007). Instructional coaching: The state of the art. In M. Mangin & S. Stoelinga (Eds.), Effective teacher leadership: Using research to inform and reform. New York: Teachers College Press.Google Scholar
  58. U.S. Department of Education. (2012). Prevalence and implementation fidelity of research-based prevention programs in public schools: Final report Retrieved from http://www2.ed.gov/rschstat/eval/other/research-based-prevention.pdf.
  59. Wehby, J. H., Maggin, D. M., Partin, Moore, T. C., & Robertson, R. (2012). The impact of working alliance, social validity, and teacher burnout on implementation fidelity of the good behavior game. School Mental Health, 4(1), 22–33. doi: 10.1007/s12310-011-9067-4.CrossRefGoogle Scholar
  60. White, I. R., Royston, P., & Wood, A. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30(4), 377–399. doi: 10.1002/sim.4067.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Stacy R. Johnson
    • 1
    • 4
  • Elise T. Pas
    • 2
  • Catherine P. Bradshaw
    • 2
    • 3
  • Nicholas S. Ialongo
    • 2
  1. 1.Department of Mental HealthJohns Hopkins Bloomberg School of Public HealthBaltimoreUSA
  2. 2.Department of Mental HealthBloomberg School of Public HealthBaltimoreUSA
  3. 3.Department of Human Services, Curry School of EducationUniversity of VirginiaCharlottesvilleUSA
  4. 4.Kennedy Krieger InstituteBaltimoreUSA

Personalised recommendations