Skip to main content
Log in

Supervisory Alliance as a Moderator of the Effects of Behavioral Rehearsal on TF-CBT Fidelity: Results from a Randomized Trial of Supervision Strategies

  • Original Article
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

Exposure is an important element of treatment for many evidence-based treatments but can be challenging to implement. Supervision strategies to support exposure delivery may be an important tool to facilitate the use of exposure techniques; however, they must be considered and used in the context of the supervisory alliance. The present study examined relations between supervisory alliance and fidelity to the trauma narrative (TN; i.e., imaginal exposure) component of Trauma-Focused Cognitive Behavioral Therapy. We also examined how supervisory alliance moderated the effect of behavioral rehearsal use in supervision on TN fidelity. We analyzed data from a randomized controlled trial, in which forty-two supervisors and their clinicians (N = 124) from 28 Washington State community-based mental health offices participated. Clinicians were randomized to receive one of two supervision conditions—symptom and fidelity monitoring (SFM) or SFM with behavioral rehearsal (SFM + BR). Supervisory alliance alone did not predict delivery (i.e., occurrence) or extensiveness of delivery of the trauma narrative. Client-focused supervisory alliance moderated the effectiveness of behavioral rehearsal—as client-focused alliance increased, the odds of delivering the TN also increased significantly. Future research should further investigate how to appropriately match supervision techniques with supervisory dyads and explore the interplay of alliance with supervision techniques a supervisor might employ.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Data Availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Code Availability

All code for data cleaning and analysis associated with the current submission is available from the corresponding author on reasonable request.

References

  • Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., Beidas, R. S., & Washington, D. C. (2017). 68(2), 115–122. https://doi.org/10.1176/APPI.PS.201600062.

  • Bambling, M., King, R., Raue, P., Schweitzer, R., & Lambert, W. (2007). Clinical supervision: Its influence on client-rated working alliance and client symptom reduction in the brief treatment of major depression. Https://Doi Org/, 16(3), 317–331. https://doi.org/10.1080/10503300500268524.

    Article  Google Scholar 

  • Bearman, S. K., Schneiderman, R. L., & Zoloth, E. (2017). Building an evidence base for Effective Supervision practices: An Analogue experiment of Supervision to increase EBT Fidelity. Administration and Policy in Mental Health, 44(2), 293. https://doi.org/10.1007/S10488-016-0723-8.

    Article  PubMed  PubMed Central  Google Scholar 

  • Becker-Haimes, E. M., Klein, C. C., Frank, H. E., Oquendo, M. A., Jager-Hyman, S., Brown, G. K., Brady, M., & Barnett, M. L. (2022). Clinician Maladaptive anxious avoidance in the context of implementation of evidence-based interventions: A Commentary. Frontiers in Health Services, 2, 833214. https://doi.org/10.3389/FRHS.2022.833214.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidas, R. S., Cross, W., & Dorsey, S. (2014). Show me, don’t tell me: Behavioral rehearsal as a training and Analogue Fidelity Tool. Cognitive and Behavioral Practice, 21(1), 1–11. https://doi.org/10.1016/j.cbpra.2013.04.002.

    Article  PubMed  Google Scholar 

  • Beidas, R. S., Edmunds, J. M., Cannuscio, C. C., Gallagher, M., Downey, M. M., & Kendall, P. C. (2013). Therapists perspectives on the effective elements of consultation following training. Administration and Policy in Mental Health and Mental Health Services Research, 40(6), 507–517. https://doi.org/10.1007/s10488-013-0475-7.

    Article  PubMed  Google Scholar 

  • Beidas, R. S., Williams, N. J., Becker-Haimes, E. M., Aarons, G. A., Barg, F. K., Evans, A. C., Jackson, K., Jones, D., Hadley, T., Hoagwood, K., Marcus, S. C., Neimark, G., Rubin, R. M., Schoenwald, S. K., Adams, D. R., Walsh, L. M., Zentgraf, K., & Mandell, D. S. (2019). A repeated cross-sectional study of clinicians’ use of psychotherapy techniques during 5 years of a system-wide effort to implement evidence-based practices in Philadelphia. Implementation Science, 14(1), 67. https://doi.org/10.1186/s13012-019-0912-4.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory Research & Practice, 16(3), 252–260. https://doi.org/10.1037/h0085885.

    Article  ADS  Google Scholar 

  • Borntrager, C., Chorpita, B. F., Higa-McMillan, C. K., Daleiden, E. L., & Starace, N. (2013). Usual care for trauma-exposed youth: Are clinician-reported therapy techniques evidence-based? Children and Youth Services Review, 35(1), 133–141. https://doi.org/10.1016/j.childyouth.2012.09.018.

    Article  Google Scholar 

  • Bradley, W. J., & Becker, K. D. (2021). Clinical Supervision of Mental Health Services: A systematic review of Supervision characteristics and practices Associated with formative and restorative outcomes. The Clinical Supervisor, 40(1), 88. https://doi.org/10.1080/07325223.2021.1904312.

    Article  PubMed  PubMed Central  Google Scholar 

  • Breitenstein, S. M., Gross, D., Garvey, C. A., Hill, C., Fogg, L., & Resnick, B. (2010). Implementation Fidelity in Community-based interventions. Research in Nursing & Health, 33(2), 164. https://doi.org/10.1002/NUR.20373.

    Article  Google Scholar 

  • Carey, V. J. (2022). Generalized Estimation Equation Solver [R package gee version 4.13-25]. https://CRAN.R-project.org/package=gee.

  • Chu, B. C., Crocco, S. T., Arnold, C. C., Brown, R., Southam-Gerow, M. A., & Weisz, J. R. (2015). Sustained implementation of cognitive-behavioral therapy for youth anxiety and depression: Long-term effects of structured training and consultation on therapist practice in the field. Professional Psychology: Research and Practice, 46(1), 70–79. https://doi.org/10.1037/a0038000.

    Article  PubMed  Google Scholar 

  • Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284.

    Article  Google Scholar 

  • Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006). Treating trauma and traumatic grief in children and adolescents. Guilford Press.

  • Collyer, H., Eisler, I., & Woolgar, M. (2020). Systematic literature review and meta-analysis of the relationship between adherence, competence and outcome in psychotherapy for children and adolescents. In European Child and Adolescent Psychiatry (Vol. 29, Issue 4, pp. 417–431). Springer. https://doi.org/10.1007/s00787-018-1265-2.

  • Deblinger, E., Cohen, J. A., Mannarino, A., Runyon, M., & Hanson, R. (2005). {TF}-{CBT} {Checklist} {Scoring} {Steet}.

  • Deblinger, E., Dorsey, S., Cooper, B., McLeod, B., & Garland, A. F. (2013). Scoring manual for the TF-CBT version of the therapy process observational coding system for child psychotherapy –. TF-CBT TPOCS-S.

  • Dorsey, S., Berliner, L., Lyon, A. R., Pullmann, M. D., & Murray, L. K. (2016). A statewide common elements initiative for children’s mental health. The Journal of Behavioral Health Services & Research, 43(2), 246–261. https://doi.org/10.1007/s11414-014-9430-y.

    Article  Google Scholar 

  • Dorsey, S., Kerns, S. E. U., Lucid, L., Pullmann, M. D., Harrison, J. P., Berliner, L., Thompson, K., & Deblinger, E. (2018). Objective coding of content and techniques in workplace-based supervision of an EBT in public mental health. Implementation Science, 13(1). https://doi.org/10.1186/s13012-017-0708-3.

  • Dorsey, S., McLaughlin, K. A., Kerns, S. E. U., Harrison, J. P., Lambert, H. K., Briggs, E. C., Cox, R., J., & Amaya-Jackson, L. (2017a). Evidence base update for psychosocial treatments for children and adolescents exposed to traumatic events. Journal of Clinical Child and Adolescent Psychology, 46(3). https://doi.org/10.1080/15374416.2016.1220309.

  • Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., Unützer, J., Weisz, J. R., & Garland, A. F. (2013). Improving practice in community-based settings: A randomized trial of supervision - study protocol. Implementation Science, 8. https://doi.org/10.1186/1748-5908-8-89.

  • Dorsey, S., Pullmann, M. D., Kerns, S. E. U., Jungbluth, N., Meza, R., Thompson, K., & Berliner, L. (2017b). The juggling act of supervision in community mental health: Implications for supporting evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44(6), 838–852. https://doi.org/10.1007/s10488-017-0796-z.

    Article  PubMed  Google Scholar 

  • Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350. https://doi.org/10.2307/2666999.

    Article  Google Scholar 

  • Efstation, J. F., Patton, M. J., & Kardish, C. M. (1990). Measuring the working alliance in counsellor supervision. Journal of Counseling Psychology, 37, 322–329.

    Article  Google Scholar 

  • Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014a). Assessing the organizational context for EBP implementation: The development and validity testing of the implementation climate scale (ICS). Implementation Science: IS, 9(1), 157. https://doi.org/10.1186/S13012-014-0157-1/TABLES/7.

    Article  PubMed  PubMed Central  Google Scholar 

  • Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014b). Assessing the organizational context for EBP implementation: The development and validity testing of the implementation climate scale (ICS). Implementation Science, 9(1), 157. https://doi.org/10.1186/s13012-014-0157-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Fitzgerald, M. M. (2010). TF-CBT Knowledge Test. Unpublished measure.

  • Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine-Schlagel, R., & Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795. https://doi.org/10.1176/ps.2010.61.8.788.

    Article  PubMed  Google Scholar 

  • Halvorson, M. A., McCabe, C. J., Kim, D. S., Cao, X., & King, K. M. (2022). Making sense of some odd ratios: A tutorial and improvements to present practices in reporting and visualizing quantities of interest for binary and count outcome models. Psychology of Addictive Behaviors: Journal of the Society of Psychologists in Addictive Behaviors, 36(3), 284–295. https://doi.org/10.1037/ADB0000669.

    Article  PubMed  Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of clinical child and adolescent psychology: The Official Journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association. Division, 53(2), 155–167. https://doi.org/10.1207/S15374424JCCP3102_02.

    Article  Google Scholar 

  • Jacobs, S. R., Weiner, B. J., & Bunger, A. C. (2014). Context matters: Measuring implementation climate among individuals and groups. Implementation Science, 9. https://doi.org/10.1186/1748-5908-9-46.

  • Johnson, S. R., Pas, E. T., & Bradshaw, C. P. (2016). Understanding and measuring coach-teacher alliance: A glimpse inside the ‘black box’. Prevention Science, 17(4), 439–449. https://doi.org/10.1007/s11121-016-0633-8.

    Article  PubMed  PubMed Central  Google Scholar 

  • Johnson, S. R., Pas, E. T., Bradshaw, C. P., & Ialongo, N. S. (2017). Promoting teachers’ implementation of classroom-based prevention programming through coaching: The mediating role of the coach–teacher relationship. Administration and Policy in Mental Health and Mental Health Services Research, 45(3), 404–416. https://doi.org/10.1007/s10488-017-0832-z.

    Article  Google Scholar 

  • Kim, D. S., & McCabe, C. J. (2022). The partial derivative framework for substantive regression effects. Psychological Methods, 27(1), 121–141. https://doi.org/10.1037/MET0000440.

    Article  PubMed  Google Scholar 

  • Kolb, D. (1984). Experiential learning. Prentice Hall.

  • Locke, J., Violante, S., Pullmann, M. D., Kerns, S. E. U., Jungbluth, N., & Dorsey, S. (2017). Agreement and discrepancy between supervisor and clinician alliance: Associations with clinicians’ perceptions of psychological climate and emotional exhaustion (pp. 1–13). Administration and Policy in Mental Health and Mental Health Services Research.

  • McCabe, C., Halvorson, M. A., King, K. M., Cao, X., & Kim, D. S. (2020). Estimating and interpreting interaction effects in generalized linear models of binary and count data.

  • McCabe, C. J., Halvorson, M. A., King, K. M., Cao, X., & Kim, D. S. (2021). modglm: An R package for testing, interpreting, and displaying interactions in generalized linear models of discrete data. https://doi.org/10.5281/ZENODO.4647849.

  • McLeod, B. D. (2011). Relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. In Clinical Psychology Review (Vol. 31, Issue 4, pp. 603–616). https://doi.org/10.1016/j.cpr.2011.02.001.

  • McLeod, B. D., Southam-Gerow, M. A., Tully, C. B., Rodríguez, A., & Smith, M. M. (2013). Making a Case for Treatment Integrity as a Psychosocial Treatment Quality Indicator for Youth Mental Health Care. In Clinical Psychology: Science and Practice (Vol. 20, Issue 1, pp. 14–32). https://doi.org/10.1111/cpsp.12020.

  • McLeod, B. D., & Weisz, J. R. (2010). The therapy process observational coding system for child psychotherapy strategies scale. Journal of Clinical Child and Adolescent Psychology, 39(3), 436–443. https://doi.org/10.1080/15374411003691750.

    Article  PubMed  Google Scholar 

  • Meza, R. D., AlRasheed, R., Pullmann, M. D., & Dorsey, S. (2023). Clinical supervision approach predicts evidence-based trauma treatment delivery in children’s mental health. Frontiers in Psychiatry, 13, 3020. https://doi.org/10.3389/FPSYT.2022.1072844/BIBTEX.

    Article  Google Scholar 

  • Milne, D. (2008). CBT supervision: From reflexivity to specialization. Behavioural and Cognitive Psychotherapy, 36(6), 779–786. https://doi.org/10.1017/S1352465808004773.

    Article  Google Scholar 

  • Milne, D., Aylott, H., Fitzpatrick, H., & Ellis, M. V. (2008). How does clinical supervision work? Using a best evidence synthesis approach to construct a basic model of supervision. Clinical Supervisor, 27(2), 170–190. https://doi.org/10.1080/07325220802487915.

    Article  Google Scholar 

  • Milne, D., & Dunkerley, C. (2010a). Towards evidence-based clinical supervision: The development and evaluation of four CBT guidelines. Cognitive Behaviour Therapist, 3(2), 43–57. https://doi.org/10.1017/S1754470X10000048.

    Article  Google Scholar 

  • Milne, D., & Dunkerley, C. (2010b). Towards evidence-based clinical supervision: The development and evaluation of four CBT guidelines. Cognitive Behaviour Therapist, 3(2), 43–57. https://doi.org/10.1017/S1754470X10000048.

    Article  Google Scholar 

  • Milne, D., & James, I. (2005). Clinical supervision: Ten tests of the tandem model. Clinical Psychology Forum, 151, 6–9. https://doi.org/10.53841/BPSCPF.2005.1.151.6.

    Article  Google Scholar 

  • Milne, D., & Reiser, R. P. (2012). A rationale for evidence-based clinical supervision. Journal of Contemporary Psychotherapy, 42(3), 139–149. https://doi.org/10.1007/s10879-011-9199-8.

    Article  Google Scholar 

  • National Crime Victims Research and Treatment Center, MUSC (2010). Project BEST Pre-Work Participant Practice Survey. Unpublished measure.

  • Park, H., Ebesutani, C. K., Chung, K. M., & Stanick, C. (2016). Cross-cultural validation of the modified practice attitudes scale: Initial factor analysis and a new factor model. Assessment, 25(1), 126–138. https://doi.org/10.1177/1073191116634202.

    Article  PubMed  Google Scholar 

  • Patton, M. J., & Kivlighan, D. M. (1997). Relevance of the Supervisory Alliance to the Counseling Alliance and to treatment adherence in Counselor Training. Journal of Counseling Psychology, 44(1), 108–115. https://doi.org/10.1037/0022-0167.44.1.108.

    Article  Google Scholar 

  • Perepletchikova, F., University, Y., & Kazdin, A. E. (2005). Treatment Integrity and Therapeutic Change: Issues and Research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383. https://doi.org/10.1093/CLIPSY.BPI045.

    Article  Google Scholar 

  • Proctor, E., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(1), 1–11. https://doi.org/10.1186/1748-5908-8-139.

    Article  Google Scholar 

  • Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7.

    Article  PubMed  Google Scholar 

  • Roth, A. D., Pilling, S., & Turner, J. (2010). Therapist training and supervision in clinical trials: Implications for clinical practice. Behavioural and Cognitive Psychotherapy, 38(3), 291–302. https://doi.org/10.1017/S1352465810000068.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Chapman, J. E., Kelleher, K., Hoagwood, K. E., Landsverk, J., Stevens, J., Glisson, C., & Rolls-Reutz, J. (2008). A survey of the infrastructure for children’s mental health services: Implications for the implementation of empirically supported treatments (ESTs). Administration and Policy in Mental Health and Mental Health Services Research, 35(1), 84–97. https://doi.org/10.1007/s10488-007-0147-6.

    Article  PubMed  Google Scholar 

  • Schoenwald, S. K., Sheidow, A. J., & Chapman, J. E. (2009). Clinical supervision in treatment transport: Effects on adherence and outcomes. Journal of Consulting and Clinical Psychology, 77(3), 410–421. https://doi.org/10.1037/A0013788.

    Article  PubMed  PubMed Central  Google Scholar 

  • Triplett, N. (2019). Supervisory Alliance and Fidelity. https://osf.io/vbhnj/.

  • Wehby, J. H., Maggin, D. M., Partin, T. C. M., & Robertson, R. (2012). The Impact of Working Alliance, Social Validity, and teacher burnout on implementation fidelity of the good behavior game. School Mental Health, 4(1), 22–33. https://doi.org/10.1007/s12310-011-9067-4.

    Article  Google Scholar 

  • Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61(7), 671–689. https://doi.org/10.1037/0003-066X.61.7.671.

    Article  PubMed  Google Scholar 

  • Weisz, J. R., Ng, M. Y., & Bearman, S. K. (2014). Odd couple? Reenvisioning the relation between Science and Practice in the dissemination-implementation era. Clinical Psychological Science, 2(1), 58–74. https://doi.org/10.1177/2167702613501307.

    Article  Google Scholar 

  • Williams, N. J., & Beidas, R. S. (2019). Annual Research Review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450. https://doi.org/10.1111/JCPP.12960.

    Article  PubMed  Google Scholar 

  • Wolk, C. B., Becker-Haimes, E. M., Fishman, J., Affrunti, N. W., Mandell, D. S., & Creed, T. A. (2019). Variability in clinician intentions to implement specific cognitive-behavioral therapy components. Bmc Psychiatry, 19(1), 1–7. https://doi.org/10.1186/s12888-019-2394-y.

    Article  Google Scholar 

Download references

Funding

This study was funded by the National Institute of Mental Health (R01 MH095749 [PI: Dorsey]). Manuscript preparation was also supported in part the Health Policy Research Scholars, a program of the Robert Wood Johnson Foundation (Fellow: Triplett), a National Institute of Mental Health grant (F31 MH124328 [PI: Triplett]) that supported the time of Mr. Triplett, a National Institute of Mental Health grant (F31 MH130041 [PI: Johnson]) that supported the time of Ms. Johnson, two National Institutes on Alcohol Abuse and Alcoholism grants that supported the time of Dr. McCabe (T32AA013525 [PI: Larimer]; K99AA030052 [PI: McCabe]), and a National Institute of Mental Health grant (P50 MH126219 [MPI: Dorsey & Lewis]) that supported the time of Dr. Dorsey.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: Noah Triplett, Shannon Dorsey; Methodology: Noah S. Triplett, Michael Pullmann, Shannon Dorsey; Formal analysis and investigation: Noah S. Triplett, Connor McCabe; Writing - original draft preparation: Noah S. Triplett; Writing - review and editing: Noah S. Triplett, Rashed AlRasheed, Clara Johnson, Connor McCabe, Michael Pullmann, Shannon Dorsey; Funding acquisition: Michael Pullmann, Shannon Dorsey; Supervision: Shannon Dorsey.

Corresponding author

Correspondence to Noah S. Triplett.

Ethics declarations

Competing Interests

Dr. Dorsey has received honorariums for providing TF-CBT training. Authors Triplett, AlRasheed, Johnson, McCabe, and Pullmann declare no conflicts of interest.

Ethics Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. This study was approved by the University of Washington Institutional Review Board (STUDY00000428).

Consent to Participate

Informed consent was obtained from all individual participants included in the study.

Consent for publication

All participants were informed that any publication of this study will not use their name or identify them personally.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Triplett, N.S., AlRasheed, R., Johnson, C. et al. Supervisory Alliance as a Moderator of the Effects of Behavioral Rehearsal on TF-CBT Fidelity: Results from a Randomized Trial of Supervision Strategies. Adm Policy Ment Health 51, 254–267 (2024). https://doi.org/10.1007/s10488-023-01334-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-023-01334-2

Keywords

Navigation