Agreement and Discrepancy Between Supervisor and Clinician Alliance: Associations with Clinicians’ Perceptions of Psychological Climate and Emotional Exhaustion

  • Jill Locke
  • Stephanie Violante
  • Michael D. Pullmann
  • Suzanne E. U. Kerns
  • Nathaniel Jungbluth
  • Shannon Dorsey
Original Article


Despite increasing interest in supervision as a leverage point for bolstering public mental health services, the potential influence of supervisory alliance on organizations and direct service providers remains understudied, particularly in the context of supporting evidence-based treatment (EBT) use. This study examined agreement and discrepancy between supervisor and clinician ratings of alliance associated with clinicians’ perceptions of psychological climate and emotional exhaustion. Results indicated that discrepancies in alliance ratings were common and associated with clinicians’ perceptions of psychological climate. These findings have important implications for collaboration among supervisors and clinicians within a community mental health organizational context and the provision of EBTs.


Supervisor alliance Clinician alliance Psychological climate Emotional exhaustion 



We also are grateful for the support and collaboration from the Washington State Department of Social and Health Services, Division of Behavioral Health and Recovery and participating mental health organizations across Washington State.


Funding for this study was supported by the National Institute of Mental Health (R01 MH095749; Dorsey, PI). Additionally, the preparation of this article was supported in part by NIMH K01MH100199 awarded to the first author.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict of interest.

Ethics Approval

The University of Washington Institutional Review Board approved this study. All procedures performed were in accordance with the ethical standards of the University of Washington Institutional Review Board.

Informed Consent

Informed consent was obtained from all individual participants included in the study.


  1. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015). Leadership and Organizational Change for Implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10, 1–12.CrossRefGoogle Scholar
  2. Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., Sklar, M., & Horowitz, J. (2017). Discrepancies in leader and follower ratings of transformational leadership: Relationship with organizational culture in mental health. Administration and Policy in Mental Health and Mental Health Services, 44, 480–491.CrossRefGoogle Scholar
  3. Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. L., & Beidas, R. (2016). The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatric Services, 68, 115–122.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Aarons, G. A., Fettes, D. L., Flores, L. E. Jr., & Sommerfled, D. H. (2009). Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy, 47, 954–960.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Aarons, G. A., & Sawitzky, A. C. (2006a). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services, 33, 289–301.CrossRefGoogle Scholar
  6. Aarons, G. A., & Sawtizky, A. C. (2006b). Organizational culture and climate and mental health provider attitudes toward evidence-based practice. Psychological Services, 3, 61–72.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Accurso, E. C., Taylor, R. M., & Garland, A. F. (2011). Evidence-based practices addressed in community-based children’s mental health clinical supervision. Training and Education in Professional Psychology, 5, 88–96.CrossRefPubMedPubMedCentralGoogle Scholar
  8. Arches, J. (1991). Social structure, burnout, and job satisfaction. Social Work, 36, 202–206.PubMedGoogle Scholar
  9. Atwater, L. E., Ostroff, C., Yammarino, F. J., & Fleenor, J. W. (1998). Self-other agreement: Does it really matter? Personnel Psychology, 51, 577–598.CrossRefGoogle Scholar
  10. Atwater, L. E., & Yammarino, F. J. (1997). Does self-other agreement on leadership perceptions moderate the validity of leadership and performance predictions?. Personnel Psychology, 45, 141–164.CrossRefGoogle Scholar
  11. Bakker, A. B., Demerouti, E., & Euwema, M. C. (2005). Job resources buffer the impact of job demands on burnout. Journal of Occupational Health Psychology, 10, 170–180.CrossRefPubMedGoogle Scholar
  12. Baltes, B. B., Zhdanova, L. S., & Parker, C. P. (2009). Psychological climate: A comparison of organizational and individual level referents. Human Relations, 62, 669–700.CrossRefGoogle Scholar
  13. Bearman, S. K., Schneiderman, R. L., & Zoloth, E. (2016). Building an evidence base for effective supervision practices: An analogue experiment of supervision to increase EBT fidelity. Administration and Policy in Mental Health and Mental Health Services Research, 44, 293–307.CrossRefGoogle Scholar
  14. Bearman, S. K., Weisz, J. R., Chorpita, B. F., Hoagwood, K., Ward, A., Ugueto, A. M., & Bernstein, A. & Research Network of Youth Mental Health (2013). More practice, less preach? The role of supervision processes and therapist characteristics in EBP implementation. Administration and Policy in Mental Health and Mental Health Services Research, 40, 518–529.CrossRefPubMedPubMedCentralGoogle Scholar
  15. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17, 1–30.Google Scholar
  16. Beidas, R. S., Williams, N. J., Green, P. D., Aarons, G. A., Becker-Haimes, E. M., Evans, A. C.,… Marcus, S. C. (2016). Concordance between administrator and clinician ratings of organizational culture and climate. Administration and Policy in Mental Health. Scholar
  17. Biemann, T., Cole, M. S., & Voelpel, S. (2012). Within-group agreement: On the use (and misuse) of rWG and rWG(J) in leadership research and some best practice guidelines. The Leadership Quarterly, 23, 66–80.CrossRefGoogle Scholar
  18. Birken, S. A., DiMartino, L. D., Kirk, M. A., Lee, S. D., McClelland, M., & Albert, N. M. (2016). Elaborating on theory with middle managers’ experience implementing healthcare innovations in practice. Implementation Science, 1, 2.Google Scholar
  19. Birken, S. A., Lee, S. D., & Weiner, B. J. (2012). Uncovering middle mangers’ role in healthcare innovation implementation. Implementation Science, 7, 28.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16, 252–260.CrossRefGoogle Scholar
  21. Cohen, J. A., Mannarino, A. P., & Deblinger, E. (2006). Treating trauma and traumatic grief in children and adolescents. New York: Guildford.Google Scholar
  22. Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., Unützer, J., Weisz, J. R., & Garland, A. F. (2013). Improving practice in community-based settings: A randomized trial of supervision—Study protocol. Implementation Science, 8, 1–11.CrossRefGoogle Scholar
  23. Dorsey, S., Pullmann, M. D., Kerns, S. E., Jungbluth, N., Meza, R., Thompson, K., & Berliner, L. (2017). The juggling act of supervision in community mental health: Implications for supporting evidence-based treatment. Administration and Policy in Mental Health and Mental Health Services Research, 44, 838–852.CrossRefPubMedGoogle Scholar
  24. Efstation, J. F., Patton, M. J., & Kardash, C. M. (1990). Measuring the working alliance in counselor supervision. Journal of Counseling Psychology, 37, 322–329.CrossRefGoogle Scholar
  25. Fleenor, J. W., McCauley, C. D., & Brutus, S. (1996). Self-other rating agreement and leader effectiveness. Leadership Quarterly, 7, 487–506.CrossRefGoogle Scholar
  26. Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5, 233–253.CrossRefPubMedGoogle Scholar
  27. Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse & Neglect, 35, 582–591.CrossRefGoogle Scholar
  28. Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22, 401–421.CrossRefGoogle Scholar
  29. Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23, 767–794.CrossRefGoogle Scholar
  30. Glisson, C., Landsverk, J., Schoenwald, S., Kelleher, K., Hoagwood, K. E., Mayberg, S., & Green, P. (2008). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98–113.CrossRefPubMedGoogle Scholar
  31. Gnilka, P. B., Chang, C. Y., & Dew, B. J. (2012). The relationship between supervisee stress, coping resources, the working alliance, and the supervisory working alliance. Journal of Counseling & Development, 90, 63–70.CrossRefGoogle Scholar
  32. Green, A. E., Albanese, B. J., Cafri, G., & Aarons, G. A. (2014). Leadership, organizational climate, and working alliance in a children’s mental health service system. Community Mental Health Journal, 50, 771–777.CrossRefPubMedGoogle Scholar
  33. Green, A. E., Miller, E. A., & Aarons, G. A. (2013). Transformational leadership moderates the relationship between emotional exhaustion and turnover intention among community mental health providers. Community Mental Health Journal, 49, 373–379.CrossRefPubMedGoogle Scholar
  34. Greenson, R. R. (1967). The technique and practice of psychoanalysis. New York: International Universities Press, Inc.Google Scholar
  35. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30, 448–466.CrossRefPubMedPubMedCentralGoogle Scholar
  36. Holloway, E. L. (1979). The effects of conceptual level on clinical hypothesis formation and the supervision interview (Doctoral dissertation, University of Wisconsin, Madison).Google Scholar
  37. Holloway, E. L., & Wampold, B. E. (1983). Patterns of verbal behavior and judgments of satisfaction in the supervision interview. Journal of Counseling Psychology, 30, 227–234.CrossRefGoogle Scholar
  38. Holloway, E. L., & Wampold, B. E. (1984). Dimensions of satisfaction in the supervision interview. Paper presented at the annual meeting of the American Psychological Association, Toronto, Canada.Google Scholar
  39. James, L. R., Choi, C. C., Ko, C. H. E., McNeil, P. K., Minton, M. K., Wright, M. A., & Kim, K. I. (2008). Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17, 5–32.CrossRefGoogle Scholar
  40. Kavanagh, D. J., Spence, S. H., Strong, J., Wilson, J., Sturk, H., & Crow, N. (2003). Supervision practices in allied mental health: Relationships of supervision characteristics to perceived impact and job satisfaction. Mental Health Services Research, 5, 187–195.CrossRefPubMedGoogle Scholar
  41. Kim, H., & Lee, S. Y. (2009). Supervisory communication, burnout, and turnover intention among social workers in health care Settings. Social Work in Health Care, 48, 364–385.CrossRefPubMedGoogle Scholar
  42. Knudsen, H. K., Ducharme, L. J., & Roman, P. M. (2006). Counselor emotional exhaustion and turnover intention in therapeutic communities. Journal of Substance Abuse Treatment, 31, 173–180.CrossRefPubMedGoogle Scholar
  43. Ladany, N., Ellis, M. V., & Friedlander, M. L. (1999). The supervisory working alliance, trainee self-efficacy, and satisfaction. Journal of Counseling and Development, 77, 447–455.CrossRefGoogle Scholar
  44. Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197–209.CrossRefPubMedGoogle Scholar
  45. Liao, E. Y., & Chun, H. (2016). Supervisor monitoring and subordinate innovation. Journal of Organizational Behavior, 37, 168–192.CrossRefGoogle Scholar
  46. Marsh, H. W., Ludtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Koller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, 106–124.CrossRefGoogle Scholar
  47. Maslach, C., & Jackson, S. E. (1981). The measurement of experienced burnout. Journal of Organizational Behavior, 2, 99–113.CrossRefGoogle Scholar
  48. Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach burnout inventory manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press, Inc.Google Scholar
  49. Mena, K. C., & Bailey, J. D. (2007). The effects of the supervisory working alliance on worker outcomes. Journal of Social Service Research, 34, 55–65.CrossRefGoogle Scholar
  50. Morse, G., Salyers, M. P., Rollins, A. L., Monroe-DeVita, M., & Pfahler, C. (2012). Burnout in mental health services: A review of the problem and its remediation. Administration and Policy in Mental Health and Mental Health Services Research, 39, 341–352.CrossRefPubMedPubMedCentralGoogle Scholar
  51. Pepinsky, H. B., & Patton, M. J. (1971). The psychological experiment: A practical accomplishment. New York: Pergamon.Google Scholar
  52. Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879–903.CrossRefPubMedGoogle Scholar
  53. Schoenwald, S. K., Mehta, T. G., Frazier, S. L., & Shernoff, E. S. (2013). Clinical supervision in effectiveness and implementation research. Clinical Psychology Science and Practice, 20, 44–59.CrossRefGoogle Scholar
  54. Shanock, L. R., Baran, B. E., Gentry, W. A., Pattison, S. C., & Heggestad, E. D. (2010). Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 25, 543–554.CrossRefGoogle Scholar
  55. Shanock, L. R., Baran, B. E., Gentry, W. A., Pattison, S. C., & Heggestad, E. D. (2014). Erratum to: Polynomial regression with response surface analysis: A powerful approach for examining moderation and overcoming limitations of difference scores. Journal of Business and Psychology, 29, 161.CrossRefGoogle Scholar
  56. Sterner, W. (2009). Influence of the supervisory working alliance on supervisee work satisfaction and work-related stress. Journal of Mental Health Counseling, 31, 249–263.CrossRefGoogle Scholar
  57. Toegel, G., & Conger, J. A. (2003). 360-degree assessment: Time for reinvention. Learning and Education, 2, 297–311.Google Scholar
  58. Watkins, C. E. Jr. (2014). The supervisory alliance: A half century of theory, practice, and research in critical perspective. American Journal of Psychotherapy, 68, 19–55.PubMedGoogle Scholar
  59. Webster, L., & Hackett, R. K. (1999). Burnout and leadership in community mental health systems. Administration and Policy in Mental Health, 26, 387–399.CrossRefPubMedGoogle Scholar
  60. Zhang, X., & Bartol, K. M. (2010). Linking empowering leadership and employee creativity: The influence of psychological empowerment, intrinsic motivation, and creative process engagement. Academy of Management Journal, 53, 107–128.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2017

Authors and Affiliations

  1. 1.University of WashingtonSeattleUSA
  2. 2.Virginia Commonwealth UniversityRichmondUSA
  3. 3.University of DenverDenverUSA

Personalised recommendations