Advertisement

Advances in Health Sciences Education

, Volume 24, Issue 1, pp 167–183 | Cite as

Training transfer: a systematic review of the impact of inner setting factors

  • Carrie B. JacksonEmail author
  • Laurel A. Brabson
  • Lauren B. Quetsch
  • Amy D. Herschell
Review

Abstract

Consistent with Baldwin and Ford’s model (Pers Psychol 41(1):63–105, 1988), training transfer is defined as the generalization of learning from a training to everyday practice in the workplace. The purpose of this review was to examine the influence of work-environment factors, one component of the model hypothesized to influence training transfer within behavioral health. An electronic literature search guided by the Consolidated Framework for Implementation Research’s inner setting domain was conducted was conducted on Medline OVID, Medline EMBASE, and PsycINFO databases. Of 9184 unique articles, 169 full-text versions of articles were screened for eligibility, yielding 26 articles meeting inclusion criteria. Results from the 26 studies revealed that overall, having more positive networks and communication, culture, implementation climate, and readiness for implementation can facilitate training transfer. Although few studies have examined the impact of inner setting factors on training transfer, these results suggest organizational context is important to consider with training efforts. These findings have important implications for individuals in the broader health professions educational field.

Keywords

Training Implementation science Inner setting Evidence-based treatments 

References

  1. Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23.  https://doi.org/10.1007/s10488-010-0327-7.Google Scholar
  2. Adler, G., Pritchett, L. R., Kauth, M. R., & Nadorff, D. (2014). A pilot project to improve access to telepsychotherapy at rural clinics. Telemedicine Journal and E-Health: The Official Journal of the American Telemedicine Association, 20(1), 83–85.  https://doi.org/10.1089/tmj.2013.0085.Google Scholar
  3. Arthur, W., Jr., Bennett, W., Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234–245.  https://doi.org/10.1037/0021-9010.88.2.234.Google Scholar
  4. Asgary-Eden, V., & Lee, C. M. (2012). Implementing an evidence-based parenting program in community agencies: What helps and what gets in the way? Administration and Policy in Mental Health and Mental Health Services Research, 39(6), 478–488.  https://doi.org/10.1007/s10488-011-0371-y.Google Scholar
  5. Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41(1), 63–105.Google Scholar
  6. Bass, B., & Avolio, B. (1995). MLQ multifactor leadership questionnaire. Menlo Park: Mind Garden.Google Scholar
  7. Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research.  https://doi.org/10.1007/s10488-013-0529-x.Google Scholar
  8. Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665.  https://doi.org/10.1176/appi.ps.201100401.Google Scholar
  9. Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30.  https://doi.org/10.1111/j.1468-2850.2009.01187.x.Google Scholar
  10. Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic. Review..  https://doi.org/10.1177/0149206309352880.Google Scholar
  11. Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014a). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal.  https://doi.org/10.1155/2014/802983.Google Scholar
  12. Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014b). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal, 2014, 802983.  https://doi.org/10.1155/2014/802983.Google Scholar
  13. Bride, B. E., Abraham, A. J., & Roman, P. M. (2011). Organizational factors associated with the use of contingency management in publicly funded substance abuse treatment centers. Journal of Substance Abuse Treatment, 40(1), 87–94.  https://doi.org/10.1016/j.jsat.2010.08.001.Google Scholar
  14. Cook, J. M., Dinnen, S., Coyne, J. C., Thompson, R., Simiola, V., Ruzek, J., et al. (2015). Evaluation of an implementation model: A national investigation of VA residential programs. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 147–156.  https://doi.org/10.1007/s10488-014-0555-3.Google Scholar
  15. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science.  https://doi.org/10.1186/1748-5908-4-50.Google Scholar
  16. Damschroder, L. J., Goodrich, D. E., Robinson, C. H., Fletcher, C. E., & Lowery, J. C. (2011). A systematic exploration of differences in contextual factors related to implementing the MOVE! weight management program in VA: A mixed methods study. BMC Health Services Research, 11, 248.  https://doi.org/10.1186/1472-6963-11-248.Google Scholar
  17. Damschroder, L. J., & Lowery, J. C. (2013). Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implementation Science, 8(1), 51.  https://doi.org/10.1186/1748-5908-8-51.Google Scholar
  18. Ditty, M. S., Landes, S. J., Doyle, A., & Beidas, R. S. (2015). It takes a village: A mixed method analysis of inner setting variables and dialectical behavior therapy implementation. Administration and Policy In Mental Health, 42(6), 672–681.  https://doi.org/10.1007/s10488-014-0602-0.Google Scholar
  19. Gifford, E., Tavakoli, S., Wisdom, J., & Hamlett-Berry, K. (2015). Implementation of smoking cessation treatment in VHA substance use disorder residential treatment programs. Psychiatric Services, 66(3), 295–302.  https://doi.org/10.1176/appi.ps.201400008.Google Scholar
  20. Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.Google Scholar
  21. Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect, 35(8), 582–591.  https://doi.org/10.1016/j.chiabu.2011.04.009.Google Scholar
  22. Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse and Neglect, 22(5), 401–421.Google Scholar
  23. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.Google Scholar
  24. Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., & Mayberg, S. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy In Mental Health, 35(1–2), 124–133.  https://doi.org/10.1007/s10488-007-0152-9.Google Scholar
  25. Glisson, C., & Williams, N. J. (2015). Assessing and changing organizational social contexts for effective mental health services. Annual Review of Public Health, 36(1), 507–523.  https://doi.org/10.1146/annurev-publhealth-031914-122435.Google Scholar
  26. Green, A. E., Albanese, B. J., Cafri, G., & Aarons, G. A. (2014). Leadership, organizational climate, and working alliance in a children’s mental health service system. Community Mental Health Journal, 50(7), 771–777.  https://doi.org/10.1007/s10597-013-9668-5.Google Scholar
  27. Greener, J. M., Joe, G. W., Simpson, D. D., Rowan-Szal, G. A., & Lehman, W. E. K. (2007). Influence of organizational functioning on client engagement in treatment. Journal of Substance Abuse Treatment, 33(2), 139–147.  https://doi.org/10.1016/j.jsat.2006.12.025.Google Scholar
  28. Grossman, R., & Salas, E. (2011). The transfer of training: What really matters. International Journal of Training and Development, 15(2), 103–120.  https://doi.org/10.1111/j.1468-2419.2011.00373.x.Google Scholar
  29. Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 72–92.Google Scholar
  30. Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69(1), 32–40.Google Scholar
  31. Hamblen, J. L., Bernardy, N. C., Sherrieb, K., Norris, F. H., Cook, J. M., Louis, C. A., et al. (2015). VA PTSD clinic director perspectives: How perceptions of readiness influence delivery of evidence-based PTSD treatment. Professional Psychology: Research and Practice, 46(2), 90–96.  https://doi.org/10.1037/a0038535.Google Scholar
  32. Hanbury, A. (2013). The relative influence of team climate, team norms and social network norms on health professionals’ implementation of a national recommendation to offer service-users diagnosed with schizophrenia family intervention therapy. Psychology, Health and Medicine, 18(5), 619–625.  https://doi.org/10.1080/13548506.2013.764459.Google Scholar
  33. Harned, M. S., Dimeff, L. A., Woodcock, E. A., & Contreras, I. (2013). Predicting adoption of exposure therapy in a randomized controlled dissemination trial. Journal of Anxiety Disorders, 27(8), 754–762.  https://doi.org/10.1016/j.janxdis.2013.02.006.Google Scholar
  34. Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466.  https://doi.org/10.1016/j.cpr.2010.02.005.Google Scholar
  35. James, L. R., & Sells, S. B. (1981). Psychological climate: Theoretical perspectives and empirical research. In: Toward a psychology of situations: An interactional perspective, pp. 275–295.Google Scholar
  36. Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. The American Psychologist, 63(3), 146–159.  https://doi.org/10.1037/0003-066X.63.3.146.Google Scholar
  37. Lehman, W. E., Greener, J. M., Rowan-Szal, G. A., & Flynn, P. M. (2012). Organizational readiness for change in correctional and community substance abuse programs. Journal of Offender Rehabilitation, 51(1–2), 96–114.Google Scholar
  38. Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209.  https://doi.org/10.1016/S0740-5472(02)00233-7.Google Scholar
  39. Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 324–334.  https://doi.org/10.1007/s10488-011-0348-x.Google Scholar
  40. Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., et al. (2015). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10(1), 2.  https://doi.org/10.1186/s13012-014-0193-x.Google Scholar
  41. Lundgren, L., Amodeo, M., Chassler, D., Krull, I., & Sullivan, L. (2013). Organizational readiness for change in community-based addiction treatment programs and adherence in implementing evidence-based practices: A national study. Journal of Substance Abuse Treatment, 45(5), 457–465.  https://doi.org/10.1016/j.jsat.2013.06.007.Google Scholar
  42. Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., et al. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60(2), 189–195.  https://doi.org/10.1176/appi.ps.60.2.189.Google Scholar
  43. Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9, 118.  https://doi.org/10.1186/s13012-014-0118-8.Google Scholar
  44. Muilenburg, J. L., Laschober, T. C., & Eby, L. T. (2014). Organizational factors as predictors of tobacco cessation pharmacotherapy adoption in addiction treatment programs. Journal of Addiction Medicine, 8(1), 59–65.  https://doi.org/10.1097/ADM.0000000000000008.Google Scholar
  45. Nelson, T. D., & Steele, R. G. (2007). Predictors of practitioner self-reported use of evidence-based practices: practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 319–330.  https://doi.org/10.1007/s10488-006-0111-x.Google Scholar
  46. Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52(10), 1009–1025.  https://doi.org/10.1016/j.jaac.2013.07.012.Google Scholar
  47. Patterson Silver Wolf, D. A. (2015). Factors influencing the implementation of a brief alcohol screening and educational intervention in social settings not specializing in addiction services. Social Work in Health Care, 54(4), 345–364.  https://doi.org/10.1080/00981389.2015.1005270.Google Scholar
  48. Powell, B. J., Proctor, E. K., & Glass, J. E. (2014). A systematic review of strategies for implementing empirically supported mental health interventions. Research on Social Work Practice, 24(2), 192–212.Google Scholar
  49. Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the expert recommendations for implementing change (ERIC) project. Implementation Science, 10(1), 21.  https://doi.org/10.1186/s13012-015-0209-1.Google Scholar
  50. Reiter, J. T., Dobmeyer, A. C., & Hunter, C. L. (2018). The primary care behavioral health (PCBH) model: An overview and operational definition. Journal of Clinical Psychology in Medical Settings, 25, 109–126. (online access).Google Scholar
  51. Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Administration and Policy In Mental Health, 35(5), 379–394.  https://doi.org/10.1007/s10488-008-0181-z.Google Scholar
  52. Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38(1), 91–105.  https://doi.org/10.1080/15374410802575388.Google Scholar
  53. Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5(4), 223–239.Google Scholar
  54. Substance Abuse and Mental Health Services Administration [SAMHSA]. (2017). Behavioral health treatments and services. Retrieved from https://www.samhsa.gov/treatment. Accessed 17 May 2018.
  55. Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337–350.Google Scholar
  56. Taxman, F. S., Cropsey, K. L., Melnick, G., & Perdoni, M. L. (2008). COD services in community correctional settings: An examination of organizational factors that affect service delivery. Behavioral Sciences & the Law, 26(4), 435–455.  https://doi.org/10.1002/bsl.830.Google Scholar
  57. Wandersman, A., Chien, V. H., & Katz, J. (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology, 50(3–4), 445–459.  https://doi.org/10.1007/s10464-012-9509-7.Google Scholar

Copyright information

© Springer Nature B.V. 2018

Authors and Affiliations

  • Carrie B. Jackson
    • 1
    Email author
  • Laurel A. Brabson
    • 1
  • Lauren B. Quetsch
    • 1
  • Amy D. Herschell
    • 1
  1. 1.West Virginia UniversityMorgantownUSA

Personalised recommendations