Training transfer: a systematic review of the impact of inner setting factors
Abstract
Consistent with Baldwin and Ford’s model (Pers Psychol 41(1):63–105, 1988), training transfer is defined as the generalization of learning from a training to everyday practice in the workplace. The purpose of this review was to examine the influence of work-environment factors, one component of the model hypothesized to influence training transfer within behavioral health. An electronic literature search guided by the Consolidated Framework for Implementation Research’s inner setting domain was conducted was conducted on Medline OVID, Medline EMBASE, and PsycINFO databases. Of 9184 unique articles, 169 full-text versions of articles were screened for eligibility, yielding 26 articles meeting inclusion criteria. Results from the 26 studies revealed that overall, having more positive networks and communication, culture, implementation climate, and readiness for implementation can facilitate training transfer. Although few studies have examined the impact of inner setting factors on training transfer, these results suggest organizational context is important to consider with training efforts. These findings have important implications for individuals in the broader health professions educational field.
Keywords
Training Implementation science Inner setting Evidence-based treatmentsReferences
- Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7.Google Scholar
- Adler, G., Pritchett, L. R., Kauth, M. R., & Nadorff, D. (2014). A pilot project to improve access to telepsychotherapy at rural clinics. Telemedicine Journal and E-Health: The Official Journal of the American Telemedicine Association, 20(1), 83–85. https://doi.org/10.1089/tmj.2013.0085.Google Scholar
- Arthur, W., Jr., Bennett, W., Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88(2), 234–245. https://doi.org/10.1037/0021-9010.88.2.234.Google Scholar
- Asgary-Eden, V., & Lee, C. M. (2012). Implementing an evidence-based parenting program in community agencies: What helps and what gets in the way? Administration and Policy in Mental Health and Mental Health Services Research, 39(6), 478–488. https://doi.org/10.1007/s10488-011-0371-y.Google Scholar
- Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41(1), 63–105.Google Scholar
- Bass, B., & Avolio, B. (1995). MLQ multifactor leadership questionnaire. Menlo Park: Mind Garden.Google Scholar
- Beidas, R. S., Edmunds, J., Ditty, M., Watkins, J., Walsh, L., Marcus, S., et al. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety? Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-013-0529-x.Google Scholar
- Beidas, R. S., Edmunds, J. M., Marcus, S. C., & Kendall, P. C. (2012). Training and consultation to promote implementation of an empirically supported treatment: A randomized trial. Psychiatric Services, 63(7), 660–665. https://doi.org/10.1176/appi.ps.201100401.Google Scholar
- Beidas, R. S., & Kendall, P. C. (2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. https://doi.org/10.1111/j.1468-2850.2009.01187.x.Google Scholar
- Blume, B. D., Ford, J. K., Baldwin, T. T., & Huang, J. L. (2010). Transfer of training: A meta-analytic. Review.. https://doi.org/10.1177/0149206309352880.Google Scholar
- Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014a). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal. https://doi.org/10.1155/2014/802983.Google Scholar
- Bonham, C. A., Sommerfeld, D., Willging, C., & Aarons, G. A. (2014b). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal, 2014, 802983. https://doi.org/10.1155/2014/802983.Google Scholar
- Bride, B. E., Abraham, A. J., & Roman, P. M. (2011). Organizational factors associated with the use of contingency management in publicly funded substance abuse treatment centers. Journal of Substance Abuse Treatment, 40(1), 87–94. https://doi.org/10.1016/j.jsat.2010.08.001.Google Scholar
- Cook, J. M., Dinnen, S., Coyne, J. C., Thompson, R., Simiola, V., Ruzek, J., et al. (2015). Evaluation of an implementation model: A national investigation of VA residential programs. Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 147–156. https://doi.org/10.1007/s10488-014-0555-3.Google Scholar
- Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science. https://doi.org/10.1186/1748-5908-4-50.Google Scholar
- Damschroder, L. J., Goodrich, D. E., Robinson, C. H., Fletcher, C. E., & Lowery, J. C. (2011). A systematic exploration of differences in contextual factors related to implementing the MOVE! weight management program in VA: A mixed methods study. BMC Health Services Research, 11, 248. https://doi.org/10.1186/1472-6963-11-248.Google Scholar
- Damschroder, L. J., & Lowery, J. C. (2013). Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implementation Science, 8(1), 51. https://doi.org/10.1186/1748-5908-8-51.Google Scholar
- Ditty, M. S., Landes, S. J., Doyle, A., & Beidas, R. S. (2015). It takes a village: A mixed method analysis of inner setting variables and dialectical behavior therapy implementation. Administration and Policy In Mental Health, 42(6), 672–681. https://doi.org/10.1007/s10488-014-0602-0.Google Scholar
- Gifford, E., Tavakoli, S., Wisdom, J., & Hamlett-Berry, K. (2015). Implementation of smoking cessation treatment in VHA substance use disorder residential treatment programs. Psychiatric Services, 66(3), 295–302. https://doi.org/10.1176/appi.ps.201400008.Google Scholar
- Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.Google Scholar
- Glisson, C., & Green, P. (2011). Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect, 35(8), 582–591. https://doi.org/10.1016/j.chiabu.2011.04.009.Google Scholar
- Glisson, C., & Hemmelgarn, A. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse and Neglect, 22(5), 401–421.Google Scholar
- Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.Google Scholar
- Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., & Mayberg, S. (2008). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy In Mental Health, 35(1–2), 124–133. https://doi.org/10.1007/s10488-007-0152-9.Google Scholar
- Glisson, C., & Williams, N. J. (2015). Assessing and changing organizational social contexts for effective mental health services. Annual Review of Public Health, 36(1), 507–523. https://doi.org/10.1146/annurev-publhealth-031914-122435.Google Scholar
- Green, A. E., Albanese, B. J., Cafri, G., & Aarons, G. A. (2014). Leadership, organizational climate, and working alliance in a children’s mental health service system. Community Mental Health Journal, 50(7), 771–777. https://doi.org/10.1007/s10597-013-9668-5.Google Scholar
- Greener, J. M., Joe, G. W., Simpson, D. D., Rowan-Szal, G. A., & Lehman, W. E. K. (2007). Influence of organizational functioning on client engagement in treatment. Journal of Substance Abuse Treatment, 33(2), 139–147. https://doi.org/10.1016/j.jsat.2006.12.025.Google Scholar
- Grossman, R., & Salas, E. (2011). The transfer of training: What really matters. International Journal of Training and Development, 15(2), 103–120. https://doi.org/10.1111/j.1468-2419.2011.00373.x.Google Scholar
- Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 72–92.Google Scholar
- Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69(1), 32–40.Google Scholar
- Hamblen, J. L., Bernardy, N. C., Sherrieb, K., Norris, F. H., Cook, J. M., Louis, C. A., et al. (2015). VA PTSD clinic director perspectives: How perceptions of readiness influence delivery of evidence-based PTSD treatment. Professional Psychology: Research and Practice, 46(2), 90–96. https://doi.org/10.1037/a0038535.Google Scholar
- Hanbury, A. (2013). The relative influence of team climate, team norms and social network norms on health professionals’ implementation of a national recommendation to offer service-users diagnosed with schizophrenia family intervention therapy. Psychology, Health and Medicine, 18(5), 619–625. https://doi.org/10.1080/13548506.2013.764459.Google Scholar
- Harned, M. S., Dimeff, L. A., Woodcock, E. A., & Contreras, I. (2013). Predicting adoption of exposure therapy in a randomized controlled dissemination trial. Journal of Anxiety Disorders, 27(8), 754–762. https://doi.org/10.1016/j.janxdis.2013.02.006.Google Scholar
- Herschell, A. D., Kolko, D. J., Baumann, B. L., & Davis, A. C. (2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005.Google Scholar
- James, L. R., & Sells, S. B. (1981). Psychological climate: Theoretical perspectives and empirical research. In: Toward a psychology of situations: An interactional perspective, pp. 275–295.Google Scholar
- Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. The American Psychologist, 63(3), 146–159. https://doi.org/10.1037/0003-066X.63.3.146.Google Scholar
- Lehman, W. E., Greener, J. M., Rowan-Szal, G. A., & Flynn, P. M. (2012). Organizational readiness for change in correctional and community substance abuse programs. Journal of Offender Rehabilitation, 51(1–2), 96–114.Google Scholar
- Lehman, W. E. K., Greener, J. M., & Simpson, D. D. (2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22(4), 197–209. https://doi.org/10.1016/S0740-5472(02)00233-7.Google Scholar
- Lewis, C. C., & Simons, A. D. (2011). A pilot study disseminating cognitive behavioral therapy for depression: Therapist factors and perceptions of barriers to implementation. Administration and Policy in Mental Health and Mental Health Services Research, 38(4), 324–334. https://doi.org/10.1007/s10488-011-0348-x.Google Scholar
- Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., et al. (2015). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10(1), 2. https://doi.org/10.1186/s13012-014-0193-x.Google Scholar
- Lundgren, L., Amodeo, M., Chassler, D., Krull, I., & Sullivan, L. (2013). Organizational readiness for change in community-based addiction treatment programs and adherence in implementing evidence-based practices: A national study. Journal of Substance Abuse Treatment, 45(5), 457–465. https://doi.org/10.1016/j.jsat.2013.06.007.Google Scholar
- Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., et al. (2009). Assertive community treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60(2), 189–195. https://doi.org/10.1176/appi.ps.60.2.189.Google Scholar
- Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9, 118. https://doi.org/10.1186/s13012-014-0118-8.Google Scholar
- Muilenburg, J. L., Laschober, T. C., & Eby, L. T. (2014). Organizational factors as predictors of tobacco cessation pharmacotherapy adoption in addiction treatment programs. Journal of Addiction Medicine, 8(1), 59–65. https://doi.org/10.1097/ADM.0000000000000008.Google Scholar
- Nelson, T. D., & Steele, R. G. (2007). Predictors of practitioner self-reported use of evidence-based practices: practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34(4), 319–330. https://doi.org/10.1007/s10488-006-0111-x.Google Scholar
- Novins, D. K., Green, A. E., Legha, R. K., & Aarons, G. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52(10), 1009–1025. https://doi.org/10.1016/j.jaac.2013.07.012.Google Scholar
- Patterson Silver Wolf, D. A. (2015). Factors influencing the implementation of a brief alcohol screening and educational intervention in social settings not specializing in addiction services. Social Work in Health Care, 54(4), 345–364. https://doi.org/10.1080/00981389.2015.1005270.Google Scholar
- Powell, B. J., Proctor, E. K., & Glass, J. E. (2014). A systematic review of strategies for implementing empirically supported mental health interventions. Research on Social Work Practice, 24(2), 192–212.Google Scholar
- Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the expert recommendations for implementing change (ERIC) project. Implementation Science, 10(1), 21. https://doi.org/10.1186/s13012-015-0209-1.Google Scholar
- Reiter, J. T., Dobmeyer, A. C., & Hunter, C. L. (2018). The primary care behavioral health (PCBH) model: An overview and operational definition. Journal of Clinical Psychology in Medical Settings, 25, 109–126. (online access).Google Scholar
- Schoenwald, S. K., Carter, R. E., Chapman, J. E., & Sheidow, A. J. (2008). Therapist adherence and organizational effects on change in youth behavior problems one year after multisystemic therapy. Administration and Policy In Mental Health, 35(5), 379–394. https://doi.org/10.1007/s10488-008-0181-z.Google Scholar
- Schoenwald, S. K., Chapman, J. E., Sheidow, A. J., & Carter, R. E. (2009). Long-term youth criminal outcomes in MST transport: The impact of therapist adherence and organizational climate and structure. Journal of Clinical Child and Adolescent Psychology, 38(1), 91–105. https://doi.org/10.1080/15374410802575388.Google Scholar
- Schoenwald, S. K., Sheidow, A. J., Letourneau, E. J., & Liao, J. G. (2003). Transportability of multisystemic therapy: Evidence for multilevel influences. Mental Health Services Research, 5(4), 223–239.Google Scholar
- Substance Abuse and Mental Health Services Administration [SAMHSA]. (2017). Behavioral health treatments and services. Retrieved from https://www.samhsa.gov/treatment. Accessed 17 May 2018.
- Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337–350.Google Scholar
- Taxman, F. S., Cropsey, K. L., Melnick, G., & Perdoni, M. L. (2008). COD services in community correctional settings: An examination of organizational factors that affect service delivery. Behavioral Sciences & the Law, 26(4), 435–455. https://doi.org/10.1002/bsl.830.Google Scholar
- Wandersman, A., Chien, V. H., & Katz, J. (2012). Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. American Journal of Community Psychology, 50(3–4), 445–459. https://doi.org/10.1007/s10464-012-9509-7.Google Scholar