Advertisement

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

  • Cole HooleyEmail author
  • Takashi Amano
  • Lara Markovitz
  • Lauren Yaeger
  • Enola Proctor
Original Article

Abstract

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.’s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17–100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Keywords

Implementation strategies Reporting Mental health 

Abbreviations

CONSORT

Consolidated Standards of Reporting Trials

StaRI

Standards for Reporting Implementation Studies

TIDieR

Template for intervention description and replication

WIDER

Workgroup for Intervention Development and Evaluation Research

Notes

Funding

CH and LM were supported by NIMH T32 MH019960. EP is supported by NIMH R25 MH080916-09 and NIH NCATS 1620-87686.

Compliance with Ethical Standards

Conflict of interest

EP is the lead author of the implementation strategy reporting recommendations on which this study is based.

Research Involving Human Participants and/or Animals

This article does not contain any studies with human participants performed by any of the authors.

Supplementary material

10488_2019_965_MOESM1_ESM.docx (19 kb)
Title: Search strategy word document and inclusion/exclusion criteria. Description: This file contains the full search strategies we used to obtain our initial sample of articles. This file also contains a table outlining the inclusion/exclusion criteria we used to assess the articles. (DOCX 18 kb)
10488_2019_965_MOESM2_ESM.docx (18 kb)
Title: Example of an implementation strategy recommendation reporting table. Description: This file provides an example of an abbreviated implementation strategy reporting table. (DOCX 18 kb)

References

  1. Academy Health. (2017). 10th annual conference on the science of dissemination and implementation health: A decade of progress and the path forward. Retrieved from https://www.academyhealth.org/events/site/10th-annual-conference-science-dissemination-and-implementation-health.
  2. Accurso, E. C., Astrachan-Fletcher, E., O’Brien, S., McClanahan, S. F., & Le Grange, D. (2018). Adaptation and implementation of family-based treatment enhanced with dialectical behavior therapy skills for anorexia nervosa in community-based specialist clinics. Eating Disorders, 26(2), 149–163.  https://doi.org/10.1080/10640266.2017.1330319.CrossRefPubMedGoogle Scholar
  3. Acri, M., Hamovitch, E., Mini, M., Garay, E., Connolly, C., & McKay, M. (2017). Testing the 4Rs and 2Ss Multiple Family Group intervention: Study protocol for a randomized controlled trial. Trials, 18(1), 588.  https://doi.org/10.1186/s13063-017-2331-7.CrossRefPubMedPubMedCentralGoogle Scholar
  4. Albrecht, L., Archibald, M., Arseneau, D., & Scott, S. D. (2013). Development of a checklist to assess the quality of reporting of knowledge translation interventions using the Workgroup for Intervention Development and Evaluation Research (WIDER) recommendations. Implementation Science, 8, 52.  https://doi.org/10.1186/1748-5908-8-52.CrossRefPubMedGoogle Scholar
  5. Altman, D. G., & Moher, D. (2014). Importance of transparent reporting of health research. In D. Moher, D. G. Altman, K. Schulz, I. Simera, & E. Wager (Eds.), Guidelines for reporting health research: A user’s manual (pp. 1–13). Hoboken, NJ: Wiley-Blackwell.  https://doi.org/10.1002/9781118715598.ch1.CrossRefGoogle Scholar
  6. Amaya-Jackson, L., Hagele, D., Sideris, J., Potter, D., Briggs, E. C., Keen, L., et al. (2018). Pilot to policy: Statewide dissemination and implementation of evidence-based treatment for traumatized youth. BMC Health Services Research, 18(1), 589.  https://doi.org/10.1186/s12913-018-3395-0.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Aragonès, E., Palao, D., López-Cortacans, G., Caballero, A., Cardoner, N., Casaus, P., et al. (2017). Development and assessment of an active strategy for the implementation of a collaborative care approach for depression in primary care (the INDI·i project). BMC Health Services Research, 17(1), 821.  https://doi.org/10.1186/s12913-017-2774-2.CrossRefPubMedPubMedCentralGoogle Scholar
  8. Arksey, H., & O’Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32.  https://doi.org/10.1080/1364557032000119616.CrossRefGoogle Scholar
  9. Auslander, W., McGinnis, H., Tlapek, S., Smith, P., Foster, A., Edmond, T., et al. (2017). Adaptation and implementation of a trauma-focused cognitive behavioral intervention for girls in child welfare. American Journal of Orthopsychiatry, 87(3), 206–215.  https://doi.org/10.1037/ort0000233.CrossRefPubMedGoogle Scholar
  10. Barac, R., Kimber, M., Johnson, S., & Barwick, M. (2018). The effectiveness of consultation for clinicians learning to deliver motivational interviewing with fidelity. Journal of Evidence-Informed Social Work, 15(5), 510–533.  https://doi.org/10.1080/23761407.2018.1480988.CrossRefPubMedGoogle Scholar
  11. Barwick, M., Barac, R., Kimber, M., Akrong, L., Johnson, S. N., Cunningham, C. E., et al. (2019). Advancing implementation frameworks with a mixed methods case study in child behavioral health. Translational Behavioral Medicine.  https://doi.org/10.1093/TBM/IBZ005.CrossRefPubMedGoogle Scholar
  12. Bath, F. J., Owen, V. E., & Bath, P. M. (1998). Quality of full and final publications reporting acute stroke trials: A systematic review. Stroke, 29(10), 2203–2210.  https://doi.org/10.1161/01.STR.29.10.2203.CrossRefPubMedGoogle Scholar
  13. Begg, C., Cho, M., Eastwood, S., Horton, R., Moher, D., Olkin, I., et al. (1996). Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA, 276(8), 637–639.  https://doi.org/10.1001/jama.1996.03540080059030.CrossRefGoogle Scholar
  14. Bitter, N., Roeg, D., Van Nieuwenhuizen, C., & Van Weeghel, J. (2019). Training professionals in a recovery-oriented methodology: A mixed method evaluation. Scandinavian Journal of Caring Sciences, 33(2), 457–466.  https://doi.org/10.1111/scs.12644.CrossRefPubMedGoogle Scholar
  15. Boyd, M. R., Powell, B. J., Endicott, D., & Lewis, C. C. (2018). A method for tracking implementation strategies: An exemplar implementing measurement-based care in community behavioral health clinics. Behavior Therapy, 49(4), 525–537.  https://doi.org/10.1016/j.beth.2017.11.012.CrossRefPubMedGoogle Scholar
  16. Breithaupt, L., Eickman, L., Byrne, C. E., & Fischer, S. (2019). REbeL peer education: A model of a voluntary, after-school program for eating disorder prevention. Eating Behaviors, 32, 111–116.  https://doi.org/10.1016/j.eatbeh.2016.10.010.CrossRefPubMedGoogle Scholar
  17. Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. (2017). Tracking implementation strategies: A description of a practical approach and early findings. Health Research Policy and Systems, 15, 15.  https://doi.org/10.1186/s12961-017-0175-y.CrossRefPubMedPubMedCentralGoogle Scholar
  18. Byatt, N., Biebel, K., Moore Simas, T. A., Sarvet, B., Ravech, M., Allison, J., et al. (2016). Improving perinatal depression care: The Massachusetts child psychiatry access project for moms. General Hospital Psychiatry, 40, 12–17.  https://doi.org/10.1016/j.genhosppsych.2016.03.002.CrossRefPubMedGoogle Scholar
  19. Chung, H., Duffy, F. F., Katzelnick, D. J., Williams, M. D., Trivedi, M. H., Rae, D. S., et al. (2013). Sustaining practice change one year after completion of the National Depression Management Leadership initiative. Psychiatric Services, 64(7), 703–706.  https://doi.org/10.1176/appi.ps.201200227.CrossRefPubMedGoogle Scholar
  20. Clossey, L., Simms, S., Hu, C., Hartzell, J., Duah, P., & Daniels, L. (2018). A pilot evaluation of the rapid response program: A home based family therapy. Community Mental Health Journal, 54(3), 302–311.  https://doi.org/10.1007/s10597-018-0231-2.CrossRefPubMedGoogle Scholar
  21. Cohen, J. A., Mannarino, A. P., Jankowski, K., Rosenberg, S., Kodya, S., & Wolford, G. L. (2016). A randomized implementation study of Trauma-Focused Cognitive Behavioral Therapy for adjudicated teens in residential treatment facilities. Child Maltreatment, 21(2), 156–167.  https://doi.org/10.1177/1077559515624775.CrossRefPubMedPubMedCentralGoogle Scholar
  22. Colquhoun, H., Leeman, J., Michie, S., Lokker, C., Bragge, P., Hempel, S., et al. (2014). Towards a common terminology: A simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implementation Science, 9, 781.  https://doi.org/10.1186/1748-5908-9-51.CrossRefGoogle Scholar
  23. Cucciare, M. A., Curran, G. M., Craske, M. G., Abraham, T., McCarthur, M. B., Marchant-Miros, K., et al. (2016). Assessing fidelity of cognitive behavioral therapy in rural VA clinics: Design of a randomized implementation effectiveness (hybrid type III) trial. Implementation Science, 11, 65.  https://doi.org/10.1186/s13012-016-0432-4.CrossRefPubMedGoogle Scholar
  24. Cully, J. A., Armento, M. E. A., Mott, J., Nadorff, M. R., Naik, A. D., Stanley, M. A., et al. (2012). Brief cognitive behavioral therapy in primary care: A hybrid type 2 patient-randomized effectiveness-implementation design. Implementation Science, 7(1), 64.  https://doi.org/10.1186/1748-5908-7-64.CrossRefPubMedGoogle Scholar
  25. Cully, J. A., Breland, J. Y., Robertson, S., Utech, A. E., Hundt, N., Kunik, M. E., et al. (2014). Behavioral health coaching for rural veterans with diabetes and depression: A patient randomized effectiveness implementation trial. BMC Health Services Research, 14(1), 191.  https://doi.org/10.1186/1472-6963-14-191.CrossRefPubMedPubMedCentralGoogle Scholar
  26. Cully, J. A., Teten, A. L., Benge, J. F., Sorocco, K. H., & Kauth, M. R. (2010). Multidisciplinary cognitive-behavioral therapy training for the Veterans Affairs primary care setting. The Primary Care Companion to The Journal of Clinical Psychiatry, 12(3), e1–e8.  https://doi.org/10.4088/PCC.09m00838blu.CrossRefGoogle Scholar
  27. Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50(3), 217–226.  https://doi.org/10.1097/MLR.0b013e3182408812.CrossRefPubMedPubMedCentralGoogle Scholar
  28. Dorsey, S., Pullmann, M. D., Deblinger, E., Berliner, L., Kerns, S. E., Thompson, K., et al. (2013). Improving practice in community-based settings: A randomized trial of supervision – study protocol. Implementation Science, 8(1), 89.  https://doi.org/10.1186/1748-5908-8-89.CrossRefPubMedGoogle Scholar
  29. Durbin, J., Selick, A., Hierlihy, D., Moss, S., & Cheng, C. (2016). A first step in system improvement: A survey of early psychosis intervention programmes in Ontario. Early Intervention in Psychiatry, 10(6), 485–493.  https://doi.org/10.1111/eip.12201.CrossRefPubMedGoogle Scholar
  30. Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1, 1.  https://doi.org/10.1186/1748-5908-1-4.CrossRefPubMedCentralGoogle Scholar
  31. Egeland, K. M., Ruud, T., Ogden, T., Färdig, R., Lindstrøm, J. C., & Heiervang, K. S. (2017). How to implement Illness Management and Recovery (IMR) in mental health service settings: Evaluation of the implementation strategy. International Journal of Mental Health Systems, 11, 13.  https://doi.org/10.1186/s13033-017-0120-z.CrossRefPubMedPubMedCentralGoogle Scholar
  32. Egeland, K. M., Skar, A.-M. S., Endsjø, M., Laukvik, E. H., Bækkelund, H., Babaii, A., et al. (2019). Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: A stepped-wedge cluster randomized design study protocol. Implementation Science, 14(1), 28.  https://doi.org/10.1186/s13012-019-0873-7.CrossRefPubMedGoogle Scholar
  33. Eiraldi, R., Khanna, M. S., Jawad, A. F., Fishman, J., Glick, H. A., Schwartz, B. S., et al. (2016). A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: Rationale, design, and methods. Implementation Science, 11(1), 92.  https://doi.org/10.1186/s13012-016-0453-z.CrossRefGoogle Scholar
  34. EQUATOR. (2019). Case studies: How journals implement reporting guidelines. Retrieved from http://www.equator-network.org/toolkits/using-guidelines-in-journals/case-studies-how-journals-implement-reporting-guidelines/.
  35. Equator Network. (2018). Search for reporting guidelines. Retrieved from https://www.equator-network.org/reporting-guidelines.
  36. Fortney, J., Enderle, M., McDougall, S., Clothier, J., Otero, J., Altman, L., et al. (2012). Implementation outcomes of evidence-based quality improvement for depression in VA community based outpatient clinics. Implementation Science, 7(1), 30.  https://doi.org/10.1186/1748-5908-7-30.CrossRefPubMedGoogle Scholar
  37. Frantz, I., Foran, H. M., Lachman, J. M., Jansen, E., Hutchings, J., Băban, A., et al. (2019). Prevention of child mental health problems in Southeastern Europe: A multicentre sequential study to adapt, optimise and test the parenting programme ‘Parenting for Lifelong Health for Young Children’, protocol for stage 1, the feasibility study. BMJ Open, 9(1), e026684.  https://doi.org/10.1136/bmjopen-2018-026684.CrossRefPubMedPubMedCentralGoogle Scholar
  38. Garety, P. A., Craig, T. K. J., Iredale, C. H., Basit, N., Fornells-Ambrojo, M., Halkoree, R., et al. (2018). Training the frontline workforce to deliver evidence-based therapy to people with psychosis: Challenges in the GOALS study. Psychiatric Services, 69(1), 9–11.  https://doi.org/10.1176/appi.ps.201700268.CrossRefPubMedGoogle Scholar
  39. Geraedts, A. S., Kleiboer, A. M., Wiezer, N. M., Cuijpers, P., van Mechelen, W., & Anema, J. R. (2014). Feasibility of a worker-directed web-based intervention for employees with depressive symptoms. Internet Interventions, 1(3), 132–140.  https://doi.org/10.1016/j.invent.2014.07.001.CrossRefGoogle Scholar
  40. Gold, R., Bunce, A. E., Cohen, D. J., Hollombe, C., Nelson, C. A., Proctor, E. K., et al. (2016). Reporting on the strategies needed to implement proven Interventions: An example from a “real-world” cross-setting implementation study. Mayo Clinic Proceedings, 91(8), 1074–1083.  https://doi.org/10.1016/j.mayocp.2016.03.014.CrossRefPubMedPubMedCentralGoogle Scholar
  41. Granholm, E., Holden, J. L., Sommerfeld, D., Rufener, C., Perivoliotis, D., Mueser, K., et al. (2015). Enhancing assertive community treatment with cognitive behavioral social skills training for schizophrenia: Study protocol for a randomized controlled trial. Trials, 16(1), 438.  https://doi.org/10.1186/s13063-015-0967-8.CrossRefPubMedPubMedCentralGoogle Scholar
  42. Hadjistavropoulos, H. D., Nugent, M. M., Dirkse, D., & Pugh, N. (2017). Implementation of internet-delivered cognitive behavior therapy within community mental health clinics: A process evaluation using the consolidated framework for implementation research. BMC Psychiatry, 17(1), 331.  https://doi.org/10.1186/s12888-017-1496-7.CrossRefPubMedPubMedCentralGoogle Scholar
  43. Hamilton, A. B., Cohen, A. N., Glover, D. L., Whelan, F., Chemerinski, E., McNagny, K. P., et al. (2013). Implementation of evidence-based employment services in specialty mental health. Health Services Research, 48(6pt2), 2224–2244.  https://doi.org/10.1111/1475-6773.12115.CrossRefPubMedPubMedCentralGoogle Scholar
  44. Haynes, T., Turner, J., Smith, J., Curran, G., Bryant-Moore, K., Ounpraseuth, S. T., et al. (2018). Reducing depressive symptoms through behavioral activation in churches: A hybrid-2 randomized effectiveness-implementation design. Contemporary Clinical Trials, 64, 22–29.  https://doi.org/10.1016/j.cct.2017.11.010.CrossRefPubMedGoogle Scholar
  45. Hermens, M. L. M., Oud, M., Sinnema, H., Nauta, M. H., Stikkelbroek, Y., van Duin, D., et al. (2015). The multidisciplinary depression guideline for children and adolescents: An implementation study. European Child and Adolescent Psychiatry, 24(10), 1207–1218.  https://doi.org/10.1007/s00787-014-0670-4.CrossRefPubMedGoogle Scholar
  46. Hickey, M. D., Odeny, T. A., Petersen, M., Neilands, T. B., Padian, N., Ford, N., et al. (2017). Specification of implementation interventions to address the cascade of HIV care and treatment in resource-limited settings: A systematic review. Implementation Science, 12, 102.  https://doi.org/10.1186/s13012-017-0630-8.CrossRefPubMedGoogle Scholar
  47. Ho, W.-W., Chen, W.-J., Ho, C.-K., Lee, M.-B., Chen, C.-C., & Chou, F. H.-C. (2011). Evaluation of the suicide prevention program in Kaohsiung City, Taiwan, using the CIPP evaluation model. Community Mental Health Journal, 47(5), 542–550.  https://doi.org/10.1007/s10597-010-9364-7.CrossRefPubMedGoogle Scholar
  48. Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., et al. (2014). Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ, 348(mar07 3), g1687.  https://doi.org/10.1136/bmj.g1687.CrossRefGoogle Scholar
  49. Huang, K.-Y., Nakigudde, J., Calzada, E., Boivin, M. J., Ogedegbe, G., & Brotman, L. M. (2014). Implementing an early childhood school-based mental health promotion intervention in low-resource Ugandan schools: Study protocol for a cluster randomized controlled trial. Trials, 15(1), 471.  https://doi.org/10.1186/1745-6215-15-471.CrossRefPubMedPubMedCentralGoogle Scholar
  50. Huang, K.-Y., Nakigudde, J., Rhule, D., Gumikiriza-Onoria, J. L., Abura, G., Kolawole, B., et al. (2017). Transportability of an evidence-based early childhood intervention in a low-income African country: Results of a cluster randomized controlled study. Prevention Science, 18(8), 964–975.  https://doi.org/10.1007/s11121-017-0822-0.CrossRefPubMedPubMedCentralGoogle Scholar
  51. Implementation Science. (2019). Research submission guidelines. Retrieved from https://implementationscience.biomedcentral.com/submission-guidelines/preparing-your-manuscript/research.
  52. Johnson, J. E., Miller, T. R., Stout, R. L., Zlotnick, C., Cerbo, L. A., Andrade, J. T., et al. (2016). Study protocol: Hybrid Type I cost-effectiveness and implementation study of interpersonal psychotherapy (IPT) for men and women prisoners with major depression. Contemporary Clinical Trials, 47, 266–274.  https://doi.org/10.1016/j.cct.2016.01.013.CrossRefPubMedPubMedCentralGoogle Scholar
  53. Johnson, J. E., Wiltsey-Stirman, S., Sikorskii, A., Miller, T., King, A., Blume, J. L., et al. (2018). Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women. Implementation Science, 13(1), 115.  https://doi.org/10.1186/s13012-018-0807-9.CrossRefPubMedGoogle Scholar
  54. Jolley, S., Onwumere, J., Kuipers, E., Craig, T., Moriarty, A., & Garety, P. (2012). Increasing access to psychological therapies for people with psychosis: Predictors of successful training. Behaviour Research and Therapy, 50(7–8), 457–462.  https://doi.org/10.1016/j.brat.2012.04.002.CrossRefPubMedGoogle Scholar
  55. Kealey, E. M., Leckman-Westin, E., Jewell, T. C., & Finnerty, M. T. (2015). Multifamily group psychoeducation in New York State: Implementation and fidelity outcomes. Psychiatric Services, 66(11), 1194–1199.  https://doi.org/10.1176/appi.ps.201400403.CrossRefPubMedGoogle Scholar
  56. Kirchner, J. E., Ritchie, M. J., Pitcock, J. A., Parker, L. E., Curran, G. M., & Fortney, J. C. (2014). Outcomes of a partnered facilitation strategy to implement primary care–mental health. Journal of General Internal Medicine, 29(S4), 904–912.  https://doi.org/10.1007/s11606-014-3027-2.CrossRefPubMedPubMedCentralGoogle Scholar
  57. Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017). Beyond “implementation strategies”: Classifying the full range of strategies used in implementation science and practice. Implementation Science, 12, 125.  https://doi.org/10.1186/s13012-017-0657-x.CrossRefPubMedGoogle Scholar
  58. Leeman, J., Calancie, L., Hartman, M. A., Escoffery, C. T., Herrmann, A. K., Tague, L. E., et al. (2015). What strategies are used to build practitioners’ capacity to implement community-based interventions and are they effective?: A systematic review. Implementation Science, 10, 80.  https://doi.org/10.1186/s13012-015-0272-7.CrossRefPubMedGoogle Scholar
  59. Letourneau, N., Duffet-Leger, L., Stewart, M., Secco, L., Colpitts, J., & Dennis, C.-L. (2016). Development of a telephone based peer support program for new mothers with postpartum depression. Current Women’s Health Review, 12, 48–57.CrossRefGoogle Scholar
  60. Levac, D., Colquhoun, H., & O’Brien, K. K. (2010). Scoping studies: Advancing the methodology. Implementation Science, 5, 69.  https://doi.org/10.1186/1748-5908-5-69.CrossRefPubMedGoogle Scholar
  61. Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., et al. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 136.  https://doi.org/10.3389/fpubh.2018.00136.CrossRefPubMedPubMedCentralGoogle Scholar
  62. Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., et al. (2015a). Implementing measurement-based care (iMBC) for depression in community mental health: A dynamic cluster randomized trial study protocol. Implementation Science, 10(1), 127.  https://doi.org/10.1186/s13012-015-0313-2.CrossRefPubMedGoogle Scholar
  63. Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., et al. (2015b). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10, 2.  https://doi.org/10.1186/s13012-014-0193-x.CrossRefPubMedGoogle Scholar
  64. Lindholm, L. H., Koivukangas, A., Lassila, A., & Kampman, O. (2015). Early assessment of implementing evidence-based brief therapy interventions among secondary service psychiatric therapists. Evaluation and Program Planning, 52, 182–188.  https://doi.org/10.1016/j.evalprogplan.2015.05.004.CrossRefPubMedGoogle Scholar
  65. Lokker, C., McKibbon, K. A., Colquhoun, H., & Hempel, S. (2015). A scoping review of classification schemes of interventions to promote and integrate evidence into practice in healthcare. Implementation Science, 10, 27.  https://doi.org/10.1186/s13012-015-0220-6.CrossRefPubMedGoogle Scholar
  66. Lyon, A. R., Frazier, S. L., Mehta, T., Atkins, M. S., & Weisbach, J. (2011). Easier said than done: Intervention sustainability in an urban after-school program. Administration and Policy in Mental Health and Mental Health Services Research, 38(6), 504–517.  https://doi.org/10.1007/s10488-011-0339-y.CrossRefPubMedGoogle Scholar
  67. Mancini, A. D., Moser, L. L., Whitley, R., McHugo, G. J., Bond, G. R., Finnerty, M. T., et al. (2009). Assertive Community Treatment: Facilitators and barriers to implementation in routine mental health settings. Psychiatric Services, 60(2), 189–195.  https://doi.org/10.1176/ps.2009.60.2.189.CrossRefPubMedGoogle Scholar
  68. Markström, U. (2014). Staying the course? Challenges in implementing evidence-based programs in community mental health services. International Journal of Environmental Research and Public Health, 11(10), 10752–10769.  https://doi.org/10.3390/ijerph111010752.CrossRefPubMedPubMedCentralGoogle Scholar
  69. Marques, L., Valentine, S. E., Kaysen, D., Mackintosh, M.-A., Dixon De Silva, L. E., Ahles, E. M., et al. (2019). Provider fidelity and modifications to cognitive processing therapy in a diverse community health clinic: Associations with clinical change. Journal of Consulting and Clinical Psychology, 87(4), 357–369.  https://doi.org/10.1037/ccp0000384.CrossRefPubMedGoogle Scholar
  70. Marvin, S. E., Miklowitz, D. J., O’Brien, M. P., & Cannon, T. D. (2016). Family-focused therapy for individuals at clinical high risk for psychosis: Treatment fidelity within a multisite randomized trial. Early Intervention in Psychiatry, 10(2), 137–143.  https://doi.org/10.1111/eip.12144.CrossRefPubMedGoogle Scholar
  71. Mateen, F. J., Oh, J., Tergas, A. I., Bhayani, N. H., & Kamdar, B. B. (2013). Titles versus titles and abstracts for initial screening of articles for systematic reviews. Clinical Epidemiology, 5, 89–95.  https://doi.org/10.2147/CLEP.S43118.CrossRefPubMedPubMedCentralGoogle Scholar
  72. McCabe, O. L., Semon, N. L., Thompson, C. B., Lating, J. M., Everly, G. S., Perry, C. J., et al. (2014). Building a national model of public mental health preparedness and community resilience: Validation of a dual-intervention, systems-based approach. Disaster Medicine and Public Health Preparedness, 8(06), 511–526.  https://doi.org/10.1017/dmp.2014.119.CrossRefPubMedGoogle Scholar
  73. McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., et al. (2007). Fidelity outcomes in the National Implementing Evidence-Based Practices Project. Psychiatric Services, 58(10), 1279–1284.  https://doi.org/10.1176/appi.ps.58.10.1279.CrossRefPubMedGoogle Scholar
  74. McKibbon, K. A., Lokker, C., Wilczynski, N. L., Ciliska, D., Dobbins, M., Davis, D. A., et al. (2010). A cross-sectional study of the number and frequency of terms used to refer to knowledge translation in a body of health literature in 2006: A Tower of Babel? Implementation Science, 5, 16.  https://doi.org/10.1186/1748-5908-5-16.CrossRefPubMedGoogle Scholar
  75. Meffert, S. M., Neylan, T. C., Chambers, D. A., & Verdeli, H. (2016). Novel implementation research designs for scaling up global mental health care: Overcoming translational challenges to address the world’s leading cause of disability. International Journal of Mental Health Systems, 10(1), 19.  https://doi.org/10.1186/s13033-016-0049-7.CrossRefPubMedPubMedCentralGoogle Scholar
  76. Michie, S., Fixsen, D., Grimshaw, J. M., & Eccles, M. P. (2009). Specifying and reporting complex behaviour change interventions: The need for a scientific method. Implementation Science, 4, 40.  https://doi.org/10.1186/1748-5908-4-40.CrossRefPubMedGoogle Scholar
  77. Mignogna, J., Hundt, N. E., Kauth, M. R., Kunik, M. E., Sorocco, K. H., Naik, A. D., et al. (2014). Implementing brief cognitive behavioral therapy in primary care: A pilot study. Translational Behavioral Medicine, 4(2), 175–183.  https://doi.org/10.1007/s13142-013-0248-6.CrossRefPubMedPubMedCentralGoogle Scholar
  78. Moher, D., Altman, D., Schulz, K., Simera, I., & Wager, E. (2014). Guidelines for reporting health research: A user’s manual. Hoboken, NJ: Wiley-Blackwell.Google Scholar
  79. Moher, D., Jones, A., Lepage, L., & Consort Group. (2001). Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA, 285(15), 1992–1995.  https://doi.org/10.1001/jama.285.15.1992.CrossRefPubMedGoogle Scholar
  80. Moher, D., Schulz, K. F., Simera, I., & Altman, D. G. (2010). Guidance for developers of health research reporting guidelines. PLoS Medicine, 7(2), e1000217.  https://doi.org/10.1371/journal.pmed.1000217.CrossRefPubMedPubMedCentralGoogle Scholar
  81. Moher, D., Stewart, L., & Shekelle, P. (2016). Implementing PRISMA-P: Recommendations for prospective authors. Systematic Reviews, 5, 15.  https://doi.org/10.1186/s13643-016-0191-y.CrossRefPubMedPubMedCentralGoogle Scholar
  82. Monroe-DeVita, M., Morse, G., Mueser, K. T., McHugo, G. J., Xie, H., Hallgren, K. A., et al. (2018). Implementing illness management and recovery within assertive community treatment: A pilot trial of feasibility and effectiveness. Psychiatric Services, 69(5), 562–571.  https://doi.org/10.1176/appi.ps.201700124.CrossRefPubMedGoogle Scholar
  83. Monson, C. M., Shields, N., Suvak, M. K., Lane, J. E. M., Shnaider, P., Landy, M. S. H., et al. (2018). A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes. Behaviour Research and Therapy, 110, 31–40.  https://doi.org/10.1016/j.brat.2018.08.007.CrossRefPubMedGoogle Scholar
  84. Munson, M. R., Cole, A., Stanhope, V., Marcus, S. C., McKay, M., Jaccard, J., et al. (2016). Cornerstone program for transition-age youth with serious mental illness: Study protocol for a randomized controlled trial. Trials, 17(1), 537.  https://doi.org/10.1186/s13063-016-1654-0.CrossRefPubMedPubMedCentralGoogle Scholar
  85. Murray, L. K., Familiar, I., Skavenski, S., Jere, E., Cohen, J., Imasiku, M., et al. (2013). An evaluation of trauma focused cognitive behavioral therapy for children in Zambia. Child Abuse and Neglect, 37(12), 1175–1185.  https://doi.org/10.1016/j.chiabu.2013.04.017.CrossRefPubMedGoogle Scholar
  86. Murray, L. K., Haroz, E. E., Doty, S. B., Singh, N. S., Bogdanov, S., Bass, J., et al. (2018). Testing the effectiveness and implementation of a brief version of the Common Elements Treatment Approach (CETA) in Ukraine: A study protocol for a randomized controlled trial. Trials, 19(1), 418.  https://doi.org/10.1186/s13063-018-2752-y.CrossRefPubMedPubMedCentralGoogle Scholar
  87. Nadeem, E., Olin, S. S., Hill, L. C., Hoagwood, K. E., & Horwitz, S. M. (2013). Understanding the components of quality improvement collaboratives: A systematic literature review. Milbank Quarterly, 91(2), 354–394.  https://doi.org/10.1111/milq.12016.CrossRefPubMedGoogle Scholar
  88. Naik, A. D., Lawrence, B., Kiefer, L., Ramos, K., Utech, A., Masozera, N., et al. (2015). Building a primary care/research partnership: Lessons learned from a telehealth intervention for diabetes and depression. Family Practice, 32(2), 216–223.  https://doi.org/10.1093/fampra/cmu084.CrossRefPubMedGoogle Scholar
  89. Nielsen, B., Slinning, K., Weie Oddli, H., & Drozd, F. (2018). Identification of implementation strategies used for the circle of security-virginia family model intervention: Concept mapping study. JMIR Research Protocols, 7(6), e10312.  https://doi.org/10.2196/10312.CrossRefPubMedPubMedCentralGoogle Scholar
  90. Noroña, C. R., & Acker, M. L. (2016). Implementation and sustainability of child-parent psychotherapy: The role of reflective consultation in the learning collaborative model. Infant Mental Health Journal, 37(6), 701–716.  https://doi.org/10.1002/imhj.21607.CrossRefPubMedGoogle Scholar
  91. Onu, C., Ongeri, L., Bukusi, E., Cohen, C. R., Neylan, T. C., Oyaro, P., et al. (2016). Interpersonal psychotherapy for depression and posttraumatic stress disorder among HIV-positive women in Kisumu, Kenya: Study protocol for a randomized controlled trial. Trials, 17(1), 64.  https://doi.org/10.1186/s13063-016-1187-6.CrossRefPubMedPubMedCentralGoogle Scholar
  92. Patel, S. R., Wheaton, M. G., Andersson, E., Rück, C., Schmidt, A. B., La Lima, C. N., et al. (2018). AAcceptability, feasibility, and effectiveness of internet-based cognitive-behavioral therapy for obsessive-compulsive disorder in New York. Behavior Therapy, 49(4), 631–641.  https://doi.org/10.1016/J.BETH.2017.09.003.CrossRefPubMedGoogle Scholar
  93. Perry, C. K., Damschroder, L. J., Hemler, J. R., Woodson, T. T., Ono, S. S., & Cohen, D. J. (2019). Specifying and comparing implementation strategies across seven large implementation interventions: A practical application of theory. Implementation Science, 14, 32.  https://doi.org/10.1186/s13012-019-0876-4.CrossRefPubMedGoogle Scholar
  94. Pinnock, H., Barwick, M., Carpenter, C. R., Eldridge, S., Grandes, G., Griffiths, C. J., et al. (2017). Standards for Reporting Implementation Studies (StaRI) statement. BMJ, 356, i6795.  https://doi.org/10.1136/bmj.i6795.CrossRefPubMedPubMedCentralGoogle Scholar
  95. Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., et al. (2019). Enhancing the impact of implementation strategies in healthcare: A research agenda. Frontiers in Public Health, 7, 3.  https://doi.org/10.3389/fpubh.2019.00003.CrossRefPubMedPubMedCentralGoogle Scholar
  96. Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157.  https://doi.org/10.1177/1077558711430690.CrossRefPubMedGoogle Scholar
  97. Powell, B. J., Proctor, E. K., & Glass, J. E. (2014). A systematic review of strategies for implementing empirically supported mental health interventions. Research on Social Work Practice, 24(2), 192–212.  https://doi.org/10.1177/1049731513505778.CrossRefPubMedGoogle Scholar
  98. Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., et al. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21.  https://doi.org/10.1186/s13012-015-0209-1.CrossRefPubMedGoogle Scholar
  99. Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34.  https://doi.org/10.1007/s10488-008-0197-4.CrossRefPubMedGoogle Scholar
  100. Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(1), 139.  https://doi.org/10.1186/1748-5908-8-139.CrossRefPubMedGoogle Scholar
  101. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76.  https://doi.org/10.1007/s10488-010-0319-7.CrossRefPubMedGoogle Scholar
  102. Ristkari, T., Kurki, M., Suominen, A., Gilbert, S., Sinokki, A., Kinnunen, M., et al. (2019). Web-based parent training intervention with telephone coaching for disruptive behavior in 4-year-old children in real-world practice: Implementation study. Journal of Medical Internet Research, 21(4), e11446.  https://doi.org/10.2196/11446.CrossRefPubMedPubMedCentralGoogle Scholar
  103. Rockhill, C. M., Tse, Y. J., Fesinmeyer, M. D., Garcia, J., & Myers, K. (2016). Telepsychiatrists’ medication treatment strategies in the children’s Attention-Deficit/Hyperactivity Disorder telemental health treatment study. Journal of Child and Adolescent Psychopharmacology, 26(8), 662–671.  https://doi.org/10.1089/cap.2015.0017.CrossRefPubMedPubMedCentralGoogle Scholar
  104. Ruzek, J. I., Rosen, R. C., Marceau, L., Larson, M. J., Garvert, D. W., Smith, L., et al. (2012). Online self-administered training for post-traumatic stress disorder treatment providers: Design and methods for a randomized, prospective intervention study. Implementation Science, 7(1), 43.  https://doi.org/10.1186/1748-5908-7-43.CrossRefPubMedGoogle Scholar
  105. Samaan, L., Mbuagbaw, L., Kosa, S., Borg Debono, R., Dillenburg, S., Zhang, V., et al. (2013). A systematic scoping review of adherence to reporting guidelines in health care literature. Journal of Multidisciplinary Healthcare, 6, 169–188.  https://doi.org/10.2147/JMDH.S43952.CrossRefPubMedPubMedCentralGoogle Scholar
  106. Schaumberg, L., Narayan, S. M., & Wright, T. (2013). Advanced practice nurse psychiatric bridging intervention. Journal of Psychosocial Nursing and Mental Health Services, 51(5), 36–43.  https://doi.org/10.3928/02793695-20130320-01.CrossRefPubMedGoogle Scholar
  107. Schulz, K. F., Altman, D. G., Moher, D., & CONSORT Group. (2010). CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, c332.  https://doi.org/10.1136/bmj.c332.CrossRefPubMedPubMedCentralGoogle Scholar
  108. Shrestha, S., Wilson, N., Kunik, M. E., Wagener, P., Amspoker, A. B., Barrera, T., et al. (2017). Calmer life: A hybrid effectiveness-implementation trial for late-life anxiety conducted in low-income, mental health-underserved communities. Journal of Psychiatric Practice, 23(3), 180–190.  https://doi.org/10.1097/PRA.0000000000000234.CrossRefPubMedPubMedCentralGoogle Scholar
  109. Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010). Transparent and accurate reporting increases reliability, utility, and impact of your research: Reporting guidelines and the EQUATOR Network. BMC Medicine, 8(1), 24.  https://doi.org/10.1186/1741-7015-8-24.CrossRefPubMedPubMedCentralGoogle Scholar
  110. Slaughter, S. E., Hill, J. N., & Snelgrove-Clarke, E. (2015). What is the extent and quality of documentation and reporting of fidelity to implementation strategies: A scoping review. Implementation Science, 10(1), 129.  https://doi.org/10.1186/s13012-015-0320-3.CrossRefPubMedGoogle Scholar
  111. Smith, S. K., Rowe, K., & Abernethy, A. P. (2014). Use of an electronic patient-reported outcome measurement system to improve distress management in oncology. Palliative and Supportive Care, 12(1), 69–73.  https://doi.org/10.1017/S1478951513000345.CrossRefPubMedGoogle Scholar
  112. Smith, J. D., Stormshak, E. A., & Kavanagh, K. (2015). Results of a pragmatic effectiveness-implementation hybrid trial of the Family Check-up in community mental health agencies. Administration and Policy In Mental Health, 42(3), 265–278.  https://doi.org/10.1007/s10488-014-0566-0.CrossRefPubMedPubMedCentralGoogle Scholar
  113. Society for Implementation Research Collaboration (SIRC). (2017). Mechanisms of implementation: What works and why. Retrieved from https://societyforimplementationresearchcollaboration.org/sirc-2017-call-for-abstracts.
  114. Sommerfeld, D. H., Aarons, G. A., Naqvi, J. B., Holden, J., Perivoliotis, D., Mueser, K. T., et al. (2019). Stakeholder perspectives on implementing cognitive behavioral social skills training on assertive community treatment teams. Administration and Policy in Mental Health and Mental Health Services Research, 46(2), 188–199.  https://doi.org/10.1007/s10488-018-0904-8.CrossRefPubMedGoogle Scholar
  115. Ssewamala, F. M., Sensoy Bahar, O., McKay, M. M., Hoagwood, K., Huang, K.-Y., & Pringle, B. (2018). Strengthening mental health and research training in Sub-Saharan Africa (SMART Africa): Uganda study protocol. Trials, 19(1), 423.  https://doi.org/10.1186/s13063-018-2751-z.CrossRefPubMedPubMedCentralGoogle Scholar
  116. Starin, A. C., Atkins, M. S., Wehrmann, K. C., Mehta, T., Hesson-McInnis, M. S., Marinez-Lora, A., et al. (2014). Moving science into state child and adolescent mental health systems: Illinois’ evidence-informed practice initiative. Journal of Clinical Child & Adolescent Psychology, 43(2), 169–178.  https://doi.org/10.1080/15374416.2013.848772.CrossRefGoogle Scholar
  117. Svenkerud, S., & MacPherson, H. (2018). The impact of STRICTA and CONSORT on reporting of randomised control trials of acupuncture: A systematic methodological evaluation. Acupuncture in Medicine, 36(6), 349–357.  https://doi.org/10.1136/acupmed-2017-011519.CrossRefPubMedGoogle Scholar
  118. Tabak, R. G., Khoong, E. C., Chambers, D. A., & Brownson, R. C. (2012). Bridging research and practice: Models for dissemination and implementation research. American Journal of Preventive Medicine, 43(3), 337–350.  https://doi.org/10.1016/j.amepre.2012.05.024.CrossRefPubMedPubMedCentralGoogle Scholar
  119. Turner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. (2012). Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review a. Systematic Reviews, 1(60), 60.  https://doi.org/10.1186/2046-4053-1-60.CrossRefPubMedPubMedCentralGoogle Scholar
  120. Vis, C., Kleiboer, A., Prior, R., Bønes, E., Cavallo, M., Clark, S. A., et al. (2015). Implementing and up-scaling evidence-based eMental health in Europe: The study protocol for the MasterMind project. Internet Interventions, 2(4), 399–409.  https://doi.org/10.1016/j.invent.2015.10.002.CrossRefGoogle Scholar
  121. Volker, D., Zijlstra-Vlasveld, M. C., Brouwers, E. P. M., & van der Feltz-Cornelis, C. M. (2017). Process evaluation of a blended web-based intervention on return to work for sick-listed employees with common mental health problems in the occupational health setting. Journal of Occupational Rehabilitation, 27(2), 186–194.  https://doi.org/10.1007/s10926-016-9643-4.CrossRefPubMedGoogle Scholar
  122. Waxmonsky, J., Kilbourne, A. M., Goodrich, D. E., Nord, K. M., Lai, Z., Laird, C., et al. (2014). Enhanced fidelity to treatment for bipolar disorder: Results from a randomized controlled implementation trial. Psychiatric Services, 65(1), 81–90.  https://doi.org/10.1176/appi.ps.201300039.CrossRefPubMedGoogle Scholar
  123. Williams, L. S., Ofner, S., Yu, Z., Beyth, R. J., Plue, L., & Damush, T. (2011). Pre-post evaluation of automated reminders may improve detection and management of post-stroke depression. Journal of General Internal Medicine, 26(8), 852–857.  https://doi.org/10.1007/s11606-011-1709-6.CrossRefPubMedPubMedCentralGoogle Scholar
  124. Wilson, P. M., Sales, A., Wensing, M., Aarons, G. A., Flottorp, S., Glidewell, L., et al. (2017). Enhancing the reporting of implementation research. Implementation Science, 12, 13.  https://doi.org/10.1186/s13012-017-0546-3.CrossRefPubMedGoogle Scholar
  125. Wiltsey Stirman, S., Calloway, A., Toder, K., Miller, C. J., DeVito, A. K., Meisel, S. N., et al. (2013). Community mental health provider modifications to cognitive therapy: Implications for sustainability. Psychiatric Services, 64(10), 1056–1059.  https://doi.org/10.1176/appi.ps.201200456.CrossRefPubMedGoogle Scholar
  126. Wiltsey Stirman, S., Finley, E. P., Shields, N., Cook, J., Haine-Schlagel, R., Burgess, J. F., et al. (2017). Improving and sustaining delivery of CPT for PTSD in mental health systems: A cluster randomized trial. Implementation Science, 12(1), 32.  https://doi.org/10.1186/s13012-017-0544-5.CrossRefPubMedGoogle Scholar
  127. Wray, L. O., Ritchie, M. J., Oslin, D. W., & Beehler, G. P. (2018). Enhancing implementation of measurement-based mental health care in primary care: A mixed-methods randomized effectiveness evaluation of implementation facilitation. BMC Health Services Research, 18(1), 753.  https://doi.org/10.1186/s12913-018-3493-z.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Social WorkBrigham Young UniversityProvoUSA
  2. 2.Department of Social WorkRutgers University-NewarkNewarkUSA
  3. 3.Washington University in St. LouisSt. LouisUSA
  4. 4.Washington University School of MedicineSt. LouisUSA

Personalised recommendations