Skip to main content

En Route to Implementation Science 3.0

  • Chapter
  • First Online:

Abstract

Implementation science has undergone an impressive development in the past two decades. A great many concepts and models have been developed suggesting to include the essentials of high-quality implementation practice; critical discussions have explored the types of measures and designs needed to reliably and validly generate high-quality implementation research that pushes the field forward; and an impressive number of empirical studies have been published, reflecting both an increasing amount of resources invested in implementation science and a growing knowledge base enabling the further development of the discipline. This chapter introduces some of the pertinent questions that researchers, practitioners, and policymakers will face when entering into a new – and third – decade of implementation science. As such, it offers readers a platform from which to start their journey toward implementation science 3.0.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   89.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Retrieved from https://www.forbes.com/2004/11/04/cx_gk_1104artofthestart.html#4af9fecd1efe on August 27, 2018.

  2. 2.

    The use of “consumers” here refers to patients, clients, students, or other intended beneficiaries of services and implies that decisions about services are made with their input.

  3. 3.

    Databases used: Ovid Medline, Embase, Psycinfo, Cochrane Collaboration Registry of Controlled Trials, Cochrane Database of Systematic Reviews.

  4. 4.

    Search terms used for evidence-based: Evidence-based OR evidence based OR evidence-informed OR evidence informed.

  5. 5.

    Search terms used for implementation: Implementation OR knowledge translation OR knowledge exchange OR knowledge mobilization OR knowledge transfer.

  6. 6.

    Inclusive indexing including any use of the terms in titles, abstracts, and subject headings.

  7. 7.

    Evidence-based OR evidence based OR evidence-informed OR evidence informed AND implementation OR knowledge translation OR knowledge exchange OR knowledge mobilization OR knowledge transfer.

  8. 8.

    Limitations include the fact that these data are correlational only, the overall number of published studies has increased, duplicates across databases (while controlled for) may still exist in substantial numbers, authors in the field may be referencing themselves in large numbers, all disciplines are not uniquely represented (e.g., education), indexing may be inaccurate or has changed over time, and terms may not be defined the same way by individual authors. Complete search available upon request.

  9. 9.

    http://www.clahrc-southlondon.nihr.ac.uk/centre-implementation-science

  10. 10.

    https://www.nhmrc.gov.au/funding/find-funding/translating-research-practice-trip-fellowships

  11. 11.

    Databases used: Ovid Medline, Embase, Psycinfo, Cochrane Collaboration Registry of Controlled Trials, Cochrane Database of Systematic Reviews.

  12. 12.

    Search terms used for RCTs: RCT or randomi∗ or (random∗ adj3 (assign∗ or allocat∗)) or blinded or double blind∗ or doubleblind∗.

  13. 13.

    Search terms used for SRs: ((metaanal∗ or meta anal∗ or (systematic adj2 review∗) or systematic synthesis).mp. or (meta analysis or metasynthesis or “systematic review”).

  14. 14.

    Search terms used for implementation: Implementation OR knowledge translation OR knowledge exchange OR knowledge mobilization OR knowledge transfer.

  15. 15.

    Inclusive indexing including any use of the terms in titles, abstracts, and subject headings.

  16. 16.

    https://www.thisinstitute.cam.ac.uk/

  17. 17.

    https://societyforimplementationresearchcollaboration.org/

References

  • Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Mental Health Services Research, 6(2), 61–74.

    Article  Google Scholar 

  • Aarons, G. A. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 1–12. https://doi.org/10.1186/s13012-014-0192-y

    Article  Google Scholar 

  • Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. C. (2010). Expanding the domains of attitudes towards evidence-based practice: The evidence based practice attitude scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 331–340. https://doi.org/10.1007/s10488-010-0302-3

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 1–10. https://doi.org/10.1186/1748-5908-9-45

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017). Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol. Implementation Science, 12(29), 1–11. https://doi.org/10.1186/s13012-017-0562-3

    Article  Google Scholar 

  • Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Roesch, S. C. (2016). Validation of the implementation leadership scale (ILS) in substance use disorder treatment organizations. Journal of Substance Abuse Treatment, 68(C), 31–35. https://doi.org/10.1016/j.jsat.2016.05.004

    Article  Google Scholar 

  • Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016). The roles of system and organizational leadership in system- wide evidence-based intervention sustainment: A mixed- method study. Administration and Policy in Mental Health and Mental Health Services Research, 1–18. https://doi.org/10.1007/s10488-016-0751-4.

  • Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the evidence-based practice attitude scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration and Policy in Mental Health and Mental Health Services Research, 34(5), 465–469. https://doi.org/10.1007/s10488-007-0127-x

    Article  Google Scholar 

  • Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science, 12(1), 1–13. https://doi.org/10.1186/s13012-017-0640-6

    Article  Google Scholar 

  • Addington, D., Kyle, T., Desai, S., & Wang, J. L. (2010). Facilitators and barriers in implementing quality measurements in primary mental health care. Canadian Family Physician, 56, 1322–1331.

    Google Scholar 

  • Ageberg, E., Bunke, S., Lucander, K., Nilsen, P., & Donaldson, A. (2018). Facilitators to support the implementation of injury prevention training in youth handball: A concept mapping approach. Scandinavian Journal of Medicine & Science in Sports, 29(2), 275–285. https://doi.org/10.1111/sms.13323

    Article  Google Scholar 

  • Alagoz, E., Chih, M.-Y., Hitchcock, M., Brown, R., & Quanbeck, A. (2018). The use of external change agents to promote quality improvement and organizational change in healthcare organizations: A systematic review. BMC Health Services Research, 18(42), 1–13. https://doi.org/10.1186/s12913-018-2856-9

    Article  Google Scholar 

  • Alonge, O., Rodriguez, D. C., Brandes, N., Geng, E., Reveiz, L., & Peters, D. H. (2019). How is implementation research applied to advance health in low-income and middle-income countries? BMJ Global Health, 4(2), e001257–e001210. https://doi.org/10.1136/bmjgh-2018-001257

    Article  Google Scholar 

  • Astley, G., & Van de Ven, A. H. (1983). Central perspectives and debates in organization theory. Administrative Science Quarterly, 28(2), 245–273.

    Article  Google Scholar 

  • Atkins, L., & Michie, S. (2013). Changing eating behaviour: What can we learn from behavioural science? Nutrition Bulletin, 38(1), 30–35. https://doi.org/10.1111/nbu.12004

    Article  Google Scholar 

  • Atkins, L., Francis, J. J., Islam, R., O’Connor, D., Patey, A., Ivers, N., … Michie, S. (2017). A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implementation Science, 12(1), 1–18. https://doi.org/10.1186/s13012-017-0605-9

    Article  Google Scholar 

  • Bäck, A., von Thiele Schwarz, U., Hasson, H., & Richter, A. (2019). Aligning perspectives?—Comparison of top and middle-level managers’ views on how organization influences implementation of evidence-based practice. British Journal of Social Work, 35(1), 255–220. https://doi.org/10.1093/bjsw/bcz085

    Article  Google Scholar 

  • Balas, E. A., & Boren, S. A. (2000). Managing clinical knowledge for health care improvement. Yearbook of Medical Informatics, 65–70.

    Google Scholar 

  • Baumann, A. A., Powell, B. J., Kohl, P. L., Tabak, R. G., Penalba, V., Proctor, E. K., … Cabassa, L. J. (2015). Cultural adaptation and implementation of evidence-based parent-training: A systematic review and critique of guiding evidence. Children and Youth Services Review, 53, 113–120. https://doi.org/10.1016/j.childyouth.2015.03.025

    Article  Google Scholar 

  • Ben Charif, A., Zomahoun, H. T. V., LeBlanc, A., Langlois, L., Wolfenden, L., Yoong, S. L., … Légaré, F. (2017). Effective strategies for scaling up evidence- based practices in primary care: A systematic review. Implementation Science, 12(139), 1–13. https://doi.org/10.1186/s13012-017-0672-y

    Article  Google Scholar 

  • Bergström, A., Skeen, S., Duc, D. M., Blandon, E. Z., Estabrooks, C. A., Gustavsson, P., … Wallin, L. (2015). Health system context and implementation of evidence-based practices—Development and validation of the Context Assessment for Community Health (COACH) tool for low- and middle-income settings. Implementation Science, 10(1), 1–15. https://doi.org/10.1186/s13012-015-0305-2

    Article  Google Scholar 

  • Birken, S. A., Bunger, A. C., Powell, B. J., Turner, K., Clary, A. S., Klaman, S. L., … Weiner, B. J. (2017). Organizational theory for dissemination and implementation research. Implementation Science, 12(1), 1–15. https://doi.org/10.1186/s13012-017-0592-x

    Article  Google Scholar 

  • Birken, S. A., Clary, A., Tabriz, A. A., Turner, K., Meza, R., Zizzi, A., … Charns, M. (2018). Middle managers’ role in implementing evidence-based practices in healthcare: A systematic review. Implementation Science, 13(149), 1–14. https://doi.org/10.1186/s13012-018-0843-5

    Article  Google Scholar 

  • Birken, S. A., Lee, S.-Y. D., Weiner, B. J., Chin, M. H., Chiu, M., & Schaefer, C. T. (2015). From strategy to action. Health Care Management Review, 40(2), 159–168. https://doi.org/10.1097/HMR.0000000000000018

    Article  Google Scholar 

  • Birken, S. A., Powell, B. J., Presseau, J., Kirk, M. A., Lorencatto, F., Gould, N. J., … Damschroder, L. J. (2017). Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): A systematic review. Implementation Science, 12(2), 1–14. https://doi.org/10.1186/s13012-016-0534-z

    Article  Google Scholar 

  • Boaz, A., Robert, G., Locock, L., Sturmey, G., Gager, M., Vougioukalou, S., … Fielden, J. (2016). What patients do and their impact on implementation. Journal of Health Organization and Management, 30(2), 258–278. https://doi.org/10.1108/JHOM-02-2015-0027

    Article  Google Scholar 

  • Booth, A., Moore, G., Flemming, K., Garside, R., Rollins, N., Tunçalp, Ö., & Noyes, J. (2019). Taking account of context in systematic reviews and guidelines considering a complexity perspective. BMJ Global Health, 4(Suppl 1), e000840–e000815. https://doi.org/10.1136/bmjgh-2018-000840

    Article  Google Scholar 

  • Bornbaum, C. C., Kornas, K., Peirson, L., & Rosella, L. C. (2015). Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: A systematic review and thematic analysis. Implementation Science, 10(162), 1–12. https://doi.org/10.1186/s13012-015-0351-9

    Article  Google Scholar 

  • Boyd, M. R., Powell, B. J., Endicott, D., & Lewis, C. C. (2018). A method for tracking implementation strategies: An exemplar implementing measurement-based care in community behavioral health clinics. Behavior Therapy, 49(4), 525–537. https://doi.org/10.1016/j.beth.2017.11.012

    Article  Google Scholar 

  • Bozeman, B., & Bretschneider, S. (1994). The “Publicness Puzzle” in organization theory: A test of alternative explanations of differences between public and private organizations∗. J-Part, 4(2), 197–223.

    Google Scholar 

  • Braithwaite, J., Churruca, K., Long, J. C., Ellis, L. A., & Herkes, J. (2018). When complexity science meets implementation science: A theoretical and empirical analysis of systems change. BMC Medicine, 16(1), 1–14. https://doi.org/10.1186/s12916-018-1057-z

    Article  Google Scholar 

  • Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., … Cruden, G. (2017). An overview of research and evaluation designs for dissemination and implementation. Annual Review of Public Health, 38(1), 1–22. https://doi.org/10.1146/annurev-publhealth-031816-044215

    Article  Google Scholar 

  • Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., & McHugo, G. J. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 69(9), 989–995.

    Article  Google Scholar 

  • Brunkert, T., Ruppen, W., Simon, M., & Zúñiga, F. (2018). A theory-based hybrid II implementation intervention to improve pain management in Swiss nursing homes: A mixed-methods study protocol. Journal of Advanced Nursing, 75(2), 432–442. https://doi.org/10.1111/jan.13817

    Article  Google Scholar 

  • Bucknall, T. K., & Hitch, D. (2018). Connections, communication and collaboration in healthcare’s complex adaptive systems comment on “using complexity and network concepts to inform healthcare knowledge translation”. Kerman University of Medical Sciences, 7(6), 556–559. https://doi.org/10.15171/ijhpm.2017.138

    Article  Google Scholar 

  • Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. M. (2017). Tracking implementation strategies: A description of a practical approach and early findings. Health Research Policy and Systems, 15(1), 1–12. https://doi.org/10.1186/s12961-017-0175-y

    Article  Google Scholar 

  • Cairney, P., Oliver, K., & Wellstead, A. (2016). To bridge the divide between evidence and policy: Reduce ambiguity as much as uncertainty. Public Administration Review, 76(3), 399–402. https://doi.org/10.1111/puar.12555

    Article  Google Scholar 

  • Cane, J., O’Connor, D., & Michie, S. (2012). Validation of the theoretical domains framework for use in behaviour change and implementation research. Implementation Science, 7(37), 1–17.

    Google Scholar 

  • Carlfjord, S., Roback, K., & Nilsen, P. (2017). Five years’ experience of an annual course on implementation science: An evaluation among course participants. Implementation Science, 12(1), 1–8. https://doi.org/10.1186/s13012-017-0618-4

    Article  Google Scholar 

  • Chalmers, I. (2003). Trying to do more good than harm in policy and practice: The role of rigorous, transparent, up-to-date evaluations. The Annals of the American Academy of Political and Social Science, 589(1), 22–40. https://doi.org/10.1177/0002716203254762

    Article  Google Scholar 

  • Chalmers, I. (2005). If evidence-informed policy works in practice, does it matter if it doesn’t work in theory? Evidence & Policy: a Journal of Research, Debate and Practice, 1(2), 227–242.

    Article  Google Scholar 

  • Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress in community based settings: The stages of implementation completion (SIC). Implementation Science, 6(1), 116. https://doi.org/10.1186/1748-5908-6-116

    Article  Google Scholar 

  • Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(117), 1–11. https://doi.org/10.1186/1748-5908-8-117

    Article  Google Scholar 

  • Chambers, D. A., Proctor, E. K., Brownson, R. C., & Straus, S. E. (2017). Mapping training needs for dissemination and implementation research: Lessons from a synthesis of existing D&I research training programs. Translational Behavioral Medicine, 1–9. https://doi.org/10.1007/s13142-016-0399-3

  • Chinman, M. J., Gellad, W. F., McCarthy, S., Gordon, A. J., Rogal, S., Mor, M. K., & Hausmann, L. R. M. (2019). Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM). Implementation Science, 14(5), 1–11. https://doi.org/10.1186/s13012-019-0852-z

    Article  Google Scholar 

  • Chinman, M. J., Woodward, E. N., Curran, G. M., & Hausmann, L. R. M. (2017). Harnessing implementation science to increase the impact of health equity research. Medical Care, 55(9), S16–S23.

    Article  Google Scholar 

  • Churruca, K., Ludlow, K., Taylor, N., Long, J. C., Best, S., & Braithwaite, J. (2019). The time has come: Embedded implementation research for health care improvement. Journal of Evaluation in Clinical Practice, 297(4), 403–408. https://doi.org/10.1111/jep.13100

    Article  Google Scholar 

  • Clinton-McHarg, T., Yoong, S. L., Tzelepis, F., Regan, T., Fielding, A., Skelton, E., … Wolfenden, L. (2016). Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: A systematic review. Implementation Science, 11(148), 1–22. https://doi.org/10.1186/s13012-016-0512-5

    Article  Google Scholar 

  • Collins, L. M., Murphy, S. A., & Strecher, V. (2007). The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): New methods for more potent eHealth interventions. American Journal of Preventive Medicine, 32(5 Suppl), S112–S118.

    Article  Google Scholar 

  • Cook, C. R., Davis, C., Brown, E. C., Locke, J., Ehrhart, M. G., Aarons, G. A., … Lyon, A. R. (2018). Confirmatory factor analysis of the evidence-based practice attitudes scale with school-based behavioral health consultants. Implementation Science, 13(1), 1–8. https://doi.org/10.1186/s13012-018-0804-z

    Article  Google Scholar 

  • Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2013). Sustaining evidence-based prevention programs: Correlates in a large-scale dissemination initiative. Prevention Science, 16(1), 145–157. https://doi.org/10.1007/s11121-013-0427-1

    Article  Google Scholar 

  • Curran, G., Bauer, M. S., Mittman, B. S., Pyne, J. M., & Stetler, C. B. (2012). Effectiveness-implementation hybrid designs. Medical Care, 50, 217–226.

    Article  Google Scholar 

  • Dadich, A., & Doloswala, N. (2018). What can organisational theory offer knowledge translation in healthcare? A thematic and lexical analysis. BMC Health Services Research, 18(351), 1–20. https://doi.org/10.1186/s12913-018-3121-y

    Article  Google Scholar 

  • Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015). What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Science, 10(49), 1–7. https://doi.org/10.1186/s13012-015-0237-x

    Article  Google Scholar 

  • Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. https://doi.org/10.1186/1748-5908-4-50

    Article  Google Scholar 

  • Damschroder, L. J., Reardon, C. M., AuYoung, M., Moin, T., Datta, S. K., Sparks, J. B., … Richardson, C. R. (2017). Implementation findings from a hybrid III implementation-effectiveness trial of the Diabetes Prevention Program (DPP) in the Veterans Health Administration (VHA). Implementation Science, 12(94), 1–14. https://doi.org/10.1186/s13012-017-0619-3

    Article  Google Scholar 

  • Darnell, D., Dorsey, C. N., Melvin, A., Chi, J., Lyon, A. R., & Lewis, C. C. (2017). A content analysis of dissemination and implementation science resource initiatives: What types of resources do they offer to advance the field? Implementation Science, 12(137), 1–15. https://doi.org/10.1186/s13012-017-0673-x

    Article  Google Scholar 

  • Denhardt, R. B., & Baker, D. L. (2007). Five great issues in organization theory. In Handbook of public administration (pp. 121–147). Boca Raton, FL: Taylor & Francis.

    Google Scholar 

  • DeSisto, C. L., Kroelinger, C. D., Estrich, C., Velonis, A., Uesugi, K., Goodman, D. A., … Rankin, K. M. (2019). Application of an implementation science framework to policies on immediate postpartum long-acting reversible contraception. Public Health Reports, 134(2), 189–196. https://doi.org/10.1177/0033354918824329

    Article  Google Scholar 

  • Dopson, S., & Fitzgerald, L. (2006). The role of the middle manager in the implementation of evidence-based health care. Journal of Nursing Management, 14, 43–51.

    Article  Google Scholar 

  • Drahota, A., Meza, R. D., Brikho, B., Naaf, M., Estabillo, J. A., Gomez, E. D., … Aarons, G. A. (2016). Community-academic partnerships: A systematic review of the state of the literature and recommendations for future research. The Milbank Quarterly, 94(1), 163–214.

    Article  Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. https://doi.org/10.1007/s10464-008-9165-0

    Article  Google Scholar 

  • Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H. T. O., Davies, S., … Sibbald, B. (2009). An implementation research agenda. Implementation Science, 4(18), 1–7. https://doi.org/10.1186/1748-5908-4-18

    Article  Google Scholar 

  • Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1(1), 89–83. https://doi.org/10.1186/1748-5908-1-1

    Article  Google Scholar 

  • Egeland, K. M., Ruud, T., Ogden, T., Lindstrøm, J. C., & Heiervang, K. S. (2016). Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): To measure implementation readiness. Health Research Policy and Systems, 14(1), 1–10. https://doi.org/10.1186/s12961-016-0114-3

    Article  Google Scholar 

  • Egeland, K. M., Skar, A.-M. S., Endsjø, M., Laukvik, E. H., Bækkelund, H., Babaii, A., … Aarons, G. A. (2019). Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: A stepped-wedge cluster randomized design study protocol, 1–12. https://doi.org/10.1186/s13012-019-0873-7.

  • Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9(157), 1–11. https://doi.org/10.1186/s13012-014-0157-1

    Article  Google Scholar 

  • Ehrhart, M. G., Torres, E. M., Green, A. E., Trott, E. M., Willging, C. E., Moullin, J. C., & Aarons, G. A. (2018). Leading for the long haul: A mixed-method evaluation of the Sustainment Leadership Scale (SLS). Implementation Science, 13(17), 1–11. https://doi.org/10.1186/s13012-018-0710-4

    Article  Google Scholar 

  • Ehrhart, M. G., Torres, E. M., Wright, L. A., Martinez, S. Y., & Aarons, G. A. (2016). Validating the implementation climate scale (ICS) in child welfare organizations. Child Abuse & Neglect, 53, 17–26. https://doi.org/10.1016/j.chiabu.2015.10.017

    Article  Google Scholar 

  • Elf, M., Nordmark, S., Lyhagen, J., Lindberg, I., Finch, T. L., & Åberg, A. C. (2018). The Swedish version of the Normalization Process Theory Measure S-NoMAD: Translation, adaptation, and pilot testing. Implementation Science, 13(1), 1–12. https://doi.org/10.1186/s13012-018-0835-5

    Article  Google Scholar 

  • Engell, T., Follestad, I. B., Andersen, A., & Hagen, K. A. (2018). Knowledge translation in child welfare – Improving educational outcomes for children at risk: Study protocol for a hybrid randomized controlled pragmatic trial. Trials, 19(714), 1–17. https://doi.org/10.1186/s13063-018-3079-4

    Article  Google Scholar 

  • Escoffery, C. T., Lebow-Skelley, E., Haardoerfer, R., Boing, E., Udelson, H., Wood, R., … Mullen, P. D. (2018). A systematic review of adaptations of evidence-based public health interventions globally. Implementation Science, 13(125), 1–21. https://doi.org/10.1186/s13012-018-0815-9

    Article  Google Scholar 

  • Eslava-Schmalbach, J., Garzón-Orjuela, N., Elias, V., Reveiz, L., Tran, N., & Langlois, E. V. (2019). Conceptual framework of equity-focused implementation research for health programs (EquIR). International Journal for Equity in Health, 18(80), 1–11. https://doi.org/10.1186/s12939-019-0984-4

    Article  Google Scholar 

  • Finch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., … Rapley, T. (2018). Improving the normalization of complex interventions: Part 2 – Validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Medical Research Methodology, 18(135), 1–13. https://doi.org/10.1186/s12874-018-0591-x

    Article  Google Scholar 

  • Finch, T. L., Rapley, T., Girling, M., Mair, F. S., Murray, E., Treweek, S., … May, C. R. (2013). Improving the normalization of complex interventions: Measure development based on normalization process theory (NoMAD): Study protocol. Implementation Science, 8(43), 1–8.

    Google Scholar 

  • Finn, N. K., Torres, E. M., Ehrhart, M. G., Roesch, S. C., & Aarons, G. A. (2016). Cross-validation of the implementation leadership scale (ILS) in child welfare service organizations. Child Maltreatment, 21(3), 250–255. https://doi.org/10.1177/1077559516638768

    Article  Google Scholar 

  • Fixsen, D., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (pp. 1–125). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.

    Google Scholar 

  • Ford, J. H., Stumbo, S. P., & Robinson, J. M. (2018). Assessing long-term sustainment of clinic participation in NIATx200_ Results and a new methodological approach. Journal of Substance Abuse Treatment, 92, 51–63. https://doi.org/10.1016/j.jsat.2018.06.012

    Article  Google Scholar 

  • Forman, S. G., Olin, S.-C. S., Hoagwood, K. E., Crowe, M., & Saka, N. (2008). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1(1), 26–36. https://doi.org/10.1007/s12310-008-9002-5

    Article  Google Scholar 

  • Galaviz, K. I., Estabrooks, P. A., Ulloa, E. J., Lee, R. E., Janssen, I., Taylor, J. L. Y., … Lévesque, L. (2017). Evaluating the effectiveness of physician counseling to promote physical activity in Mexico: An effectiveness-implementation hybrid study. Translational Behavioral Medicine, 7, 731–740. https://doi.org/10.1007/s13142-017-0524-y

    Article  Google Scholar 

  • Gambrill, E. D. (2003). Evidence-based practice: Sea change or the emperor’s new clothes? Journal of Social Work Education, 39(1), 3–23.

    Article  Google Scholar 

  • Gifford, W. A., Edwards, N., Griffin, P., & Lybanon, V. (2007). Managerial leadership for nurses’ use of research evidence: An integrative review of the literature. Worldviews on Evidence-Based Nursing, 4(3), 126–145.

    Article  Google Scholar 

  • Gifford, W. A., Squires, J. E., Angus, D. E., Ashley, L. A., Brosseau, L., Craik, J. M., … Graham, I. D. (2018). Managerial leadership for research use in nursing and allied health care professions: A systematic review. Implementation Science, 13(127), 1–23. https://doi.org/10.1186/s13012-018-0817-7

    Article  Google Scholar 

  • Glasgow, R. E., & Riley, W. T. (2013). Pragmatic measures. American Journal of Preventive Medicine, 45(2), 237–243. https://doi.org/10.1016/j.amepre.2013.03.010

    Article  Google Scholar 

  • Glasziou, P. (2005). The paths from research to improved health outcomes. Evidence Based Medicine, 10(1), 4–7. https://doi.org/10.1136/ebm.10.1.4-a

    Article  Google Scholar 

  • Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J. M., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: Time for a map? Journal of Continuing Education in the Health Professions, 26(1), 13–24. https://doi.org/10.1002/chp.47

    Article  Google Scholar 

  • Granger, B. B. (2018). Science of improvement versus science of implementation: Integrating both into clinical inquiry. AACN Advanced Critical Care, 29(2), 208–212. https://doi.org/10.4037/aacnacc2018757

    Article  Google Scholar 

  • Grant, J., Green, L., & Mason, B. (2003). Basic research and health: A reassessment of the scientific basis for the support of biomedical science. Research Evaluation, 12(3), 217–224.

    Article  Google Scholar 

  • Grazioli, V. S., Moullin, J. C., Kasztura, M., Canepa-Allen, M., Hugli, O., Griffin, J., … Bodenmann, P. (2019). Implementing a case management intervention for frequent users of the emergency department (I-CaM): An effectiveness-implementation hybrid trial study protocol. BMC Health Services Research, 19(28), 1–11. https://doi.org/10.1186/s12913-018-3852-9

    Article  Google Scholar 

  • Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009). Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual Review of Public Health, 30(1), 151–174. https://doi.org/10.1146/annurev.publhealth.031308.100049

    Article  Google Scholar 

  • Greenhalgh, T., Hinton, L., Finlay, T., Macfarlane, A., Fahy, N., Clyde, B., & Chant, A. (2019). Frameworks for supporting patient and public involvement in research: Systematic review and co-design pilot. Health Expectations, 362(1), k3193–k3117. https://doi.org/10.1111/hex.12888

    Article  Google Scholar 

  • Greenhalgh, T., Jackson, C., Shaw, S., & Janamian, T. (2016). Achieving research impact through co-creation in community-based health services: Literature review and case study. The Milbank Quarterly, 94(2), 392–429.

    Article  Google Scholar 

  • Greenhalgh, T., & Papoutsi, C. (2018). Studying complexity in health services research: Desperately seeking an overdue paradigm shift, 1–6. https://doi.org/10.1186/s12916-018-1089-4.

  • Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 581–629.

    Article  Google Scholar 

  • Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A’Court, C., … Shaw, S. (2017). Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. Journal of Medical Internet Research, 19(11), e367–e330. https://doi.org/10.2196/jmir.8775

    Article  Google Scholar 

  • Guerrero, E. G., Padwa, H., Fenwick, K., Harris, L. M., & Aarons, G. A. (2016). Identifying and ranking implicit leadership strategies to promote evidence-based practice implementation in addiction health services. Implementation Science, 11(1), 1–13. https://doi.org/10.1186/s13012-016-0438-y

    Article  Google Scholar 

  • Gurung, R., Jha, A. K., Pyakurel, S., Gurung, A., Litorp, H., Wrammert, J., … Kc, A. (2019). Scaling up safer birth bundle through quality improvement in Nepal (SUSTAIN)—A stepped wedge cluster randomized controlled trial in public hospitals. Implementation Science, 14(65), 1–9. https://doi.org/10.1186/s13012-019-0917-z

    Article  Google Scholar 

  • Haldane, V., Chuah, F. L. H., Srivastava, A., Singh, S. R., Koh, G. C. H., Seng, C. K., & Legido-Quigley, H. (2019). Community participation in health services development, implementation, and evaluation: A systematic review of empowerment, health, community, and process outcomes. PLoS One, 14(5), e0216112–e0216125. https://doi.org/10.1371/journal.pone.0216112

    Article  Google Scholar 

  • Halko, H., Stanick, C., Powell, B. J., & Lewis, C. C. (2017). Defining the “pragmatic” measures construct: A stakeholder-driven approach. The Behavior Therapist, 40(7), 248–251.

    Google Scholar 

  • Harding, T., & Oetzel, J. (2019). Implementation effectiveness of health interventions for indigenous communities: A systematic review. Implementation Science, 14(76), 1–18. https://doi.org/10.1186/s13012-019-0920-4

    Article  Google Scholar 

  • Harvey, G., Loftus-Hills, A., Rycroft-Malone, J., Titchen, A., Kitson, A. L., McCormack, B. G., & Seers, K. (2002). Getting evidence into practice: The role and function of facilitation. Journal of Advanced Nursing, 37(6), 577–588.

    Article  Google Scholar 

  • Hasson, H., Nilsen, P., Augustsson, H., & von Thiele Schwarz, U. (2018). Empirical and conceptual investigation of de-implementation of low-value care from professional and health care system perspectives: A study protocol. Implementation Science, 13(67), 1–8. https://doi.org/10.1186/s13012-018-0760-7

    Article  Google Scholar 

  • Hawe, P. (2015). Lessons from complex interventions to improve health. Annual Review of Public Health, 36(1), 307–323. https://doi.org/10.1146/annurev-publhealth-031912-114421

    Article  Google Scholar 

  • Haynes, B. R., Devereaux, P. J., & Guyatt, G. H. (2002). Clinical expertise in the era of evidence-based medicine and patient choice. Evidence Based Medicine, 7(March/April), 1–3.

    Google Scholar 

  • Hearld, L. R., Bleser, W. K., Alexander, J. A., & Wolf, L. J. (2016). A systematic review of the literature on the sustainability of community health collaboratives. Medical Care Research and Review, 73(2), 127–181. https://doi.org/10.1177/1077558715607162

    Article  Google Scholar 

  • Highfield, L., Hartman, M. A., Mullen, P. D., Rodriguez, S. A., Fernandez, M. E., & Bartholomew, L. K. (2015). Intervention mapping to adapt evidence-based interventions for use in practice: Increasing mammography among African American women. BioMed Research International, 2015(1), 1–11. https://doi.org/10.1155/2015/160103

    Article  Google Scholar 

  • Hill, L. G., Cooper, B. R., & Parker, L. A. (2019). Qualitative comparative analysis: A mixed-method tool for complex implementation questions. The Journal of Primary Prevention, 40(1), 69–87. https://doi.org/10.1007/s10935-019-00536-5

    Article  Google Scholar 

  • Hodson, R., & Cooke, E. (2004). Leading the drive for evidence-informed practice. Journal of Integrated Care, 12(1), 12–18.

    Article  Google Scholar 

  • Hølge Hazelton, B., Bruun, L. Z., Slater, P., McCormack, B. G., Thomsen, T. G., Klausen, S. H., & Bucknall, T. K. (2019). Danish translation and adaptation of the context assessment index with implications for evidence-based practice. Worldviews on Evidence-Based Nursing, 16(3), 221–229. https://doi.org/10.1111/wvn.12347

    Article  Google Scholar 

  • Holt, D. T., Armenakis, A. A., Feild, H. S., & Harris, S. G. (2007). Readiness for organizational change: The systematic development of a scale. The Journal of Applied Behavioral Science, 43(2), 232–255. https://doi.org/10.1177/0021886306295295

    Article  Google Scholar 

  • Holt, D. T., Armenakis, A. A., Harris, S. G., & Feild, H. S. (2007). Toward a comprehensive definition of readiness for change: A review of research and instrumentation. Research in Organizational Change and Development, 16, 289–336. https://doi.org/10.1016/S0897-3016(06)16009-7

    Article  Google Scholar 

  • Huang, W., Hunter, S. B., Ayer, L., Han, B., Slaughter, M. E., Garner, B. R., & Godley, S. H. (2017). Measuring sustainment of an evidence based treatment for adolescent substance use. Journal of Substance Abuse Treatment, 83, 55–61. https://doi.org/10.1016/j.jsat.2017.10.005

    Article  Google Scholar 

  • Hupe, P. (2010). The thesis of incongruent implementation: Revisiting Pressman and Wildavsky. Public Policy and Administration, 26(1), 63–80. https://doi.org/10.1177/0952076710367717

    Article  Google Scholar 

  • Hupe, P. L., & Hill, M. J. (2015). “And the rest is implementation.” Comparing approaches to what happens in policy processes beyond great expectations. Public Policy and Administration, 31(2), 103–121. https://doi.org/10.1177/0952076715598828

    Article  Google Scholar 

  • Indig, D., Lee, K., Grunseit, A., Milat, A. J., & Bauman, A. (2018). Pathways for scaling up public health interventions. BMC Public Health, 18(68), 1–11. https://doi.org/10.1186/s12889-017-4572-5

    Article  Google Scholar 

  • Jernigan, V. B. B., D’Amico, E. J., & Kaholokula, J. K. (2018). Prevention research with indigenous communities to expedite dissemination and implementation efforts, 1–9. https://doi.org/10.1007/s11121-018-0951-0.

  • Jull, J., Whitehead, M., Petticrew, M., Kristjansson, E., Gough, D., Petkovic, J., … Welch, V. (2017). When is a randomised controlled trial health equity relevant? Development and validation of a conceptual framework. BMJ Open, 7(9), e015815–e015818. https://doi.org/10.1136/bmjopen-2016-015815

    Article  Google Scholar 

  • Kadu, M. K. (2015). Facilitators and barriers of implementing the chronic care model in primary care: A systematic review. BMC Family Practice, 16(1), 1–14. https://doi.org/10.1186/s12875-014-0219-0

    Article  Google Scholar 

  • Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology Research and Practice, 38(1), 13–20. https://doi.org/10.1037/0735-7028.38.1.13

    Article  Google Scholar 

  • Khanassov, V., Vedel, I., & Pluye, P. (2014). Barriers to implementation of case management for patients with dementia: A systematic mixed studies review. The Annals of Family Medicine, 12(5), 456–465. https://doi.org/10.1370/afm.1677

    Article  Google Scholar 

  • Kitson, A. L., Brook, A., Harvey, G., Jordan, Z., Marshall, R., O’Shea, R., & Wilson, D. (2018). Using complexity and network concepts to inform healthcare knowledge translation. Kerman University of Medical Sciences, 7(3), 231–243. https://doi.org/10.15171/ijhpm.2017.79

    Article  Google Scholar 

  • Kitson, A. L., O’Shea, R., Brook, A., Harvey, G., Jordan, Z., Marshall, R., & Wilson, D. (2018). The knowledge translation complexity network (KTCN) model: The whole is greater than the sum of the parts – A response to recent commentaries. Kerman University of Medical Sciences, 7(8), 768–770. https://doi.org/10.15171/ijhpm.2018.49

    Article  Google Scholar 

  • Koczwara, B., Stover, A. M., Davies, L., Davis, M. M., Fleisher, L., Ramanadhan, S., … Proctor, E. (2018). Harnessing the synergy between improvement science and implementation science in cancer: A call to action. Journal of Oncology Practice, 14(6), 335–340. https://doi.org/10.1200/JOP.17.00083

    Article  Google Scholar 

  • Korb, K. B., & Nicholson, A. E. (2011). Bayesian artificial intelligence (2nd ed.). Boca Raton, FL: CRC Press.

    Google Scholar 

  • Kruk, M. E., Yamey, G., Angell, S. Y., Beith, A., Cotlear, D., Guanais, F., … Goosby, E. (2016). Transforming global health by improving the science of scale-up. PLoS Biology, 14(3), e1002360–e1002316. https://doi.org/10.1371/journal.pbio.1002360

    Article  Google Scholar 

  • Landsverk, J., Brown, C. H., Rolls-Reutz, J., Palinkas, L. A., & Horwitz, S. M. (2010). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 54–63. https://doi.org/10.1007/s10488-010-0315-y

    Article  Google Scholar 

  • Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017). Beyond “implementation strategies”: Classifying the full range of strategies used in implementation science and practice. Implementation Science, 12(1), 1–9. https://doi.org/10.1186/s13012-017-0657-x

    Article  Google Scholar 

  • Lewis, C. C. (2015). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10(1), 1–18. https://doi.org/10.1186/s13012-014-0193-x

    Article  Google Scholar 

  • Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015). Outcomes for implementation science: An enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science, 10(1), 1–17. https://doi.org/10.1186/s13012-015-0342-x

    Article  Google Scholar 

  • Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., … Weiner, B. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 65–66. https://doi.org/10.3389/fpubh.2018.00136

    Article  Google Scholar 

  • Lewis, C. C., Mettert, K. D., Dorsey, C. N., Martinez, R. G., Weiner, B. J., Nolen, E., … Powell, B. J. (2018). An updated protocol for a systematic review of implementation-related measures. Systematic Reviews, 7(66), 1–8. https://doi.org/10.1186/s13643-018-0728-3

    Article  Google Scholar 

  • Lewis, C. C., Puspitasari, A., Boyd, M. R., Scott, K., Marriott, B. R., Hoffman, M., … Kassab, H. (2018). Implementing measurement based care in community mental health: A description of tailored and standardized methods. BMC Research Notes, 11(1), 606–607. https://doi.org/10.1186/s13104-018-3193-0

    Article  Google Scholar 

  • Lewis, C. C., Scott, K., & Marriott, B. R. (2018). A methodology for generating a tailored implementation blueprint: An exemplar from a youth residential setting. Implementation Science, 13(68), 1–13. https://doi.org/10.1186/s13012-018-0761-6

    Article  Google Scholar 

  • Lipsey, M. W. (2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims & Offenders, 4(2), 124–147. https://doi.org/10.1080/15564880802612573

    Article  Google Scholar 

  • Liverani, M., Hawkins, B., & Parkhurst, J. O. (2013). Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One, 8(10), e77404. https://doi.org/10.1371/journal.pone.0077404.s004

    Article  Google Scholar 

  • Long, J. C., Cunningham, F. C., & Braithwaite, J. (2013). Bridges, brokers and boundary spanners in collaborative networks: A systematic review. BMC Health Services Research, 13(158), 1–13.

    Google Scholar 

  • Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M. G., & Aarons, G. A. (2018). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13(5), 1–14. https://doi.org/10.1186/s13012-017-0705-6

    Article  Google Scholar 

  • Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9(118), 1–9. https://doi.org/10.1186/s13012-014-0118-8

    Article  Google Scholar 

  • Maru, S., Nirola, I., Thapa, A., Thapa, P., Kunwar, L., Wu, W.-J., … Maru, D. (2018). An integrated community health worker intervention in rural Nepal: A type 2 hybrid effectiveness-implementation study protocol. Implementation Science, 13(53), 1–11. https://doi.org/10.1186/s13012-018-0741-x

    Article  Google Scholar 

  • May, C. R., & Finch, T. L. (2009). Implementing, embedding, and integrating practices: An outline of normalization process theory. Sociology, 43(3), 535–554. https://doi.org/10.1177/0038038509103208

    Article  Google Scholar 

  • May, C. R., Johnson, M., & Finch, T. L. (2016). Implementation, context and complexity. Implementation Science, 11(1), 1–12. https://doi.org/10.1186/s13012-016-0506-3

    Article  Google Scholar 

  • Mazza, D., Bairstow, P., Buchan, H., Chakraborty, S. P., van Hecke, O., Grech, C., & Kunnamo, I. (2013). Refining a taxonomy for guideline implementation: Results of an exercise in abstract classification. Implementation Science, 8(32), 1–10. https://doi.org/10.1186/1748-5908-8-32

    Article  Google Scholar 

  • Mazzucca, S., Tabak, R. G., Pilar, M., Ramsey, A. T., Baumann, A. A., Kryzer, E., … Brownson, R. C. (2018). Variation in research designs used to test the effectiveness of dissemination and implementation strategies: A review. Frontiers in Public Health, 6, 1–10. https://doi.org/10.3389/fpubh.2018.00032

    Article  Google Scholar 

  • Mbuagbaw, L., Aves, T., Shea, B., Jull, J., Welch, V., Taljaard, M., … Tugwell, P. (2017). Considerations and guidance in designing equity-relevant clinical trials. International Journal for Equity in Health, 16(93), 1–9. https://doi.org/10.1186/s12939-017-0591-1

    Article  Google Scholar 

  • McCormack, B. G., Kitson, A. L., Harvey, G., Rycroft-Malone, J., Titchen, A., & Seers, K. (2002). Getting evidence into practice: The meaning of ‘context’. Journal of Advanced Nursing, 38(1), 94–104.

    Article  Google Scholar 

  • McCrabb, S., Lane, C., Hall, A., Milat, A. J., Bauman, A., Sutherland, R., … Wolfenden, L. (2019). Scaling-up evidence-based obesity interventions: A systematic review assessing intervention adaptations and effectiveness and quantifying the scale-up penalty. Obesity Reviews, 20(7), 964–982. https://doi.org/10.1111/obr.12845

    Article  Google Scholar 

  • McKay, V. R., Dolcini, M. M., & Hoffer, L. D. (2017). The dynamics of de-adoption: A case study of policy change, de-adoption, and replacement of an evidence-based HIV intervention. Translational Behavioral Medicine, 7(4), 1–11. https://doi.org/10.1007/s13142-017-0493-1

    Article  Google Scholar 

  • McKay, V. R., Hoffer, L. D., Combs, T. B., & Dolcini, M. M. (2018). The dynamic influence of human resources on evidence-based intervention sustainability and population outcomes: An agent-based modeling approach, 1–10. https://doi.org/10.1186/s13012-018-0767-0.

  • McKay, V. R., Morshed, A. B., Brownson, R. C., Proctor, E. K., & Prusaczyk, B. (2018). Letting go: Conceptualizing intervention de-implementation in public health and social service settings. American Journal of Community Psychology, 38(Suppl 4), 4–14. https://doi.org/10.1002/ajcp.12258

    Article  Google Scholar 

  • McKenzie, A., Alpers, K., Heyworth, J., Phuong, C., & Hanley, B. (2016). Consumer and community involvement in health and medical research: Evaluation by online survey of Australian training workshops for researchers. Research Involvement and Engagement, 2(16), 1–15. https://doi.org/10.1186/s40900-016-0030-2

    Article  Google Scholar 

  • McNulty, M., Smith, J. D., Villamar, J., Burnett-Zeigler, I., Vermeer, W., Benbow, N., … Hendricks Brown, C. (2019). Implementation research methodologies for achieving scientific equity and health equity. Ethnicity & Disease, 29(Suppl 1), 83–92.

    Article  Google Scholar 

  • Meissner, H. I., Glasgow, R. E., Vinson, C. A., Chambers, D. A., Brownson, R. C., Green, L. W., … Mittman, B. (2013). The U.S. training institute for dissemination and implementation research in health. Implementation Science, 8(12), 1–9.

    Google Scholar 

  • Meyers, D. C., Wandersman, A., & Durlak, J. A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480. https://doi.org/10.1007/s10464-012-9522-x

    Article  Google Scholar 

  • Michie, S., Fixsen, D., Grimshaw, J., & Eccles, M. P. (2009). Specifying and reporting complex behaviour change interventions: The need for a scientific method. Implementation Science, 4(1), 1238–1236. https://doi.org/10.1186/1748-5908-4-40

    Article  Google Scholar 

  • Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J. J., Hardeman, W., … Wood, C. E. (2013). The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine, 46(1), 81–95. https://doi.org/10.1007/s12160-013-9486-6

    Article  Google Scholar 

  • Michie, S., van Stralen, M. M., & West, R. (2011). The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science, 6(1), 42. https://doi.org/10.1186/1748-5908-6-42

    Article  Google Scholar 

  • Milat, A. J., King, L., Bauman, A., & Redman, S. (2013). The concept of scalability: Increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promotion International, 28(3), 285–298. https://doi.org/10.1093/heapro/dar097

    Article  Google Scholar 

  • Mitton, C., Adair, C. E., McKenzie, E., Patten, S. B., & Perry, B. W. (2007). Knowledge transfer and exchange: Review and synthesis of the literature. The Milbank Quarterly, 85(4), 729–768.

    Article  Google Scholar 

  • Montgomery, P., Grant, S., Hopewell, S., Macdonald, G., Moher, D., Michie, S., & Mayo-Wilson, E. (2013). Protocol for CONSORT-SPI: An extension for social and psychological interventions. Implementation Science, 8(1), 1–7. https://doi.org/10.1186/1748-5908-8-99

    Article  Google Scholar 

  • Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017). Developing a comprehensive definition of sustainability. Implementation Science, 12(1), 1–8. https://doi.org/10.1186/s13012-017-0637-1

    Article  Google Scholar 

  • Morgan, F., Battersby, A., Weightman, A. L., Searchfield, L., Turley, R., Morgan, H., … Ellis, S. (2016). Adherence to exercise referral schemes by participants – What do providers and commissioners need to know? A systematic review of barriers and facilitators. BMC Public Health, 16(227), 1–11. https://doi.org/10.1186/s12889-016-2882-7

    Article  Google Scholar 

  • Mosson, R., von Thiele Schwarz, U., Hasson, H., Lundmark, R., & Richter, A. (2018). How do iLead? Validation of a scale measuring active and passive implementation leadership in Swedish healthcare. BMJ Open, 8(6), e021992–e021911. https://doi.org/10.1136/bmjopen-2018-021992

    Article  Google Scholar 

  • Mosson, R., von Thiele Schwarz, U., Richter, A., & Hasson, H. (2018). The impact of inner and outer context on line managers’ implementation leadership. British Journal of Social Work, 48(5), 1447–1468. https://doi.org/10.1093/bjsw/bcx077

    Article  Google Scholar 

  • Moulton, S., & Sandfort, J. (2017). The strategic action field framework for policy implementation research. Policy Studies Journal, 45(1), 144–169.

    Article  Google Scholar 

  • Mullen, E. J., Shlonsky, A., Bledsoe, S. E., & Bellamy, J. L. (2005). From concept to implementation: Challenges facing evidence-based social work. Evidence & Policy: a Journal of Research, Debate and Practice, 1(1), 61–84.

    Article  Google Scholar 

  • Mullen, E. J., & Streiner, D. L. (2004). The evidence for and against evidence-based practice. Brief Treatment and Crisis Intervention, 4(2), 111–121. https://doi.org/10.1093/brief-treatment/mhh009

    Article  Google Scholar 

  • Nápoles, A. M., & Stewart, A. L. (2018). Transcreation: An implementation science framework for community-engaged behavioral interventions to reduce health disparities. BMC Health Services Research, 1–15. https://doi.org/10.1186/s12913-018-3521-z.

  • Newman, J., Cherney, A., & Head, B. W. (2015). Do policy makers use academic research? Reexamining the “two communities” theory of research utilization. Public Administration Review, 76(1), 24–32. https://doi.org/10.1111/puar.12464

    Article  Google Scholar 

  • Nilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013). Never the twain shall meet? – A comparison of implementation science and policy implementation research. Implementation Science, 8(63), 1–12. https://doi.org/10.1186/1748-5908-8-63

    Article  Google Scholar 

  • Niven, D. J., Mrklas, K. J., Holodinsky, J. K., Straus, S. E., Hemmelgarn, B. R., Jeffs, L. P., & Stelfox, H. T. (2015). Towards understanding the de-adoption of low-value clinical practices: A scoping review. BMC Medicine, 13(1), 1–21. https://doi.org/10.1186/s12916-015-0488-z

    Article  Google Scholar 

  • Noel, V. A. (2017). Barriers and facilitators to sustainment of an evidence-based supported employment program. Administration and Policy in Mental Health and Mental Health Services Research, 44(3), 331–338. https://doi.org/10.1007/s10488-016-0778-6

    Article  Google Scholar 

  • Northridge, M. E., & Metcalf, S. S. (2016). Enhancing implementation science by applying best principles of systems science. Health Research Policy and Systems, 14(74), 1–8. https://doi.org/10.1186/s12961-016-0146-8

    Article  Google Scholar 

  • Norton, W. E., Kennedy, A. E., & Chambers, D. A. (2017). Studying de-implementation in health: An analysis of funded research grants. Implementation Science, 12(144), 1–13. https://doi.org/10.1186/s13012-017-0655-z

    Article  Google Scholar 

  • Norton, W. E., Lungeanu, A., Chambers, D. A., & Contractor, N. (2017). Mapping the growing discipline of dissemination and implementation science in health. Scientometrics, 286, 1–24. https://doi.org/10.1007/s11192-017-2455-2

    Article  Google Scholar 

  • Olasoji, M., Cross, W., Reed, F., Wang, W., Jacob, S., & Plummer, V. (2019). Mental health nurses’ attitudes towards consumer involvement in nursing handover pre and post an educational implementation. International Journal of Mental Health Nursing, 30(2), 12–11. https://doi.org/10.1111/inm.12631

    Article  Google Scholar 

  • Oliver, K., & Faul, M. V. (2018). Networks and network analysis in evidence, policy and practice. Evidence & Policy: a Journal of Research, Debate and Practice, 14(3), 369–379. https://doi.org/10.1332/174426418X15314037224597

    Article  Google Scholar 

  • Oliver, K., Innvar, S., Lorenc, T., Woodman, J., & Thomas, J. (2014). A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Services Research, 14(1), 1–12. https://doi.org/10.1186/1472-6963-14-2

    Article  Google Scholar 

  • Örtenblad, A., Putnam, L. L., & Trehan, K. (2016). Beyond Morgan’s eight metaphors: Adding to and developing organization theory. Human Relations, 69(4), 875–889. https://doi.org/10.1177/0018726715623999

    Article  Google Scholar 

  • Øvretveit, J. (2009). Leading improvement effectively (pp. 1–105). London, UK: The Health Foundation.

    Google Scholar 

  • Øvretveit, J., Mittman, B. S., Rubenstein, L., & Ganz, D. A. (2017). Using implementation tools to design and conduct quality improvement projects for faster and more effective improvement. International Journal of Health Care Quality Assurance, 30(8), 755–768. https://doi.org/10.1108/IJHCQA-01-2017-0019

    Article  Google Scholar 

  • Palinkas, L. A., Aarons, G. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2010). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53. https://doi.org/10.1007/s10488-010-0314-z

    Article  Google Scholar 

  • Palinkas, L. A., Mendon, S. J., & Hamilton, A. B. (2019). Innovations in mixed methods evaluations. Annual Review of Public Health, 40(1), 423–442. https://doi.org/10.1146/annurev-publhealth-040218-044215

    Article  Google Scholar 

  • Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., … Oxman, A. D. (2017). Implementation strategies for health systems in low-income countries: An overview of systematic reviews. (Cochrane Effective Practice and Organisation of Care Group, Ed.) Cochrane Database of Systematic Reviews, 10, 63–135.

    Google Scholar 

  • Papoutsi, C., Ruth, B., Foy, R., Grimshaw, J., & Rycroft-Malone, J. (2016). Challenges for Implementation Science. In Challenges, solutions and future directions in the evaluation of service innovations in health care and public health (pp. 121–132). National Institute for Health Research: Southhampton (U.K.).

    Google Scholar 

  • Parahoo, K. (1999). Barriers to, and facilitators of, research utilization among nurses in Northern Ireland. Journal of Advanced Nursing, 31(1), 89–98.

    Article  Google Scholar 

  • Parolini, A., Tan, W. W., & Shlonsky, A. (2018). A blueprint for causal inference in implementation systems. Social Science Research Network, 1–38.

    Google Scholar 

  • Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383. https://doi.org/10.1093/clipsy/bpi045

    Article  Google Scholar 

  • Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829–841. https://doi.org/10.1037/0022-006X.75.6.829

    Article  Google Scholar 

  • Peters, D. H., Adam, T., Alonge, O., Agyepong, I. A., & Tran, N. (2013). Implementation research: What it is and how to do it. British Medical Journal, 347(nov20 1), f6753. https://doi.org/10.1136/bmj.f6753.

  • Petrosino, A., Boruch, R. F., Soydan, H., Duggan, L., & Sanchez-Meca, J. (2001). Meeting the challenges of evidence-based policy: The Campbell Collaboration. The Annals of the American Academy of Political and Social Science, 578(1), 14–34.

    Article  Google Scholar 

  • Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., … Rehfuess, E. (2017). Making sense of complexity in context and implementation: The Context and Implementation of Complex Interventions (CICI) framework. Implementation Science, 12(1), 1–17. https://doi.org/10.1186/s13012-017-0552-5

    Article  Google Scholar 

  • Pfadenhauer, L. M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K. B., … Rehfuess, E. A. (2015). Context and implementation: A concept analysis towards conceptual maturity. Theriogenology, 109(2), 103–114. https://doi.org/10.1016/j.zefq.2015.01.004

    Article  Google Scholar 

  • Pinnock, H. (2015). Developing standards for reporting implementation studies of complex interventions (StaRI): A systematic review and e-Delphi. Implementation Science, 10(1), 1–10. https://doi.org/10.1186/s13012-015-0235-z

    Article  Google Scholar 

  • Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., … Morley, R. (2018). Stakeholder involvement in systematic reviews: A scoping review. Systematic Reviews, 1–26. https://doi.org/10.1186/s13643-018-0852-0.

  • Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2015). Methods to improve the selection and tailoring of implementation strategies. Journal of Behavioral Health Services Research, 44(2), 177–194. https://doi.org/10.1007/s11414-015-9475-6

    Article  Google Scholar 

  • Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., … Mandell, D. S. (2016). Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy in Mental Health and Mental Health Services Research, 1–18. https://doi.org/10.1007/s10488-016-0733-6.

  • Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., … Weiner, B. J. (2019). Enhancing the impact of implementation strategies in healthcare: A research agenda. Frontiers in Public Health, 7, 503–509. https://doi.org/10.3389/fpubh.2019.00003

    Article  Google Scholar 

  • Powell, B. J., Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Barwick, M. A., … Lewis, C. C. (2017). Toward criteria for pragmatic measurement in implementation research and practice: A stakeholder-driven approach using concept mapping. Implementation Science, 12(118), 1–7. https://doi.org/10.1186/s13012-017-0649-x

    Article  Google Scholar 

  • Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., … Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 1–14. https://doi.org/10.1186/s13012-015-0209-1

    Article  Google Scholar 

  • Power, J., Gilmore, B., Vallières, F., Toomey, E., Mannan, H., & McAuliffe, E. (2019). Adapting health interventions for local fit when scaling-up: A realist review protocol. BMJ Open, 9(1), e022084–e022011. https://doi.org/10.1136/bmjopen-2018-022084

    Article  Google Scholar 

  • Prasad, V., & Ioannidis, J. P. A. (2014). Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implementation Science, 9(1), 1–5.

    Article  Google Scholar 

  • Pressman, J. L., & Wildavsky, A. B. (1974). Implementation. ICON Group International.

    Google Scholar 

  • Proctor, E. K., & Chambers, D. A. (2017). Training in dissemination and implementation research: A field-wide perspective. Translational Behavioral Medicine, 1–12. https://doi.org/10.1007/s13142-016-0406-8.

  • Proctor, E. K., Knudsen, K. J., Fedoravicius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34(5), 479–488. https://doi.org/10.1007/s10488-007-0129-8

    Article  Google Scholar 

  • Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D. A., & Mittman, B. S. (2008). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34. https://doi.org/10.1007/s10488-008-0197-4

    Article  Google Scholar 

  • Proctor, E. K., Landsverk, J., Baumann, A. A., Mittman, B. S., Brownson, R. C., Glisson, C., & Chambers, D. A. (2013). The implementation research institute: Training mental health implementation researchers in the United States. Implementation Science, 8(105), 1–12. https://doi.org/10.1186/1748-5908-8-105

    Article  Google Scholar 

  • Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(139), 1–11.

    Google Scholar 

  • Proctor, E. K., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G. A., Bunger, A. C., … Hensley, M. (2010). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/10.1007/s10488-010-0319-7

    Article  Google Scholar 

  • Purtle, J., Brownson, R. C., & Proctor, E. K. (2016). Infusing science into politics and policy: The importance of legislators as an audience in mental health policy dissemination research. Administration and Policy in Mental Health and Mental Health Services Research, 44(2), 160–163. https://doi.org/10.1007/s10488-016-0752-3

    Article  Google Scholar 

  • Purtle, J., Peters, R., & Brownson, R. C. (2016). A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implementation Science, 11(1), 1–8. https://doi.org/10.1186/s13012-015-0367-1

    Article  Google Scholar 

  • Rabin, B. A., Brownson, R. C., Haire-Joshu, D., Kreuter, M. W., & Weaver, N. L. (2008). A glossary for dissemination and implementation research in health. Journal of Public Health Management and Practice, 14(2), 117–123. https://doi.org/10.1097/01.PHH.0000311888.06252.bb

    Article  Google Scholar 

  • Raghavan, R., Bright, C., & Shadoin, A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3(1), 26–29. https://doi.org/10.1186/1748-5908-3-26

    Article  Google Scholar 

  • Rapley, T., Girling, M., Mair, F. S., Murray, E., Treweek, S., McColl, E., … Finch, T. L. (2018). Improving the normalization of complex interventions: Part 1 – Development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Medical Research Methodology, 18(133), 1–17. https://doi.org/10.1186/s12874-018-0590-y

    Article  Google Scholar 

  • Regehr, C., Stern, S., & Shlonsky, A. (2007). Operationalizing evidence-based practice: The development of an institute for evidence-based social work. Research on Social Work Practice, 17(3), 408–416. https://doi.org/10.1177/1049731506293561

    Article  Google Scholar 

  • Reichenpfader, U., Carlfjord, S., & Nilsen, P. (2015). Leadership in evidence-based practice: A systematic review. Leadership in Health Services, 28(4), 298–316. https://doi.org/10.1108/LHS-08-2014-0061

    Article  Google Scholar 

  • Richter, A., von Thiele Schwarz, U., Lornudd, C., Lundmark, R., Mosson, R., & Hasson, H. (2016). iLead—A transformational leadership intervention to train healthcare managers’ implementation leadership. Implementation Science, 11(1), 1–13. https://doi.org/10.1186/s13012-016-0475-6

    Article  Google Scholar 

  • Richter, L. M., Daelmans, B., Lombardi, J., Heymann, J., Boo, F. L., Behrman, J. R., … Paper 3 Working Group and the Lancet Early Childhood Development Series Steering Committee. (2017). Investing in the foundation of sustainable development: Pathways to scale up for early childhood development. The Lancet, 389(10064), 103–118. https://doi.org/10.1016/S0140-6736(16)31698-1.

  • Ridde, V. (2016). Need for more and better implementation science in global health. BMJ Global Health, 1(2), e000115–e000113. https://doi.org/10.1136/bmjgh-2016-000115

    Article  Google Scholar 

  • Robinson, T. E., Janssen, A., Harnett, P., Museth, K. E., Provan, P. J., Hills, D. J., & Shaw, T. (2017). Embedding continuous quality improvement processes in multidisciplinary teams in cancer care: Exploring the boundaries between quality and implementation science. Australian Health Review, 41(3), 291–296. https://doi.org/10.1071/AH16052

    Article  Google Scholar 

  • Roll, S., Moulton, S., & Sandfort, J. (2017). A comparative analysis of two streams of implementation research. Journal of Public and Nonprofit Affairs, 3(1), 3–20. https://doi.org/10.20899/jpna.3.1.3-22

    Article  Google Scholar 

  • Rousseau, D. M. (2007). Standing out in the fields of organization science. Journal of Organizational Behavior, 28(7), 849–857. https://doi.org/10.1002/job.457

    Article  Google Scholar 

  • Ruest, M., Léonard, G., Thomas, A., Desrosiers, J., & Guay, M. (2019). French cross-cultural adaptation of the Organizational Readiness for Implementing Change (ORIC). BMC Health Services Research, 19(535), 1–14. https://doi.org/10.1186/s12913-019-4361-1

    Article  Google Scholar 

  • Rycroft-Malone, J. (2004). The PARIHS framework – A framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19(4), 297–304.

    Article  Google Scholar 

  • Rye, M., Torres, E. M., Friborg, O., Skre, I., & Aarons, G. A. (2017). The evidence-based practice attitude scale- 36 (EBPAS-36): A brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples. Implementation Science, 12(44), 1–11. https://doi.org/10.1186/s13012-017-0573-0

    Article  Google Scholar 

  • Sackett, D. L., Rosenberg, W. C., Gray, J. A. M., Haynes, B. R., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. British Medical Journal, 312, 71–73.

    Article  Google Scholar 

  • Saldana, L. (2014). The stages of implementation completion for evidence-based practice: Protocol for a mixed methods study. Implementation Science, 9(43), 1–11. https://doi.org/10.1186/1748-5908-9-43

    Article  Google Scholar 

  • Saldana, L., Bennett, I., Powers, D., Vredevoogd, M., Grover, T., Schaper, H., & Campbell, M. (2019). Scaling implementation of collaborative care for depression: Adaptation of the stages of implementation completion (SIC). Administration and Policy in Mental Health and Mental Health Services Research, 1–9. https://doi.org/10.1007/s10488-019-00944-z.

  • Saldana, L., Chamberlain, P., Wang, W., & Brown, C. H. (2011). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health and Mental Health Services Research, 39(6), 419–425. https://doi.org/10.1007/s10488-011-0363-y

    Article  Google Scholar 

  • Santesteban-Echarri, O., Hernández-Arroyo, L., Rice, S. M., Güerre-Lobera, M. J., Serrano-Villar, M., Espín-Jaime, J. C., & Jiménez-Arriero, M. Á. (2018). Adapting the brief coping cat for children with anxiety to a group setting in the Spanish public mental health system: A hybrid effectiveness-implementation pilot study. Journal of Child and Family Studies, 27, 3300–3315. https://doi.org/10.1007/s10826-018-1154-9

    Article  Google Scholar 

  • Sarkies, M. N., Skinner, E. H., Bowles, K.-A., Morris, M. E., Williams, C., O’Brien, L., … Haines, T. P. (2019). A novel counterbalanced implementation study design: Methodological description and application to implementation research. Implementation Science, 14(45), 1–11. https://doi.org/10.1186/s13012-019-0896-0

    Article  Google Scholar 

  • Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013). Public health program capacity for sustainability: A new framework. Implementation Science, 8(15), 1–9. https://doi.org/10.1186/1748-5908-8-15

    Article  Google Scholar 

  • Schliep, M. E., Alonzo, C. N., & Morris, M. A. (2018). Beyond RCTs: Innovations in research design and methods to advance implementation science. Evidence-Based Communication Assessment and Intervention, 1–17. https://doi.org/10.1080/17489539.2017.1394807.

  • Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103.

    Article  Google Scholar 

  • Schoenwald, S. K., Hoagwood, K. E., Atkins, M. S., Evans, M. E., & Ringeisen, H. (2010). Workforce development and the organization of work: The science we need. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 71–80. https://doi.org/10.1007/s10488-010-0278-z

    Article  Google Scholar 

  • Shea, C. M., Jacobs, S. R., Esserman, D. A., Bruce, K., & Weiner, B. J. (2014). Organizational readiness for implementing change: A psychometric assessment of a new measure. Implementation Science, 9(7), 1–15.

    Google Scholar 

  • Shelton, R. C., Lee, M., Brotzman, L. E., Crookes, D. M., Jandorf, L., Erwin, D., & Gage-Bouchard, E. A. (2018). Use of social network analysis in the development, dissemination, implementation, and sustainability of health behavior interventions for adults: A systematic review. Social Science & Medicine, 220, 81–101. https://doi.org/10.1016/j.socscimed.2018.10.013

    Article  Google Scholar 

  • Shlonsky, A., Noonan, E., Littell, J. H., & Montgomery, P. (2010). The role of systematic reviews and the Campbell collaboration in the realization of evidence-informed practice. Clinical Social Work Journal, 39(4), 362–368. https://doi.org/10.1007/s10615-010-0307-0

    Article  Google Scholar 

  • Simons, H., Kushner, S., Jones, K., & James, D. (2003). From evidence-based practice to practice-based evidence: The idea of situated generalisation. Research Papers in Education, 18(4), 347–364. https://doi.org/10.1080/0267152032000176855

    Article  Google Scholar 

  • Smith, J. D., Berkel, C., Rudo-Stern, J., Montaño, Z., St George, S. M., Prado, G., … Dishion, T. J. (2018). The family check-up 4 health (FCU4Health): Applying implementation science frameworks to the process of adapting an evidence-based parenting program for prevention of pediatric obesity and excess weight gain in primary care. Frontiers in Public Health, 6, 243–217. https://doi.org/10.3389/fpubh.2018.00293

    Article  Google Scholar 

  • Squires, J. E. (2015). Identifying the domains of context important to implementation science: A study protocol. Implementation Science, 10(135), 1–9. https://doi.org/10.1186/s13012-015-0325-y

    Article  Google Scholar 

  • Squires, J. E., Hayduk, L., Hutchinson, A. M., Mallick, R., Norton, P. G., Cummings, G. G., & Estabrooks, C. A. (2015). Reliability and validity of the Alberta context tool (ACT) with professional nurses: Findings from a multi-study analysis. PLoS One, 10(6), e0127405–e0127417. https://doi.org/10.1371/journal.pone.0127405

    Article  Google Scholar 

  • Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Powell, B. J., Palinkas, L. A., & Lewis, C. C. (2018). Operationalizing the “pragmatic” measures construct using a stakeholder feedback and a multi-method approach. BMC Health Services Research, 18(882), 1–12. https://doi.org/10.1186/s12913-018-3709-2

    Article  Google Scholar 

  • Stetler, C. B. (2003). Role of the organization in translating research into evidence-based practice. Outcomes Management, 7(3), 97–103.

    Google Scholar 

  • Stetler, C. B., McQueen, L., Demakis, J., & Mittman, B. S. (2008). An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI series. Implementation Science, 3(1), 30. https://doi.org/10.1186/1748-5908-3-30

    Article  Google Scholar 

  • Stirman, S. W., Baumann, A. A., & Miller, C. J. (2019). The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions, 1–10. https://doi.org/10.1186/s13012-019-0898-y.

  • Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8(65), 1–12. https://doi.org/10.1186/1748-5908-8-65

    Article  Google Scholar 

  • Storkholm, M. H., Mazzocato, P., Tessma, M. K., & Savage, C. (2018). Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC). Implementation Science, 13(1), 1–7. https://doi.org/10.1186/s13012-018-0769-y

    Article  Google Scholar 

  • Straus, S. E., Tetroe, J., & Graham, I. D. (2009). Defining knowledge translation. Canadian Medical Association Journal, 181(3–4), 165–168. https://doi.org/10.1503/cmaj.081229

    Article  Google Scholar 

  • Tabak, R. G., Strickland, J. R., Stein, R. I., Dart, H., Colditz, G. A., Kirk, B., … Evanoff, B. A. (2018). Development of a scalable weight loss intervention for low-income workers through adaptation of interactive obesity treatment approach (iOTA). BMC Public Health, 18(1), 1–11. https://doi.org/10.1186/s12889-018-6176-0

    Article  Google Scholar 

  • Tommeraas, T., & Ogden, T. (2015). Is there a scale-up penalty? Testing behavioral change in the scaling up of parent management training in Norway. Administration and Policy in Mental Health and Mental Health Services Research, 1–14. https://doi.org/10.1007/s10488-015-0712-3.

  • Torfing, J., Sørensen, E., & Røiseland, A. (2018). Transforming the public sector into an arena for co-creation: Barriers, drivers, benefits, and ways forward. Administration & Society, 51(5), 795–825. https://doi.org/10.1177/0095399716680057

    Article  Google Scholar 

  • Torres, E. M., Ehrhart, M. G., Beidas, R. S., Farahnak, L. R., Finn, N. K., & Aarons, G. A. (2018). Validation of the implementation leadership scale (ILS) with supervisors’ self-ratings. Community Mental Health Journal, 54(1), 49–53. https://doi.org/10.1007/s10597-017-0114-y

    Article  Google Scholar 

  • Valente, T. W., Palinkas, L. A., Czaja, S., Chu, K.-H., & Brown, C. H. (2015). Social network analysis for program implementation. PLoS One, 10(6), e0131712–e0131718. https://doi.org/10.1371/journal.pone.0131712

    Article  Google Scholar 

  • van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Kleinjan, M., Aarons, G. A., & Tiemens, B. G. (2015). Psychometric properties of the Dutch version of the evidence-based practice attitude scale (EBPAS). Health Research Policy and Systems, 13(69), 1–12. https://doi.org/10.1186/s12961-015-0058-z

    Article  Google Scholar 

  • Vis, C., Ruwaard, J., Finch, T. L., Rapley, T., de Beurs, D., van Stel, H., … Smit, J. (2019). Toward an objective assessment of implementation processes for innovations in health care: Psychometric evaluation of the normalization measure development (NoMAD) questionnaire among mental health care professionals. Journal of Medical Internet Research, 21(2), e12376–e12316. https://doi.org/10.2196/12376

    Article  Google Scholar 

  • Wallerstein, N., & Duran, B. (2010). Community-based participatory research contributions to intervention research: The intersection of science and practice to improve health equity. American Journal of Public Health, 100(S1), S40–S47. https://doi.org/10.2105/AJPH.2009

    Article  Google Scholar 

  • Waltz, T. J., Powell, B. J., Chinman, M. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., … Kirchner, J. E. (2014). Expert recommendations for implementing change (ERIC): Protocol for a mixed methods study. Implementation Science, 9(39), 1–12.

    Google Scholar 

  • Waltz, T. J., Powell, B. J., Fernandez, M. E., Abadie, B., & Damschroder, L. J. (2019). Choosing implementation strategies to address contextual barriers: Diversity in recommendations and future directions. Implementation Science, 14(1), 1–15. https://doi.org/10.1186/s13012-019-0892-4

    Article  Google Scholar 

  • Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., … Kirchner, J. E. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10(1), 1–8. https://doi.org/10.1186/s13012-015-0295-0

    Article  Google Scholar 

  • Ward, V. (2017). Why, whose, what and how? A framework for knowledge mobilisers. Evidence & Policy: a Journal of Research, Debate and Practice, 13(3), 477–497. https://doi.org/10.1332/174426416X14634763278725

    Article  Google Scholar 

  • Ward, V., House, A., & Hamer, S. (2009). Knowledge brokering: The missing link in the evidence to action chain? Evidence & Policy: a Journal of Research, Debate and Practice, 5(3), 267–279. https://doi.org/10.1332/174426409X463811

    Article  Google Scholar 

  • Watson, D. P., Adams, E. L., Shue, S., Coates, H., McGuire, A., Chesher, J., … Omenka, O. I. (2018). Defining the external implementation context: An integrative systematic literature review. BMC Health Services Research, 18(1), 1–14. https://doi.org/10.1186/s12913-018-3046-5

    Article  Google Scholar 

  • Weatherley, R., & Lipsky, M. (1977). Street-level bureaucrats and institutional innovation: Implementing special-education reform. Harvard Educational Review, 17(2), 171–197.

    Article  Google Scholar 

  • Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 67. https://doi.org/10.1186/1748-5908-4-67

    Article  Google Scholar 

  • Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., … Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation Science, 12(1), 65–13. https://doi.org/10.1186/s13012-017-0635-3

    Article  Google Scholar 

  • Weiner, B. J., Lewis, M. A., & Linnan, L. A. (2008). Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Education Research, 24(2), 292–305. https://doi.org/10.1093/her/cyn019

    Article  Google Scholar 

  • Welch, V., Jull, J., Petkovic, J., Armstrong, R., Boyer, Y., Cuervo, L. G., … Tugwell. (2015). Protocol for the development of a CONSORT-equity guideline to improve reporting of health equity in randomized trials. Implementation Science, 10(146), 1–11. https://doi.org/10.1186/s13012-015-0332-z

    Article  Google Scholar 

  • Welch, V. A., Norheim, O. F., Jull, J., Cookson, R., Sommerfelt, H., Tugwell, P., & CONSORT-Equity and Boston Equity Symposium. (2017). CONSORT-Equity 2017 extension and elaboration for better reporting of health equity in randomised trials. British Medical Journal, 359, j5085–j5014. https://doi.org/10.1136/bmj.j5085

    Article  Google Scholar 

  • Wensing, M., & Grol, R. (2019). Knowledge translation in health: How implementation science could contribute more. Implementation Science, 17(88), 1–6. https://doi.org/10.1186/s12916-019-1322-9

    Article  Google Scholar 

  • Whelan, J., Love, P., Millar, L., Allender, S., & Bell, C. (2018). Sustaining obesity prevention in communities: A systematic narrative synthesis review. Obesity Reviews, 19(6), 839–851. https://doi.org/10.1111/obr.12675

    Article  Google Scholar 

  • White, H. (2018). Theory-based systematic reviews. Journal of Development Effectiveness, 10(1), 17–38. https://doi.org/10.1080/19439342.2018.1439078

    Article  Google Scholar 

  • Willging, C. E., Green, A. E., Gunderson, L. M., Chaffin, M. J., & Aarons, G. A. (2015). From a “Perfect Storm” to “Smooth Sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment, 20(1), 24–36. https://doi.org/10.1177/1077559514547384

    Article  Google Scholar 

  • Williams, J., Sevdalis, N., & Gaughran, F. (2019). Evaluation of a Physical health plan for people with psychosis: a protocol for a quality improvement study, 1–9. https://doi.org/10.1186/s40814-019-0396-7.

  • Williams, N. J., & Beidas, R. S. (2018). Annual research review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450. https://doi.org/10.1111/jcpp.12960

    Article  Google Scholar 

  • Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2016). Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health and Mental Health Services Research, 1–15. https://doi.org/10.1007/s10488-016-0742-5.

  • Willis, C. D., Riley, B. L., Stockton, L., Abramowicz, A., Zummach, D., Wong, G., … Best, A. (2016). Scaling up complex interventions: Insights from a realist synthesis. Health Research Policy and Systems, 14(88), 1–16. https://doi.org/10.1186/s12961-016-0158-4

    Article  Google Scholar 

  • Wolfenden, L., Albers, B., & Shlonsky, A. (2018). Strategies for scaling up the implementation of interventions in social welfare: Protocol for a systematic review. Campbell Systematic Reviews, 14(1), 1–33.

    Article  Google Scholar 

  • Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., … Drake, R. E. (2008). The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatric Services, 59, 732–737.

    Article  Google Scholar 

  • Woodward, E. N., Matthieu, M. M., Uchendu, U. S., Rogal, S., & Kirchner, J. E. (2019). The health equity implementation framework: Proposal and preliminary study of hepatitis C virus treatment. Implementation Science, 14(26), 1–18. https://doi.org/10.1186/s13012-019-0861-y

    Article  Google Scholar 

  • World Health Organization. (2009). Practical guidance for scaling up health service innovations (pp. 1–64). Geneva, Switzerland: World Health Organization.

    Google Scholar 

  • Yapa, H. M., & Bärnighausen, T. (2018). Implementation science in resource-poor countries and communities. Implementation Science, 13(154), 1–13. https://doi.org/10.1186/s13012-018-0847-1

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bianca Albers .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Albers, B., Shlonsky, A., Mildon, R. (2020). En Route to Implementation Science 3.0. In: Albers, B., Shlonsky, A., Mildon, R. (eds) Implementation Science 3.0. Springer, Cham. https://doi.org/10.1007/978-3-030-03874-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-03874-8_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-03873-1

  • Online ISBN: 978-3-030-03874-8

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics