En Route to Implementation Science 3.0

  • Bianca AlbersEmail author
  • Aron Shlonsky
  • Robyn Mildon


Implementation science has undergone an impressive development in the past two decades. A great many concepts and models have been developed suggesting to include the essentials of high-quality implementation practice; critical discussions have explored the types of measures and designs needed to reliably and validly generate high-quality implementation research that pushes the field forward; and an impressive number of empirical studies have been published, reflecting both an increasing amount of resources invested in implementation science and a growing knowledge base enabling the further development of the discipline. This chapter introduces some of the pertinent questions that researchers, practitioners, and policymakers will face when entering into a new – and third – decade of implementation science. As such, it offers readers a platform from which to start their journey toward implementation science 3.0.


Implementation science Knowledge transfer and exchange Diffusion of innovation Evidence-based practice Health-care delivery 


  1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The evidence-based practice attitude scale (EBPAS). Mental Health Services Research, 6(2), 61–74.CrossRefGoogle Scholar
  2. Aarons, G. A. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 1–12. Scholar
  3. Aarons, G. A., Cafri, G., Lugo, L., & Sawitzky, A. C. (2010). Expanding the domains of attitudes towards evidence-based practice: The evidence based practice attitude scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 331–340. Scholar
  4. Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 1–10. Scholar
  5. Aarons, G. A., Ehrhart, M. G., Moullin, J. C., Torres, E. M., & Green, A. E. (2017). Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol. Implementation Science, 12(29), 1–11. Scholar
  6. Aarons, G. A., Ehrhart, M. G., Torres, E. M., Finn, N. K., & Roesch, S. C. (2016). Validation of the implementation leadership scale (ILS) in substance use disorder treatment organizations. Journal of Substance Abuse Treatment, 68(C), 31–35. Scholar
  7. Aarons, G. A., Green, A. E., Trott, E., Willging, C. E., Torres, E. M., Ehrhart, M. G., & Roesch, S. C. (2016). The roles of system and organizational leadership in system- wide evidence-based intervention sustainment: A mixed- method study. Administration and Policy in Mental Health and Mental Health Services Research, 1–18.
  8. Aarons, G. A., McDonald, E. J., Sheehan, A. K., & Walrath-Greene, C. M. (2007). Confirmatory factor analysis of the evidence-based practice attitude scale (EBPAS) in a geographically diverse sample of community mental health providers. Administration and Policy in Mental Health and Mental Health Services Research, 34(5), 465–469. Scholar
  9. Aarons, G. A., Sklar, M., Mustanski, B., Benbow, N., & Brown, C. H. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science, 12(1), 1–13. Scholar
  10. Addington, D., Kyle, T., Desai, S., & Wang, J. L. (2010). Facilitators and barriers in implementing quality measurements in primary mental health care. Canadian Family Physician, 56, 1322–1331.Google Scholar
  11. Ageberg, E., Bunke, S., Lucander, K., Nilsen, P., & Donaldson, A. (2018). Facilitators to support the implementation of injury prevention training in youth handball: A concept mapping approach. Scandinavian Journal of Medicine & Science in Sports, 29(2), 275–285. Scholar
  12. Alagoz, E., Chih, M.-Y., Hitchcock, M., Brown, R., & Quanbeck, A. (2018). The use of external change agents to promote quality improvement and organizational change in healthcare organizations: A systematic review. BMC Health Services Research, 18(42), 1–13. Scholar
  13. Alonge, O., Rodriguez, D. C., Brandes, N., Geng, E., Reveiz, L., & Peters, D. H. (2019). How is implementation research applied to advance health in low-income and middle-income countries? BMJ Global Health, 4(2), e001257–e001210. Scholar
  14. Astley, G., & Van de Ven, A. H. (1983). Central perspectives and debates in organization theory. Administrative Science Quarterly, 28(2), 245–273.CrossRefGoogle Scholar
  15. Atkins, L., & Michie, S. (2013). Changing eating behaviour: What can we learn from behavioural science? Nutrition Bulletin, 38(1), 30–35. Scholar
  16. Atkins, L., Francis, J. J., Islam, R., O’Connor, D., Patey, A., Ivers, N., … Michie, S. (2017). A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implementation Science, 12(1), 1–18. Scholar
  17. Bäck, A., von Thiele Schwarz, U., Hasson, H., & Richter, A. (2019). Aligning perspectives?—Comparison of top and middle-level managers’ views on how organization influences implementation of evidence-based practice. British Journal of Social Work, 35(1), 255–220. Scholar
  18. Balas, E. A., & Boren, S. A. (2000). Managing clinical knowledge for health care improvement. Yearbook of Medical Informatics, 65–70.Google Scholar
  19. Baumann, A. A., Powell, B. J., Kohl, P. L., Tabak, R. G., Penalba, V., Proctor, E. K., … Cabassa, L. J. (2015). Cultural adaptation and implementation of evidence-based parent-training: A systematic review and critique of guiding evidence. Children and Youth Services Review, 53, 113–120. Scholar
  20. Ben Charif, A., Zomahoun, H. T. V., LeBlanc, A., Langlois, L., Wolfenden, L., Yoong, S. L., … Légaré, F. (2017). Effective strategies for scaling up evidence- based practices in primary care: A systematic review. Implementation Science, 12(139), 1–13. Scholar
  21. Bergström, A., Skeen, S., Duc, D. M., Blandon, E. Z., Estabrooks, C. A., Gustavsson, P., … Wallin, L. (2015). Health system context and implementation of evidence-based practices—Development and validation of the Context Assessment for Community Health (COACH) tool for low- and middle-income settings. Implementation Science, 10(1), 1–15. Scholar
  22. Birken, S. A., Bunger, A. C., Powell, B. J., Turner, K., Clary, A. S., Klaman, S. L., … Weiner, B. J. (2017). Organizational theory for dissemination and implementation research. Implementation Science, 12(1), 1–15. Scholar
  23. Birken, S. A., Clary, A., Tabriz, A. A., Turner, K., Meza, R., Zizzi, A., … Charns, M. (2018). Middle managers’ role in implementing evidence-based practices in healthcare: A systematic review. Implementation Science, 13(149), 1–14. Scholar
  24. Birken, S. A., Lee, S.-Y. D., Weiner, B. J., Chin, M. H., Chiu, M., & Schaefer, C. T. (2015). From strategy to action. Health Care Management Review, 40(2), 159–168. Scholar
  25. Birken, S. A., Powell, B. J., Presseau, J., Kirk, M. A., Lorencatto, F., Gould, N. J., … Damschroder, L. J. (2017). Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): A systematic review. Implementation Science, 12(2), 1–14. Scholar
  26. Boaz, A., Robert, G., Locock, L., Sturmey, G., Gager, M., Vougioukalou, S., … Fielden, J. (2016). What patients do and their impact on implementation. Journal of Health Organization and Management, 30(2), 258–278. Scholar
  27. Booth, A., Moore, G., Flemming, K., Garside, R., Rollins, N., Tunçalp, Ö., & Noyes, J. (2019). Taking account of context in systematic reviews and guidelines considering a complexity perspective. BMJ Global Health, 4(Suppl 1), e000840–e000815. Scholar
  28. Bornbaum, C. C., Kornas, K., Peirson, L., & Rosella, L. C. (2015). Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: A systematic review and thematic analysis. Implementation Science, 10(162), 1–12. Scholar
  29. Boyd, M. R., Powell, B. J., Endicott, D., & Lewis, C. C. (2018). A method for tracking implementation strategies: An exemplar implementing measurement-based care in community behavioral health clinics. Behavior Therapy, 49(4), 525–537. Scholar
  30. Bozeman, B., & Bretschneider, S. (1994). The “Publicness Puzzle” in organization theory: A test of alternative explanations of differences between public and private organizations∗. J-Part, 4(2), 197–223.Google Scholar
  31. Braithwaite, J., Churruca, K., Long, J. C., Ellis, L. A., & Herkes, J. (2018). When complexity science meets implementation science: A theoretical and empirical analysis of systems change. BMC Medicine, 16(1), 1–14. Scholar
  32. Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., … Cruden, G. (2017). An overview of research and evaluation designs for dissemination and implementation. Annual Review of Public Health, 38(1), 1–22. Scholar
  33. Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Wieder, B. L., Jones, A. M., & McHugo, G. J. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 69(9), 989–995.CrossRefGoogle Scholar
  34. Brunkert, T., Ruppen, W., Simon, M., & Zúñiga, F. (2018). A theory-based hybrid II implementation intervention to improve pain management in Swiss nursing homes: A mixed-methods study protocol. Journal of Advanced Nursing, 75(2), 432–442. Scholar
  35. Bucknall, T. K., & Hitch, D. (2018). Connections, communication and collaboration in healthcare’s complex adaptive systems comment on “using complexity and network concepts to inform healthcare knowledge translation”. Kerman University of Medical Sciences, 7(6), 556–559. Scholar
  36. Bunger, A. C., Powell, B. J., Robertson, H. A., MacDowell, H., Birken, S. A., & Shea, C. M. (2017). Tracking implementation strategies: A description of a practical approach and early findings. Health Research Policy and Systems, 15(1), 1–12. Scholar
  37. Cairney, P., Oliver, K., & Wellstead, A. (2016). To bridge the divide between evidence and policy: Reduce ambiguity as much as uncertainty. Public Administration Review, 76(3), 399–402. Scholar
  38. Cane, J., O’Connor, D., & Michie, S. (2012). Validation of the theoretical domains framework for use in behaviour change and implementation research. Implementation Science, 7(37), 1–17.Google Scholar
  39. Carlfjord, S., Roback, K., & Nilsen, P. (2017). Five years’ experience of an annual course on implementation science: An evaluation among course participants. Implementation Science, 12(1), 1–8. Scholar
  40. Chalmers, I. (2003). Trying to do more good than harm in policy and practice: The role of rigorous, transparent, up-to-date evaluations. The Annals of the American Academy of Political and Social Science, 589(1), 22–40. Scholar
  41. Chalmers, I. (2005). If evidence-informed policy works in practice, does it matter if it doesn’t work in theory? Evidence & Policy: a Journal of Research, Debate and Practice, 1(2), 227–242.CrossRefGoogle Scholar
  42. Chamberlain, P., Brown, C. H., & Saldana, L. (2011). Observational measure of implementation progress in community based settings: The stages of implementation completion (SIC). Implementation Science, 6(1), 116. Scholar
  43. Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(117), 1–11. Scholar
  44. Chambers, D. A., Proctor, E. K., Brownson, R. C., & Straus, S. E. (2017). Mapping training needs for dissemination and implementation research: Lessons from a synthesis of existing D&I research training programs. Translational Behavioral Medicine, 1–9.
  45. Chinman, M. J., Gellad, W. F., McCarthy, S., Gordon, A. J., Rogal, S., Mor, M. K., & Hausmann, L. R. M. (2019). Protocol for evaluating the nationwide implementation of the VA Stratification Tool for Opioid Risk Management (STORM). Implementation Science, 14(5), 1–11. Scholar
  46. Chinman, M. J., Woodward, E. N., Curran, G. M., & Hausmann, L. R. M. (2017). Harnessing implementation science to increase the impact of health equity research. Medical Care, 55(9), S16–S23.CrossRefGoogle Scholar
  47. Churruca, K., Ludlow, K., Taylor, N., Long, J. C., Best, S., & Braithwaite, J. (2019). The time has come: Embedded implementation research for health care improvement. Journal of Evaluation in Clinical Practice, 297(4), 403–408. Scholar
  48. Clinton-McHarg, T., Yoong, S. L., Tzelepis, F., Regan, T., Fielding, A., Skelton, E., … Wolfenden, L. (2016). Psychometric properties of implementation measures for public health and community settings and mapping of constructs against the Consolidated Framework for Implementation Research: A systematic review. Implementation Science, 11(148), 1–22. Scholar
  49. Collins, L. M., Murphy, S. A., & Strecher, V. (2007). The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): New methods for more potent eHealth interventions. American Journal of Preventive Medicine, 32(5 Suppl), S112–S118.CrossRefGoogle Scholar
  50. Cook, C. R., Davis, C., Brown, E. C., Locke, J., Ehrhart, M. G., Aarons, G. A., … Lyon, A. R. (2018). Confirmatory factor analysis of the evidence-based practice attitudes scale with school-based behavioral health consultants. Implementation Science, 13(1), 1–8. Scholar
  51. Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2013). Sustaining evidence-based prevention programs: Correlates in a large-scale dissemination initiative. Prevention Science, 16(1), 145–157. Scholar
  52. Curran, G., Bauer, M. S., Mittman, B. S., Pyne, J. M., & Stetler, C. B. (2012). Effectiveness-implementation hybrid designs. Medical Care, 50, 217–226.CrossRefGoogle Scholar
  53. Dadich, A., & Doloswala, N. (2018). What can organisational theory offer knowledge translation in healthcare? A thematic and lexical analysis. BMC Health Services Research, 18(351), 1–20. Scholar
  54. Dalkin, S. M., Greenhalgh, J., Jones, D., Cunningham, B., & Lhussier, M. (2015). What’s in a mechanism? Development of a key concept in realist evaluation. Implementation Science, 10(49), 1–7. Scholar
  55. Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. Scholar
  56. Damschroder, L. J., Reardon, C. M., AuYoung, M., Moin, T., Datta, S. K., Sparks, J. B., … Richardson, C. R. (2017). Implementation findings from a hybrid III implementation-effectiveness trial of the Diabetes Prevention Program (DPP) in the Veterans Health Administration (VHA). Implementation Science, 12(94), 1–14. Scholar
  57. Darnell, D., Dorsey, C. N., Melvin, A., Chi, J., Lyon, A. R., & Lewis, C. C. (2017). A content analysis of dissemination and implementation science resource initiatives: What types of resources do they offer to advance the field? Implementation Science, 12(137), 1–15. Scholar
  58. Denhardt, R. B., & Baker, D. L. (2007). Five great issues in organization theory. In Handbook of public administration (pp. 121–147). Boca Raton, FL: Taylor & Francis.Google Scholar
  59. DeSisto, C. L., Kroelinger, C. D., Estrich, C., Velonis, A., Uesugi, K., Goodman, D. A., … Rankin, K. M. (2019). Application of an implementation science framework to policies on immediate postpartum long-acting reversible contraception. Public Health Reports, 134(2), 189–196. Scholar
  60. Dopson, S., & Fitzgerald, L. (2006). The role of the middle manager in the implementation of evidence-based health care. Journal of Nursing Management, 14, 43–51.CrossRefGoogle Scholar
  61. Drahota, A., Meza, R. D., Brikho, B., Naaf, M., Estabillo, J. A., Gomez, E. D., … Aarons, G. A. (2016). Community-academic partnerships: A systematic review of the state of the literature and recommendations for future research. The Milbank Quarterly, 94(1), 163–214.CrossRefGoogle Scholar
  62. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. Scholar
  63. Eccles, M. P., Armstrong, D., Baker, R., Cleary, K., Davies, H. T. O., Davies, S., … Sibbald, B. (2009). An implementation research agenda. Implementation Science, 4(18), 1–7. Scholar
  64. Eccles, M. P., & Mittman, B. S. (2006). Welcome to implementation science. Implementation Science, 1(1), 89–83. Scholar
  65. Egeland, K. M., Ruud, T., Ogden, T., Lindstrøm, J. C., & Heiervang, K. S. (2016). Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): To measure implementation readiness. Health Research Policy and Systems, 14(1), 1–10. Scholar
  66. Egeland, K. M., Skar, A.-M. S., Endsjø, M., Laukvik, E. H., Bækkelund, H., Babaii, A., … Aarons, G. A. (2019). Testing the leadership and organizational change for implementation (LOCI) intervention in Norwegian mental health clinics: A stepped-wedge cluster randomized design study protocol, 1–12.
  67. Ehrhart, M. G., Aarons, G. A., & Farahnak, L. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9(157), 1–11. Scholar
  68. Ehrhart, M. G., Torres, E. M., Green, A. E., Trott, E. M., Willging, C. E., Moullin, J. C., & Aarons, G. A. (2018). Leading for the long haul: A mixed-method evaluation of the Sustainment Leadership Scale (SLS). Implementation Science, 13(17), 1–11. Scholar
  69. Ehrhart, M. G., Torres, E. M., Wright, L. A., Martinez, S. Y., & Aarons, G. A. (2016). Validating the implementation climate scale (ICS) in child welfare organizations. Child Abuse & Neglect, 53, 17–26. Scholar
  70. Elf, M., Nordmark, S., Lyhagen, J., Lindberg, I., Finch, T. L., & Åberg, A. C. (2018). The Swedish version of the Normalization Process Theory Measure S-NoMAD: Translation, adaptation, and pilot testing. Implementation Science, 13(1), 1–12. Scholar
  71. Engell, T., Follestad, I. B., Andersen, A., & Hagen, K. A. (2018). Knowledge translation in child welfare – Improving educational outcomes for children at risk: Study protocol for a hybrid randomized controlled pragmatic trial. Trials, 19(714), 1–17. Scholar
  72. Escoffery, C. T., Lebow-Skelley, E., Haardoerfer, R., Boing, E., Udelson, H., Wood, R., … Mullen, P. D. (2018). A systematic review of adaptations of evidence-based public health interventions globally. Implementation Science, 13(125), 1–21. Scholar
  73. Eslava-Schmalbach, J., Garzón-Orjuela, N., Elias, V., Reveiz, L., Tran, N., & Langlois, E. V. (2019). Conceptual framework of equity-focused implementation research for health programs (EquIR). International Journal for Equity in Health, 18(80), 1–11. Scholar
  74. Finch, T. L., Girling, M., May, C. R., Mair, F. S., Murray, E., Treweek, S., … Rapley, T. (2018). Improving the normalization of complex interventions: Part 2 – Validation of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Medical Research Methodology, 18(135), 1–13. Scholar
  75. Finch, T. L., Rapley, T., Girling, M., Mair, F. S., Murray, E., Treweek, S., … May, C. R. (2013). Improving the normalization of complex interventions: Measure development based on normalization process theory (NoMAD): Study protocol. Implementation Science, 8(43), 1–8.Google Scholar
  76. Finn, N. K., Torres, E. M., Ehrhart, M. G., Roesch, S. C., & Aarons, G. A. (2016). Cross-validation of the implementation leadership scale (ILS) in child welfare service organizations. Child Maltreatment, 21(3), 250–255. Scholar
  77. Fixsen, D., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (pp. 1–125). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.Google Scholar
  78. Ford, J. H., Stumbo, S. P., & Robinson, J. M. (2018). Assessing long-term sustainment of clinic participation in NIATx200_ Results and a new methodological approach. Journal of Substance Abuse Treatment, 92, 51–63. Scholar
  79. Forman, S. G., Olin, S.-C. S., Hoagwood, K. E., Crowe, M., & Saka, N. (2008). Evidence-based interventions in schools: Developers’ views of implementation barriers and facilitators. School Mental Health, 1(1), 26–36. Scholar
  80. Galaviz, K. I., Estabrooks, P. A., Ulloa, E. J., Lee, R. E., Janssen, I., Taylor, J. L. Y., … Lévesque, L. (2017). Evaluating the effectiveness of physician counseling to promote physical activity in Mexico: An effectiveness-implementation hybrid study. Translational Behavioral Medicine, 7, 731–740. Scholar
  81. Gambrill, E. D. (2003). Evidence-based practice: Sea change or the emperor’s new clothes? Journal of Social Work Education, 39(1), 3–23.CrossRefGoogle Scholar
  82. Gifford, W. A., Edwards, N., Griffin, P., & Lybanon, V. (2007). Managerial leadership for nurses’ use of research evidence: An integrative review of the literature. Worldviews on Evidence-Based Nursing, 4(3), 126–145.CrossRefGoogle Scholar
  83. Gifford, W. A., Squires, J. E., Angus, D. E., Ashley, L. A., Brosseau, L., Craik, J. M., … Graham, I. D. (2018). Managerial leadership for research use in nursing and allied health care professions: A systematic review. Implementation Science, 13(127), 1–23. Scholar
  84. Glasgow, R. E., & Riley, W. T. (2013). Pragmatic measures. American Journal of Preventive Medicine, 45(2), 237–243. Scholar
  85. Glasziou, P. (2005). The paths from research to improved health outcomes. Evidence Based Medicine, 10(1), 4–7. Scholar
  86. Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J. M., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: Time for a map? Journal of Continuing Education in the Health Professions, 26(1), 13–24. Scholar
  87. Granger, B. B. (2018). Science of improvement versus science of implementation: Integrating both into clinical inquiry. AACN Advanced Critical Care, 29(2), 208–212. Scholar
  88. Grant, J., Green, L., & Mason, B. (2003). Basic research and health: A reassessment of the scientific basis for the support of biomedical science. Research Evaluation, 12(3), 217–224.CrossRefGoogle Scholar
  89. Grazioli, V. S., Moullin, J. C., Kasztura, M., Canepa-Allen, M., Hugli, O., Griffin, J., … Bodenmann, P. (2019). Implementing a case management intervention for frequent users of the emergency department (I-CaM): An effectiveness-implementation hybrid trial study protocol. BMC Health Services Research, 19(28), 1–11. Scholar
  90. Green, L. W., Ottoson, J. M., García, C., & Hiatt, R. A. (2009). Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annual Review of Public Health, 30(1), 151–174. Scholar
  91. Greenhalgh, T., Hinton, L., Finlay, T., Macfarlane, A., Fahy, N., Clyde, B., & Chant, A. (2019). Frameworks for supporting patient and public involvement in research: Systematic review and co-design pilot. Health Expectations, 362(1), k3193–k3117. Scholar
  92. Greenhalgh, T., Jackson, C., Shaw, S., & Janamian, T. (2016). Achieving research impact through co-creation in community-based health services: Literature review and case study. The Milbank Quarterly, 94(2), 392–429.CrossRefGoogle Scholar
  93. Greenhalgh, T., & Papoutsi, C. (2018). Studying complexity in health services research: Desperately seeking an overdue paradigm shift, 1–6.
  94. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 581–629.CrossRefGoogle Scholar
  95. Greenhalgh, T., Wherton, J., Papoutsi, C., Lynch, J., Hughes, G., A’Court, C., … Shaw, S. (2017). Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. Journal of Medical Internet Research, 19(11), e367–e330. Scholar
  96. Guerrero, E. G., Padwa, H., Fenwick, K., Harris, L. M., & Aarons, G. A. (2016). Identifying and ranking implicit leadership strategies to promote evidence-based practice implementation in addiction health services. Implementation Science, 11(1), 1–13. Scholar
  97. Gurung, R., Jha, A. K., Pyakurel, S., Gurung, A., Litorp, H., Wrammert, J., … Kc, A. (2019). Scaling up safer birth bundle through quality improvement in Nepal (SUSTAIN)—A stepped wedge cluster randomized controlled trial in public hospitals. Implementation Science, 14(65), 1–9. Scholar
  98. Haldane, V., Chuah, F. L. H., Srivastava, A., Singh, S. R., Koh, G. C. H., Seng, C. K., & Legido-Quigley, H. (2019). Community participation in health services development, implementation, and evaluation: A systematic review of empowerment, health, community, and process outcomes. PLoS One, 14(5), e0216112–e0216125. Scholar
  99. Halko, H., Stanick, C., Powell, B. J., & Lewis, C. C. (2017). Defining the “pragmatic” measures construct: A stakeholder-driven approach. The Behavior Therapist, 40(7), 248–251.Google Scholar
  100. Harding, T., & Oetzel, J. (2019). Implementation effectiveness of health interventions for indigenous communities: A systematic review. Implementation Science, 14(76), 1–18. Scholar
  101. Harvey, G., Loftus-Hills, A., Rycroft-Malone, J., Titchen, A., Kitson, A. L., McCormack, B. G., & Seers, K. (2002). Getting evidence into practice: The role and function of facilitation. Journal of Advanced Nursing, 37(6), 577–588.CrossRefGoogle Scholar
  102. Hasson, H., Nilsen, P., Augustsson, H., & von Thiele Schwarz, U. (2018). Empirical and conceptual investigation of de-implementation of low-value care from professional and health care system perspectives: A study protocol. Implementation Science, 13(67), 1–8. Scholar
  103. Hawe, P. (2015). Lessons from complex interventions to improve health. Annual Review of Public Health, 36(1), 307–323. Scholar
  104. Haynes, B. R., Devereaux, P. J., & Guyatt, G. H. (2002). Clinical expertise in the era of evidence-based medicine and patient choice. Evidence Based Medicine, 7(March/April), 1–3.Google Scholar
  105. Hearld, L. R., Bleser, W. K., Alexander, J. A., & Wolf, L. J. (2016). A systematic review of the literature on the sustainability of community health collaboratives. Medical Care Research and Review, 73(2), 127–181. Scholar
  106. Highfield, L., Hartman, M. A., Mullen, P. D., Rodriguez, S. A., Fernandez, M. E., & Bartholomew, L. K. (2015). Intervention mapping to adapt evidence-based interventions for use in practice: Increasing mammography among African American women. BioMed Research International, 2015(1), 1–11. Scholar
  107. Hill, L. G., Cooper, B. R., & Parker, L. A. (2019). Qualitative comparative analysis: A mixed-method tool for complex implementation questions. The Journal of Primary Prevention, 40(1), 69–87. Scholar
  108. Hodson, R., & Cooke, E. (2004). Leading the drive for evidence-informed practice. Journal of Integrated Care, 12(1), 12–18.CrossRefGoogle Scholar
  109. Hølge Hazelton, B., Bruun, L. Z., Slater, P., McCormack, B. G., Thomsen, T. G., Klausen, S. H., & Bucknall, T. K. (2019). Danish translation and adaptation of the context assessment index with implications for evidence-based practice. Worldviews on Evidence-Based Nursing, 16(3), 221–229. Scholar
  110. Holt, D. T., Armenakis, A. A., Feild, H. S., & Harris, S. G. (2007). Readiness for organizational change: The systematic development of a scale. The Journal of Applied Behavioral Science, 43(2), 232–255. Scholar
  111. Holt, D. T., Armenakis, A. A., Harris, S. G., & Feild, H. S. (2007). Toward a comprehensive definition of readiness for change: A review of research and instrumentation. Research in Organizational Change and Development, 16, 289–336. Scholar
  112. Huang, W., Hunter, S. B., Ayer, L., Han, B., Slaughter, M. E., Garner, B. R., & Godley, S. H. (2017). Measuring sustainment of an evidence based treatment for adolescent substance use. Journal of Substance Abuse Treatment, 83, 55–61. Scholar
  113. Hupe, P. (2010). The thesis of incongruent implementation: Revisiting Pressman and Wildavsky. Public Policy and Administration, 26(1), 63–80. Scholar
  114. Hupe, P. L., & Hill, M. J. (2015). “And the rest is implementation.” Comparing approaches to what happens in policy processes beyond great expectations. Public Policy and Administration, 31(2), 103–121. Scholar
  115. Indig, D., Lee, K., Grunseit, A., Milat, A. J., & Bauman, A. (2018). Pathways for scaling up public health interventions. BMC Public Health, 18(68), 1–11. Scholar
  116. Jernigan, V. B. B., D’Amico, E. J., & Kaholokula, J. K. (2018). Prevention research with indigenous communities to expedite dissemination and implementation efforts, 1–9.
  117. Jull, J., Whitehead, M., Petticrew, M., Kristjansson, E., Gough, D., Petkovic, J., … Welch, V. (2017). When is a randomised controlled trial health equity relevant? Development and validation of a conceptual framework. BMJ Open, 7(9), e015815–e015818. Scholar
  118. Kadu, M. K. (2015). Facilitators and barriers of implementing the chronic care model in primary care: A systematic review. BMC Family Practice, 16(1), 1–14. Scholar
  119. Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology Research and Practice, 38(1), 13–20. Scholar
  120. Khanassov, V., Vedel, I., & Pluye, P. (2014). Barriers to implementation of case management for patients with dementia: A systematic mixed studies review. The Annals of Family Medicine, 12(5), 456–465. Scholar
  121. Kitson, A. L., Brook, A., Harvey, G., Jordan, Z., Marshall, R., O’Shea, R., & Wilson, D. (2018). Using complexity and network concepts to inform healthcare knowledge translation. Kerman University of Medical Sciences, 7(3), 231–243. Scholar
  122. Kitson, A. L., O’Shea, R., Brook, A., Harvey, G., Jordan, Z., Marshall, R., & Wilson, D. (2018). The knowledge translation complexity network (KTCN) model: The whole is greater than the sum of the parts – A response to recent commentaries. Kerman University of Medical Sciences, 7(8), 768–770. Scholar
  123. Koczwara, B., Stover, A. M., Davies, L., Davis, M. M., Fleisher, L., Ramanadhan, S., … Proctor, E. (2018). Harnessing the synergy between improvement science and implementation science in cancer: A call to action. Journal of Oncology Practice, 14(6), 335–340. Scholar
  124. Korb, K. B., & Nicholson, A. E. (2011). Bayesian artificial intelligence (2nd ed.). Boca Raton, FL: CRC Press.Google Scholar
  125. Kruk, M. E., Yamey, G., Angell, S. Y., Beith, A., Cotlear, D., Guanais, F., … Goosby, E. (2016). Transforming global health by improving the science of scale-up. PLoS Biology, 14(3), e1002360–e1002316. Scholar
  126. Landsverk, J., Brown, C. H., Rolls-Reutz, J., Palinkas, L. A., & Horwitz, S. M. (2010). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 54–63. Scholar
  127. Leeman, J., Birken, S. A., Powell, B. J., Rohweder, C., & Shea, C. M. (2017). Beyond “implementation strategies”: Classifying the full range of strategies used in implementation science and practice. Implementation Science, 12(1), 1–9. Scholar
  128. Lewis, C. C. (2015). The society for implementation research collaboration instrument review project: A methodology to promote rigorous evaluation. Implementation Science, 10(1), 1–18. Scholar
  129. Lewis, C. C., Fischer, S., Weiner, B. J., Stanick, C., Kim, M., & Martinez, R. G. (2015). Outcomes for implementation science: An enhanced systematic review of instruments using evidence-based rating criteria. Implementation Science, 10(1), 1–17. Scholar
  130. Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., … Weiner, B. (2018). From classification to causality: Advancing understanding of mechanisms of change in implementation science. Frontiers in Public Health, 6, 65–66. Scholar
  131. Lewis, C. C., Mettert, K. D., Dorsey, C. N., Martinez, R. G., Weiner, B. J., Nolen, E., … Powell, B. J. (2018). An updated protocol for a systematic review of implementation-related measures. Systematic Reviews, 7(66), 1–8. Scholar
  132. Lewis, C. C., Puspitasari, A., Boyd, M. R., Scott, K., Marriott, B. R., Hoffman, M., … Kassab, H. (2018). Implementing measurement based care in community mental health: A description of tailored and standardized methods. BMC Research Notes, 11(1), 606–607. Scholar
  133. Lewis, C. C., Scott, K., & Marriott, B. R. (2018). A methodology for generating a tailored implementation blueprint: An exemplar from a youth residential setting. Implementation Science, 13(68), 1–13. Scholar
  134. Lipsey, M. W. (2009). The primary factors that characterize effective interventions with juvenile offenders: A meta-analytic overview. Victims & Offenders, 4(2), 124–147. Scholar
  135. Liverani, M., Hawkins, B., & Parkhurst, J. O. (2013). Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One, 8(10), e77404. Scholar
  136. Long, J. C., Cunningham, F. C., & Braithwaite, J. (2013). Bridges, brokers and boundary spanners in collaborative networks: A systematic review. BMC Health Services Research, 13(158), 1–13.Google Scholar
  137. Lyon, A. R., Cook, C. R., Brown, E. C., Locke, J., Davis, C., Ehrhart, M. G., & Aarons, G. A. (2018). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13(5), 1–14. Scholar
  138. Martinez, R. G., Lewis, C. C., & Weiner, B. J. (2014). Instrumentation issues in implementation science. Implementation Science, 9(118), 1–9. Scholar
  139. Maru, S., Nirola, I., Thapa, A., Thapa, P., Kunwar, L., Wu, W.-J., … Maru, D. (2018). An integrated community health worker intervention in rural Nepal: A type 2 hybrid effectiveness-implementation study protocol. Implementation Science, 13(53), 1–11. Scholar
  140. May, C. R., & Finch, T. L. (2009). Implementing, embedding, and integrating practices: An outline of normalization process theory. Sociology, 43(3), 535–554. Scholar
  141. May, C. R., Johnson, M., & Finch, T. L. (2016). Implementation, context and complexity. Implementation Science, 11(1), 1–12. Scholar
  142. Mazza, D., Bairstow, P., Buchan, H., Chakraborty, S. P., van Hecke, O., Grech, C., & Kunnamo, I. (2013). Refining a taxonomy for guideline implementation: Results of an exercise in abstract classification. Implementation Science, 8(32), 1–10. Scholar
  143. Mazzucca, S., Tabak, R. G., Pilar, M., Ramsey, A. T., Baumann, A. A., Kryzer, E., … Brownson, R. C. (2018). Variation in research designs used to test the effectiveness of dissemination and implementation strategies: A review. Frontiers in Public Health, 6, 1–10. Scholar
  144. Mbuagbaw, L., Aves, T., Shea, B., Jull, J., Welch, V., Taljaard, M., … Tugwell, P. (2017). Considerations and guidance in designing equity-relevant clinical trials. International Journal for Equity in Health, 16(93), 1–9. Scholar
  145. McCormack, B. G., Kitson, A. L., Harvey, G., Rycroft-Malone, J., Titchen, A., & Seers, K. (2002). Getting evidence into practice: The meaning of ‘context’. Journal of Advanced Nursing, 38(1), 94–104.CrossRefGoogle Scholar
  146. McCrabb, S., Lane, C., Hall, A., Milat, A. J., Bauman, A., Sutherland, R., … Wolfenden, L. (2019). Scaling-up evidence-based obesity interventions: A systematic review assessing intervention adaptations and effectiveness and quantifying the scale-up penalty. Obesity Reviews, 20(7), 964–982. Scholar
  147. McKay, V. R., Dolcini, M. M., & Hoffer, L. D. (2017). The dynamics of de-adoption: A case study of policy change, de-adoption, and replacement of an evidence-based HIV intervention. Translational Behavioral Medicine, 7(4), 1–11. Scholar
  148. McKay, V. R., Hoffer, L. D., Combs, T. B., & Dolcini, M. M. (2018). The dynamic influence of human resources on evidence-based intervention sustainability and population outcomes: An agent-based modeling approach, 1–10.
  149. McKay, V. R., Morshed, A. B., Brownson, R. C., Proctor, E. K., & Prusaczyk, B. (2018). Letting go: Conceptualizing intervention de-implementation in public health and social service settings. American Journal of Community Psychology, 38(Suppl 4), 4–14. Scholar
  150. McKenzie, A., Alpers, K., Heyworth, J., Phuong, C., & Hanley, B. (2016). Consumer and community involvement in health and medical research: Evaluation by online survey of Australian training workshops for researchers. Research Involvement and Engagement, 2(16), 1–15. Scholar
  151. McNulty, M., Smith, J. D., Villamar, J., Burnett-Zeigler, I., Vermeer, W., Benbow, N., … Hendricks Brown, C. (2019). Implementation research methodologies for achieving scientific equity and health equity. Ethnicity & Disease, 29(Suppl 1), 83–92.CrossRefGoogle Scholar
  152. Meissner, H. I., Glasgow, R. E., Vinson, C. A., Chambers, D. A., Brownson, R. C., Green, L. W., … Mittman, B. (2013). The U.S. training institute for dissemination and implementation research in health. Implementation Science, 8(12), 1–9.Google Scholar
  153. Meyers, D. C., Wandersman, A., & Durlak, J. A. (2012). The quality implementation framework: A synthesis of critical steps in the implementation process. American Journal of Community Psychology, 50(3–4), 462–480. Scholar
  154. Michie, S., Fixsen, D., Grimshaw, J., & Eccles, M. P. (2009). Specifying and reporting complex behaviour change interventions: The need for a scientific method. Implementation Science, 4(1), 1238–1236. Scholar
  155. Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J. J., Hardeman, W., … Wood, C. E. (2013). The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine, 46(1), 81–95. Scholar
  156. Michie, S., van Stralen, M. M., & West, R. (2011). The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science, 6(1), 42. Scholar
  157. Milat, A. J., King, L., Bauman, A., & Redman, S. (2013). The concept of scalability: Increasing the scale and potential adoption of health promotion interventions into policy and practice. Health Promotion International, 28(3), 285–298. Scholar
  158. Mitton, C., Adair, C. E., McKenzie, E., Patten, S. B., & Perry, B. W. (2007). Knowledge transfer and exchange: Review and synthesis of the literature. The Milbank Quarterly, 85(4), 729–768.CrossRefGoogle Scholar
  159. Montgomery, P., Grant, S., Hopewell, S., Macdonald, G., Moher, D., Michie, S., & Mayo-Wilson, E. (2013). Protocol for CONSORT-SPI: An extension for social and psychological interventions. Implementation Science, 8(1), 1–7. Scholar
  160. Moore, J. E., Mascarenhas, A., Bain, J., & Straus, S. E. (2017). Developing a comprehensive definition of sustainability. Implementation Science, 12(1), 1–8. Scholar
  161. Morgan, F., Battersby, A., Weightman, A. L., Searchfield, L., Turley, R., Morgan, H., … Ellis, S. (2016). Adherence to exercise referral schemes by participants – What do providers and commissioners need to know? A systematic review of barriers and facilitators. BMC Public Health, 16(227), 1–11. Scholar
  162. Mosson, R., von Thiele Schwarz, U., Hasson, H., Lundmark, R., & Richter, A. (2018). How do iLead? Validation of a scale measuring active and passive implementation leadership in Swedish healthcare. BMJ Open, 8(6), e021992–e021911. Scholar
  163. Mosson, R., von Thiele Schwarz, U., Richter, A., & Hasson, H. (2018). The impact of inner and outer context on line managers’ implementation leadership. British Journal of Social Work, 48(5), 1447–1468. Scholar
  164. Moulton, S., & Sandfort, J. (2017). The strategic action field framework for policy implementation research. Policy Studies Journal, 45(1), 144–169.CrossRefGoogle Scholar
  165. Mullen, E. J., Shlonsky, A., Bledsoe, S. E., & Bellamy, J. L. (2005). From concept to implementation: Challenges facing evidence-based social work. Evidence & Policy: a Journal of Research, Debate and Practice, 1(1), 61–84.CrossRefGoogle Scholar
  166. Mullen, E. J., & Streiner, D. L. (2004). The evidence for and against evidence-based practice. Brief Treatment and Crisis Intervention, 4(2), 111–121. Scholar
  167. Nápoles, A. M., & Stewart, A. L. (2018). Transcreation: An implementation science framework for community-engaged behavioral interventions to reduce health disparities. BMC Health Services Research, 1–15.
  168. Newman, J., Cherney, A., & Head, B. W. (2015). Do policy makers use academic research? Reexamining the “two communities” theory of research utilization. Public Administration Review, 76(1), 24–32. Scholar
  169. Nilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013). Never the twain shall meet? – A comparison of implementation science and policy implementation research. Implementation Science, 8(63), 1–12. Scholar
  170. Niven, D. J., Mrklas, K. J., Holodinsky, J. K., Straus, S. E., Hemmelgarn, B. R., Jeffs, L. P., & Stelfox, H. T. (2015). Towards understanding the de-adoption of low-value clinical practices: A scoping review. BMC Medicine, 13(1), 1–21. Scholar
  171. Noel, V. A. (2017). Barriers and facilitators to sustainment of an evidence-based supported employment program. Administration and Policy in Mental Health and Mental Health Services Research, 44(3), 331–338. Scholar
  172. Northridge, M. E., & Metcalf, S. S. (2016). Enhancing implementation science by applying best principles of systems science. Health Research Policy and Systems, 14(74), 1–8. Scholar
  173. Norton, W. E., Kennedy, A. E., & Chambers, D. A. (2017). Studying de-implementation in health: An analysis of funded research grants. Implementation Science, 12(144), 1–13. Scholar
  174. Norton, W. E., Lungeanu, A., Chambers, D. A., & Contractor, N. (2017). Mapping the growing discipline of dissemination and implementation science in health. Scientometrics, 286, 1–24. Scholar
  175. Olasoji, M., Cross, W., Reed, F., Wang, W., Jacob, S., & Plummer, V. (2019). Mental health nurses’ attitudes towards consumer involvement in nursing handover pre and post an educational implementation. International Journal of Mental Health Nursing, 30(2), 12–11. Scholar
  176. Oliver, K., & Faul, M. V. (2018). Networks and network analysis in evidence, policy and practice. Evidence & Policy: a Journal of Research, Debate and Practice, 14(3), 369–379. Scholar
  177. Oliver, K., Innvar, S., Lorenc, T., Woodman, J., & Thomas, J. (2014). A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Services Research, 14(1), 1–12. Scholar
  178. Örtenblad, A., Putnam, L. L., & Trehan, K. (2016). Beyond Morgan’s eight metaphors: Adding to and developing organization theory. Human Relations, 69(4), 875–889. Scholar
  179. Øvretveit, J. (2009). Leading improvement effectively (pp. 1–105). London, UK: The Health Foundation.Google Scholar
  180. Øvretveit, J., Mittman, B. S., Rubenstein, L., & Ganz, D. A. (2017). Using implementation tools to design and conduct quality improvement projects for faster and more effective improvement. International Journal of Health Care Quality Assurance, 30(8), 755–768. Scholar
  181. Palinkas, L. A., Aarons, G. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2010). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53. Scholar
  182. Palinkas, L. A., Mendon, S. J., & Hamilton, A. B. (2019). Innovations in mixed methods evaluations. Annual Review of Public Health, 40(1), 423–442. Scholar
  183. Pantoja, T., Opiyo, N., Lewin, S., Paulsen, E., Ciapponi, A., Wiysonge, C. S., … Oxman, A. D. (2017). Implementation strategies for health systems in low-income countries: An overview of systematic reviews. (Cochrane Effective Practice and Organisation of Care Group, Ed.) Cochrane Database of Systematic Reviews, 10, 63–135.Google Scholar
  184. Papoutsi, C., Ruth, B., Foy, R., Grimshaw, J., & Rycroft-Malone, J. (2016). Challenges for Implementation Science. In Challenges, solutions and future directions in the evaluation of service innovations in health care and public health (pp. 121–132). National Institute for Health Research: Southhampton (U.K.).Google Scholar
  185. Parahoo, K. (1999). Barriers to, and facilitators of, research utilization among nurses in Northern Ireland. Journal of Advanced Nursing, 31(1), 89–98.CrossRefGoogle Scholar
  186. Parolini, A., Tan, W. W., & Shlonsky, A. (2018). A blueprint for causal inference in implementation systems. Social Science Research Network, 1–38.Google Scholar
  187. Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12(4), 365–383. Scholar
  188. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75(6), 829–841. Scholar
  189. Peters, D. H., Adam, T., Alonge, O., Agyepong, I. A., & Tran, N. (2013). Implementation research: What it is and how to do it. British Medical Journal, 347(nov20 1), f6753.
  190. Petrosino, A., Boruch, R. F., Soydan, H., Duggan, L., & Sanchez-Meca, J. (2001). Meeting the challenges of evidence-based policy: The Campbell Collaboration. The Annals of the American Academy of Political and Social Science, 578(1), 14–34.CrossRefGoogle Scholar
  191. Pfadenhauer, L. M., Gerhardus, A., Mozygemba, K., Lysdahl, K. B., Booth, A., Hofmann, B., … Rehfuess, E. (2017). Making sense of complexity in context and implementation: The Context and Implementation of Complex Interventions (CICI) framework. Implementation Science, 12(1), 1–17. Scholar
  192. Pfadenhauer, L. M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K. B., … Rehfuess, E. A. (2015). Context and implementation: A concept analysis towards conceptual maturity. Theriogenology, 109(2), 103–114. Scholar
  193. Pinnock, H. (2015). Developing standards for reporting implementation studies of complex interventions (StaRI): A systematic review and e-Delphi. Implementation Science, 10(1), 1–10. Scholar
  194. Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., … Morley, R. (2018). Stakeholder involvement in systematic reviews: A scoping review. Systematic Reviews, 1–26.
  195. Powell, B. J., Beidas, R. S., Lewis, C. C., Aarons, G. A., McMillen, J. C., Proctor, E. K., & Mandell, D. S. (2015). Methods to improve the selection and tailoring of implementation strategies. Journal of Behavioral Health Services Research, 44(2), 177–194. Scholar
  196. Powell, B. J., Beidas, R. S., Rubin, R. M., Stewart, R. E., Wolk, C. B., Matlin, S. L., … Mandell, D. S. (2016). Applying the policy ecology framework to Philadelphia’s behavioral health transformation efforts. Administration and Policy in Mental Health and Mental Health Services Research, 1–18.
  197. Powell, B. J., Fernandez, M. E., Williams, N. J., Aarons, G. A., Beidas, R. S., Lewis, C. C., … Weiner, B. J. (2019). Enhancing the impact of implementation strategies in healthcare: A research agenda. Frontiers in Public Health, 7, 503–509. Scholar
  198. Powell, B. J., Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Barwick, M. A., … Lewis, C. C. (2017). Toward criteria for pragmatic measurement in implementation research and practice: A stakeholder-driven approach using concept mapping. Implementation Science, 12(118), 1–7. Scholar
  199. Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., … Kirchner, J. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10(1), 1–14. Scholar
  200. Power, J., Gilmore, B., Vallières, F., Toomey, E., Mannan, H., & McAuliffe, E. (2019). Adapting health interventions for local fit when scaling-up: A realist review protocol. BMJ Open, 9(1), e022084–e022011. Scholar
  201. Prasad, V., & Ioannidis, J. P. A. (2014). Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implementation Science, 9(1), 1–5.CrossRefGoogle Scholar
  202. Pressman, J. L., & Wildavsky, A. B. (1974). Implementation. ICON Group International.Google Scholar
  203. Proctor, E. K., & Chambers, D. A. (2017). Training in dissemination and implementation research: A field-wide perspective. Translational Behavioral Medicine, 1–12.
  204. Proctor, E. K., Knudsen, K. J., Fedoravicius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34(5), 479–488. Scholar
  205. Proctor, E. K., Landsverk, J., Aarons, G. A., Chambers, D. A., & Mittman, B. S. (2008). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36(1), 24–34. Scholar
  206. Proctor, E. K., Landsverk, J., Baumann, A. A., Mittman, B. S., Brownson, R. C., Glisson, C., & Chambers, D. A. (2013). The implementation research institute: Training mental health implementation researchers in the United States. Implementation Science, 8(105), 1–12. Scholar
  207. Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(139), 1–11.Google Scholar
  208. Proctor, E. K., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G. A., Bunger, A. C., … Hensley, M. (2010). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. Scholar
  209. Purtle, J., Brownson, R. C., & Proctor, E. K. (2016). Infusing science into politics and policy: The importance of legislators as an audience in mental health policy dissemination research. Administration and Policy in Mental Health and Mental Health Services Research, 44(2), 160–163. Scholar
  210. Purtle, J., Peters, R., & Brownson, R. C. (2016). A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implementation Science, 11(1), 1–8. Scholar
  211. Rabin, B. A., Brownson, R. C., Haire-Joshu, D., Kreuter, M. W., & Weaver, N. L. (2008). A glossary for dissemination and implementation research in health. Journal of Public Health Management and Practice, 14(2), 117–123. Scholar
  212. Raghavan, R., Bright, C., & Shadoin, A. L. (2008). Toward a policy ecology of implementation of evidence-based practices in public mental health settings. Implementation Science, 3(1), 26–29. Scholar
  213. Rapley, T., Girling, M., Mair, F. S., Murray, E., Treweek, S., McColl, E., … Finch, T. L. (2018). Improving the normalization of complex interventions: Part 1 – Development of the NoMAD instrument for assessing implementation work based on normalization process theory (NPT). BMC Medical Research Methodology, 18(133), 1–17. Scholar
  214. Regehr, C., Stern, S., & Shlonsky, A. (2007). Operationalizing evidence-based practice: The development of an institute for evidence-based social work. Research on Social Work Practice, 17(3), 408–416. Scholar
  215. Reichenpfader, U., Carlfjord, S., & Nilsen, P. (2015). Leadership in evidence-based practice: A systematic review. Leadership in Health Services, 28(4), 298–316. Scholar
  216. Richter, A., von Thiele Schwarz, U., Lornudd, C., Lundmark, R., Mosson, R., & Hasson, H. (2016). iLead—A transformational leadership intervention to train healthcare managers’ implementation leadership. Implementation Science, 11(1), 1–13. Scholar
  217. Richter, L. M., Daelmans, B., Lombardi, J., Heymann, J., Boo, F. L., Behrman, J. R., … Paper 3 Working Group and the Lancet Early Childhood Development Series Steering Committee. (2017). Investing in the foundation of sustainable development: Pathways to scale up for early childhood development. The Lancet, 389(10064), 103–118.
  218. Ridde, V. (2016). Need for more and better implementation science in global health. BMJ Global Health, 1(2), e000115–e000113. Scholar
  219. Robinson, T. E., Janssen, A., Harnett, P., Museth, K. E., Provan, P. J., Hills, D. J., & Shaw, T. (2017). Embedding continuous quality improvement processes in multidisciplinary teams in cancer care: Exploring the boundaries between quality and implementation science. Australian Health Review, 41(3), 291–296. Scholar
  220. Roll, S., Moulton, S., & Sandfort, J. (2017). A comparative analysis of two streams of implementation research. Journal of Public and Nonprofit Affairs, 3(1), 3–20. Scholar
  221. Rousseau, D. M. (2007). Standing out in the fields of organization science. Journal of Organizational Behavior, 28(7), 849–857. Scholar
  222. Ruest, M., Léonard, G., Thomas, A., Desrosiers, J., & Guay, M. (2019). French cross-cultural adaptation of the Organizational Readiness for Implementing Change (ORIC). BMC Health Services Research, 19(535), 1–14. Scholar
  223. Rycroft-Malone, J. (2004). The PARIHS framework – A framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19(4), 297–304.CrossRefGoogle Scholar
  224. Rye, M., Torres, E. M., Friborg, O., Skre, I., & Aarons, G. A. (2017). The evidence-based practice attitude scale- 36 (EBPAS-36): A brief and pragmatic measure of attitudes to evidence-based practice validated in US and Norwegian samples. Implementation Science, 12(44), 1–11. Scholar
  225. Sackett, D. L., Rosenberg, W. C., Gray, J. A. M., Haynes, B. R., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. British Medical Journal, 312, 71–73.CrossRefGoogle Scholar
  226. Saldana, L. (2014). The stages of implementation completion for evidence-based practice: Protocol for a mixed methods study. Implementation Science, 9(43), 1–11. Scholar
  227. Saldana, L., Bennett, I., Powers, D., Vredevoogd, M., Grover, T., Schaper, H., & Campbell, M. (2019). Scaling implementation of collaborative care for depression: Adaptation of the stages of implementation completion (SIC). Administration and Policy in Mental Health and Mental Health Services Research, 1–9.
  228. Saldana, L., Chamberlain, P., Wang, W., & Brown, C. H. (2011). Predicting program start-up using the stages of implementation measure. Administration and Policy in Mental Health and Mental Health Services Research, 39(6), 419–425. Scholar
  229. Santesteban-Echarri, O., Hernández-Arroyo, L., Rice, S. M., Güerre-Lobera, M. J., Serrano-Villar, M., Espín-Jaime, J. C., & Jiménez-Arriero, M. Á. (2018). Adapting the brief coping cat for children with anxiety to a group setting in the Spanish public mental health system: A hybrid effectiveness-implementation pilot study. Journal of Child and Family Studies, 27, 3300–3315. Scholar
  230. Sarkies, M. N., Skinner, E. H., Bowles, K.-A., Morris, M. E., Williams, C., O’Brien, L., … Haines, T. P. (2019). A novel counterbalanced implementation study design: Methodological description and application to implementation research. Implementation Science, 14(45), 1–11. Scholar
  231. Schell, S. F., Luke, D. A., Schooley, M. W., Elliott, M. B., Herbers, S. H., Mueller, N. B., & Bunger, A. C. (2013). Public health program capacity for sustainability: A new framework. Implementation Science, 8(15), 1–9. Scholar
  232. Schliep, M. E., Alonzo, C. N., & Morris, M. A. (2018). Beyond RCTs: Innovations in research design and methods to advance implementation science. Evidence-Based Communication Assessment and Intervention, 1–17.
  233. Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83–103.CrossRefGoogle Scholar
  234. Schoenwald, S. K., Hoagwood, K. E., Atkins, M. S., Evans, M. E., & Ringeisen, H. (2010). Workforce development and the organization of work: The science we need. Administration and Policy in Mental Health and Mental Health Services Research, 37(1–2), 71–80. Scholar
  235. Shea, C. M., Jacobs, S. R., Esserman, D. A., Bruce, K., & Weiner, B. J. (2014). Organizational readiness for implementing change: A psychometric assessment of a new measure. Implementation Science, 9(7), 1–15.Google Scholar
  236. Shelton, R. C., Lee, M., Brotzman, L. E., Crookes, D. M., Jandorf, L., Erwin, D., & Gage-Bouchard, E. A. (2018). Use of social network analysis in the development, dissemination, implementation, and sustainability of health behavior interventions for adults: A systematic review. Social Science & Medicine, 220, 81–101. Scholar
  237. Shlonsky, A., Noonan, E., Littell, J. H., & Montgomery, P. (2010). The role of systematic reviews and the Campbell collaboration in the realization of evidence-informed practice. Clinical Social Work Journal, 39(4), 362–368. Scholar
  238. Simons, H., Kushner, S., Jones, K., & James, D. (2003). From evidence-based practice to practice-based evidence: The idea of situated generalisation. Research Papers in Education, 18(4), 347–364. Scholar
  239. Smith, J. D., Berkel, C., Rudo-Stern, J., Montaño, Z., St George, S. M., Prado, G., … Dishion, T. J. (2018). The family check-up 4 health (FCU4Health): Applying implementation science frameworks to the process of adapting an evidence-based parenting program for prevention of pediatric obesity and excess weight gain in primary care. Frontiers in Public Health, 6, 243–217. Scholar
  240. Squires, J. E. (2015). Identifying the domains of context important to implementation science: A study protocol. Implementation Science, 10(135), 1–9. Scholar
  241. Squires, J. E., Hayduk, L., Hutchinson, A. M., Mallick, R., Norton, P. G., Cummings, G. G., & Estabrooks, C. A. (2015). Reliability and validity of the Alberta context tool (ACT) with professional nurses: Findings from a multi-study analysis. PLoS One, 10(6), e0127405–e0127417. Scholar
  242. Stanick, C. F., Halko, H. M., Dorsey, C. N., Weiner, B. J., Powell, B. J., Palinkas, L. A., & Lewis, C. C. (2018). Operationalizing the “pragmatic” measures construct using a stakeholder feedback and a multi-method approach. BMC Health Services Research, 18(882), 1–12. Scholar
  243. Stetler, C. B. (2003). Role of the organization in translating research into evidence-based practice. Outcomes Management, 7(3), 97–103.Google Scholar
  244. Stetler, C. B., McQueen, L., Demakis, J., & Mittman, B. S. (2008). An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI series. Implementation Science, 3(1), 30. Scholar
  245. Stirman, S. W., Baumann, A. A., & Miller, C. J. (2019). The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions, 1–10.
  246. Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8(65), 1–12. Scholar
  247. Storkholm, M. H., Mazzocato, P., Tessma, M. K., & Savage, C. (2018). Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC). Implementation Science, 13(1), 1–7. Scholar
  248. Straus, S. E., Tetroe, J., & Graham, I. D. (2009). Defining knowledge translation. Canadian Medical Association Journal, 181(3–4), 165–168. Scholar
  249. Tabak, R. G., Strickland, J. R., Stein, R. I., Dart, H., Colditz, G. A., Kirk, B., … Evanoff, B. A. (2018). Development of a scalable weight loss intervention for low-income workers through adaptation of interactive obesity treatment approach (iOTA). BMC Public Health, 18(1), 1–11. Scholar
  250. Tommeraas, T., & Ogden, T. (2015). Is there a scale-up penalty? Testing behavioral change in the scaling up of parent management training in Norway. Administration and Policy in Mental Health and Mental Health Services Research, 1–14.
  251. Torfing, J., Sørensen, E., & Røiseland, A. (2018). Transforming the public sector into an arena for co-creation: Barriers, drivers, benefits, and ways forward. Administration & Society, 51(5), 795–825. Scholar
  252. Torres, E. M., Ehrhart, M. G., Beidas, R. S., Farahnak, L. R., Finn, N. K., & Aarons, G. A. (2018). Validation of the implementation leadership scale (ILS) with supervisors’ self-ratings. Community Mental Health Journal, 54(1), 49–53. Scholar
  253. Valente, T. W., Palinkas, L. A., Czaja, S., Chu, K.-H., & Brown, C. H. (2015). Social network analysis for program implementation. PLoS One, 10(6), e0131712–e0131718. Scholar
  254. van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Kleinjan, M., Aarons, G. A., & Tiemens, B. G. (2015). Psychometric properties of the Dutch version of the evidence-based practice attitude scale (EBPAS). Health Research Policy and Systems, 13(69), 1–12. Scholar
  255. Vis, C., Ruwaard, J., Finch, T. L., Rapley, T., de Beurs, D., van Stel, H., … Smit, J. (2019). Toward an objective assessment of implementation processes for innovations in health care: Psychometric evaluation of the normalization measure development (NoMAD) questionnaire among mental health care professionals. Journal of Medical Internet Research, 21(2), e12376–e12316. Scholar
  256. Wallerstein, N., & Duran, B. (2010). Community-based participatory research contributions to intervention research: The intersection of science and practice to improve health equity. American Journal of Public Health, 100(S1), S40–S47. Scholar
  257. Waltz, T. J., Powell, B. J., Chinman, M. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., … Kirchner, J. E. (2014). Expert recommendations for implementing change (ERIC): Protocol for a mixed methods study. Implementation Science, 9(39), 1–12.Google Scholar
  258. Waltz, T. J., Powell, B. J., Fernandez, M. E., Abadie, B., & Damschroder, L. J. (2019). Choosing implementation strategies to address contextual barriers: Diversity in recommendations and future directions. Implementation Science, 14(1), 1–15. Scholar
  259. Waltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., … Kirchner, J. E. (2015). Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: Results from the Expert Recommendations for Implementing Change (ERIC) study. Implementation Science, 10(1), 1–8. Scholar
  260. Ward, V. (2017). Why, whose, what and how? A framework for knowledge mobilisers. Evidence & Policy: a Journal of Research, Debate and Practice, 13(3), 477–497. Scholar
  261. Ward, V., House, A., & Hamer, S. (2009). Knowledge brokering: The missing link in the evidence to action chain? Evidence & Policy: a Journal of Research, Debate and Practice, 5(3), 267–279. Scholar
  262. Watson, D. P., Adams, E. L., Shue, S., Coates, H., McGuire, A., Chesher, J., … Omenka, O. I. (2018). Defining the external implementation context: An integrative systematic literature review. BMC Health Services Research, 18(1), 1–14. Scholar
  263. Weatherley, R., & Lipsky, M. (1977). Street-level bureaucrats and institutional innovation: Implementing special-education reform. Harvard Educational Review, 17(2), 171–197.CrossRefGoogle Scholar
  264. Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4(1), 67. Scholar
  265. Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., … Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation Science, 12(1), 65–13. Scholar
  266. Weiner, B. J., Lewis, M. A., & Linnan, L. A. (2008). Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Education Research, 24(2), 292–305. Scholar
  267. Welch, V., Jull, J., Petkovic, J., Armstrong, R., Boyer, Y., Cuervo, L. G., … Tugwell. (2015). Protocol for the development of a CONSORT-equity guideline to improve reporting of health equity in randomized trials. Implementation Science, 10(146), 1–11. Scholar
  268. Welch, V. A., Norheim, O. F., Jull, J., Cookson, R., Sommerfelt, H., Tugwell, P., & CONSORT-Equity and Boston Equity Symposium. (2017). CONSORT-Equity 2017 extension and elaboration for better reporting of health equity in randomised trials. British Medical Journal, 359, j5085–j5014. Scholar
  269. Wensing, M., & Grol, R. (2019). Knowledge translation in health: How implementation science could contribute more. Implementation Science, 17(88), 1–6. Scholar
  270. Whelan, J., Love, P., Millar, L., Allender, S., & Bell, C. (2018). Sustaining obesity prevention in communities: A systematic narrative synthesis review. Obesity Reviews, 19(6), 839–851. Scholar
  271. White, H. (2018). Theory-based systematic reviews. Journal of Development Effectiveness, 10(1), 17–38. Scholar
  272. Willging, C. E., Green, A. E., Gunderson, L. M., Chaffin, M. J., & Aarons, G. A. (2015). From a “Perfect Storm” to “Smooth Sailing”: Policymaker perspectives on implementation and sustainment of an evidence-based practice in two states. Child Maltreatment, 20(1), 24–36. Scholar
  273. Williams, J., Sevdalis, N., & Gaughran, F. (2019). Evaluation of a Physical health plan for people with psychosis: a protocol for a quality improvement study, 1–9.
  274. Williams, N. J., & Beidas, R. S. (2018). Annual research review: The state of implementation science in child psychology and psychiatry: A review and suggestions to advance the field. Journal of Child Psychology and Psychiatry, 60(4), 430–450. Scholar
  275. Williams, N. J., Glisson, C., Hemmelgarn, A., & Green, P. (2016). Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health and Mental Health Services Research, 1–15.
  276. Willis, C. D., Riley, B. L., Stockton, L., Abramowicz, A., Zummach, D., Wong, G., … Best, A. (2016). Scaling up complex interventions: Insights from a realist synthesis. Health Research Policy and Systems, 14(88), 1–16. Scholar
  277. Wolfenden, L., Albers, B., & Shlonsky, A. (2018). Strategies for scaling up the implementation of interventions in social welfare: Protocol for a systematic review. Campbell Systematic Reviews, 14(1), 1–33.CrossRefGoogle Scholar
  278. Woltmann, E. M., Whitley, R., McHugo, G. J., Brunette, M., Torrey, W. C., Coots, L., … Drake, R. E. (2008). The role of staff turnover in the implementation of evidence-based practices in mental health care. Psychiatric Services, 59, 732–737.CrossRefGoogle Scholar
  279. Woodward, E. N., Matthieu, M. M., Uchendu, U. S., Rogal, S., & Kirchner, J. E. (2019). The health equity implementation framework: Proposal and preliminary study of hepatitis C virus treatment. Implementation Science, 14(26), 1–18. Scholar
  280. World Health Organization. (2009). Practical guidance for scaling up health service innovations (pp. 1–64). Geneva, Switzerland: World Health Organization.Google Scholar
  281. Yapa, H. M., & Bärnighausen, T. (2018). Implementation science in resource-poor countries and communities. Implementation Science, 13(154), 1–13. Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.European Implementation CollaborativeCopenhagenDenmark
  2. 2.Monash UniversityClaytonAustralia
  3. 3.Centre for Evidence and ImplementationMelbourneAustralia

Personalised recommendations