Strategies for Building Delivery Science in an Integrated Health Care System
Health systems today have increasing opportunities and imperatives to conduct delivery science, which is applied research that evaluates clinical or organizational practices that systems can implement or encourage. Examples include research on eliminating racial/ethnic disparities in hypertension management and on identifying the types of patients who can successfully use video visits. Clinical leaders and researchers often face barriers to delivery science, including limited funding, insufficient leadership support, lack of engagement between operational and research leaders, limited pools of research expertise, and lack of pathways to identify and develop ideas. We describe five key strategies we employed to address these barriers and develop a portfolio of delivery science programs in Kaiser Permanente Northern California. This portfolio now includes small and medium-sized grant programs, training programs for postdoctoral research fellows and experienced physician researchers, and a dedicated team that partners with clinicians to develop high-priority ideas and conduct small projects. Most of our approaches are consistent with frameworks used to develop delivery science by other health systems; some are innovative. Most of these strategies are adaptable by other health systems prepared to make long-range organizational commitments to mechanisms that foster partnerships between clinical leaders and researchers.
KEY WORDSimplementation research health care delivery program evaluation medical informatics physician decision support
We are grateful to the executive leaders and physicians of The Permanente Medical Group (TPMG), including Robert Pearl, MD (Executive Director and CEO, 1999-2017), Richard Isaacs, MD (current Executive Director and CEO), and Yi-Fen Irene Chen, MD (current Associate Executive Director for quality and research) for their strong support and guidance of our delivery science portfolio. We acknowledge Richard Grant, MD, MPH, Julie Schmittdiel, PhD, Douglas Corley, MD, PhD (current Director of Delivery Science and Applied Research), Andy Avins, MD, MPH, and Lisa Herrinton, PhD, for their capable leadership of the programs described here. We thank Steven Schroeder, MD, Grace Lee, MD, MPH, Hal Sox, MD, and the anonymous reviewers for insightful suggestions on shaping this paper. This portfolio’s development has relied on the skillful contributions of our research scientists, project managers, and programmer/analysts, especially Beth Dameron, MS, Suzanne Furuya, MPH, MBA, and Stephanie Prausnitz, MPH.
This work was funded by TPMG, Kaiser Permanente Northern California.
Compliance with Ethical Standards
Conflict of Interest
The authors are employees of TPMG and have no other relationships or conflicts of interest to declare.
- 1.Whicher D. Accelerating Progress Toward Continuous Learning: A National Academy of Medicine Meeting Summary. Washington, DC: National Academy of Medicine; 2017. https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/systems/learning-health-systems/Learning-Health-Systems-Meeting-Summary.pdf. Accessed 5 Jan 2019.
- 11.Kilbourne AM, Elwy AR, Sales AE, Atkins D. Accelerating Research Impact in a Learning Health Care System: VA’s Quality Enhancement Research Initiative in the Choice Act Era. Med Care. 2017;55(7 Suppl 1):S4–S12.Google Scholar
- 13.Division of Research, Kaiser Permanente Northern California. Delivery Science Portfolio. https://divisionofresearch.kaiserpermanente.org/deliveryscience/deliveryscience/. Accessed 8 Sept 2018.
- 15.Schmittdiel JA, Dlott R, Young JD, Rothmann MB, Dyer W, Adams AS. The Delivery Science Rapid Analysis Program: A Research and Operational Partnership at Kaiser Permanente Northern California. Learn Health Syst. 2017;1(4). https://doi.org/10.1002/lrh2.10035.
- 17.Suh-Burgmann EJ, Flanagan T, Osinski T, Alavi M, Herrinton L. Prospective Validation of a Standardized Ultrasonography-Based Ovarian Cancer Risk Assessment System. Obstet Gynecol. 2018; https://doi.org/10.1097/AOG.0000000000002939.
- 20.James BC, Poulsen GP. The Case for Capitation. Harv Bus Rev. 2016;94(7-8):102–111, 134.Google Scholar
- 21.Gould MK. Annual Report 2017 of the Care Improvement Research Team. Pasadena, CA: Kaiser Permanente Southern California Department of Research and Evaluation; 2018.Google Scholar
- 22.National Institute for Health Research. NIHR Collaborations for Leadership in Applied Health Research and Care (CLAHRCs). https://www.nihr.ac.uk/about-us/how-we-are-managed/our-structure/infrastructure/collaborations-for-leadership-in-applied-health-research-and-care.htm. Accessed 8 Sept 2018.
- 23.Penn Medicine. Center for Health Care Innovation. https://healthcareinnovation.upenn.edu/. Accessed 8 Sept 2018.
- 25.Reed ME, Parikh R, Huang J, Ballard DW, Barr I, Wargon C. Real-Time Patient-Provider Video Telemedicine Integrated with Clinical Care. N Engl J Med. 2018;379(15):1478–1479.Google Scholar
- 26.Vinson DR, Mark DG, Chettipally UK, et al. Increasing Safe Outpatient Management of Emergency Department Patients With Pulmonary Embolism. Ann Intern Med 2018;169(12):855–865. https://doi.org/10.7326/M18-1206.