Study protocol: a cluster-randomized trial implementing Sustained Patient-centered Alcohol-related Care (SPARC trial)
Experts recommend that alcohol-related care be integrated into primary care (PC) to improve prevention and treatment of unhealthy alcohol use. However, few healthcare systems offer such integrated care. To address this gap, implementation researchers and clinical leaders at Kaiser Permanente Washington (KPWA) partnered to design a high-quality program of evidence-based care for unhealthy alcohol use: the Sustained Patient-centered Alcohol-related Care (SPARC) program. SPARC implements systems of clinical care designed to increase both prevention and treatment of unhealthy alcohol use. This clinical care for unhealthy alcohol use was implemented using three strategies: electronic health record (EHR) decision support, performance monitoring and feedback, and front-line support from external practice coaches with expertise in alcohol-related care (“SPARC implementation intervention” hereafter).
The purpose of this report is to describe the protocol of the SPARC trial, a pragmatic, cluster-randomized, stepped-wedge implementation trial to evaluate whether the SPARC implementation intervention increased alcohol screening and brief alcohol counseling (so-called brief interventions), and diagnosis and treatment of alcohol use disorders (AUDs) in 22 KPWA PC clinics.
The SPARC trial sample includes all adult patients who had a visit to any of the 22 primary care sites in the trial during the study period (January 1, 2015–July 31, 2018). The 22 sites were randomized to implement the SPARC program on different dates (in seven waves, approximately every 4 months). Primary outcomes are the proportion of patients with PC visits who (1) screen positive for unhealthy alcohol use and have documented brief interventions and (2) have a newly recognized AUD and subsequently initiate and engage in alcohol-related care. Main analyses compare the rates of these primary outcomes in the pre- and post-implementation periods, following recommended approaches for analyzing stepped-wedge trials. Qualitative analyses assess barriers and facilitators to implementation and required adaptations of implementation strategies.
The SPARC trial is the first study to our knowledge to use an experimental design to test whether practice coaches with expertise in alcohol-related care, along with EHR clinical decision support and performance monitoring and feedback to sites, increase both preventive care—alcohol screening and brief intervention—as well as diagnosis and treatment of AUDs.
The trial is registered at ClinicalTrials.Gov: NCT02675777. Registered February 5, 2016, https://clinicaltrials.gov/ct2/show/NCT02675777.
KeywordsAlcohol drinking Prevention Alcohol use disorders Primary care, implementation, stepped-wedge, pragmatic trial
Alcohol or drug
Alcohol use Disorders Identification Test-Consumption
Alcohol use disorders
Columbia Suicide Severity Rating Scale
Diagnostic and Statistical Manual, 5th edition
Drug use disorder
Electronic health record
International Classification of Diseases codes, 9th edition
Kaiser Permanente Washington
Kaiser Permanente Washington Health Research Institute
Licensed independent clinical social worker
US National Committee for Quality Assurance
Natural language processing
Two-item Patient Health Questionnaire depression screen
Nine-item Patient Health Questionnaire depression screen
Substance Abuse and Mental Health Services Administration
Screening and brief intervention
Sustained Patient-centered Alcohol-related Care
Unhealthy alcohol use, a common cause of death and disability , includes a spectrum from risky drinking to alcohol use disorders (AUDs) [2, 3]. Risky drinking—drinking above recommended limits —can lead to the development of AUDs and increases risk of a number of other health problems such as trauma, cirrhosis, cancer, and poor management of other chronic diseases [5, 6, 7, 8, 9, 10]. Unhealthy alcohol use is common—over 25% of US adults report risky drinking , and 13.9% have AUDs . Unhealthy alcohol use is often not recognized by medical providers , and most people with AUDs never receive treatment [12, 14].
Evidence-based care for unhealthy alcohol use includes both prevention and treatment. The US Preventive Services Task Force recommends routine alcohol screening and brief alcohol counseling for patients who screen positive for risky drinking (screening and brief intervention, SBI) [2, 3]. The National Commission on Prevention Priorities ranks alcohol SBI for unhealthy alcohol use as the third highest prevention priority for US adults . For AUD treatment, systematic reviews and evidence-based guidelines support several treatment options, including three US Food and Drug Administration-approved medications [16, 17], counseling (motivational enhancement therapy, cognitive behavioral therapy, and couples counseling) , and specialty alcohol treatment [16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27].
Most health systems do not provide high-quality alcohol-related care. Most have not implemented routine SBI, and patients rarely are offered evidence-based prevention or treatment for unhealthy alcohol use. In a World Health Organization project implementing SBI across 10 nations, healthcare systems screened 2–26% of patients across countries, and rates of brief interventions among patients with unhealthy alcohol use were so low that 10% was defined as a “high” rate of brief intervention . A 2011 systematic review on implementation of preventive care for unhealthy alcohol use  found that no healthcare system had successfully implemented sustained high-quality SBI. Receipt of effective treatments for AUD, including pharmacotherapy and specialty treatment, is also rare [30, 31, 32, 33, 34]. An important study found that the quality of US medical care for AUDs was poorer compared to any other common chronic disease , and this has not changed in the years since .
Efforts to implement improved alcohol-related preventive care have had both successes and challenges. One successful implementation of SBI—a preventive intervention—in healthcare settings was integration at more than 900 Veterans Affairs (VA) clinical sites nationwide [37, 38, 39]. Embedded VA investigators partnered with VA leaders to implement SBI using two strategies that addressed many issues important in dissemination and implementation:  (1) performance monitoring with SBI quality indicators and feedback to sites and (2) dissemination of electronic health record (EHR) decision support for screening and brief intervention . Technical assistance and knowledge transfer was supported by a nationally disseminated technical manual and training materials and was performed by local leaders . This process resulted in sustained high rates of documented screening (> 90%) and brief intervention (78%) across 21 VA networks . Although implementation of alcohol SBI in the VA increased patient report of receiving alcohol-related advice , it also had limitations. The VA implementation strategies resulted in variable-quality screening [44, 45], incomplete understanding and “ownership” of preventive alcohol-related care among front-line primary care (PC) staff , and unclear benefits in reducing consumption among patients [47, 48]. Moreover, biased denominators may have impacted performance monitoring [45, 49], and incentives to document brief intervention may have led to increased EHR documentation of brief intervention that was already occurring .
Little research has addressed how to improve diagnosis and treatment of AUDs among PC patients, but most efforts focus on “referral to” or “linkage to” treatment as the only option for patients with AUDs [13, 51]. Since the COMBINE trial showed that medications could benefit patients even without specialized treatment , increased focus has been placed on management of AUDs in PC, often with medications [16, 17, 53]. One approach to increasing diagnosis and treatment of AUDs in PC patients is to use brief standardized measures  based on the Diagnostic and Statistical Manual (DSM) to identify AUDs  and link patients with care managers [17, 18, 53, 55]. Increasing focus has also been placed on shared decision-making and management of AUDs [17, 18, 53, 55, 56, 57, 58, 59]. These approaches to improving clinical care for AUDs have been integrated into a “Behavioral Health Lab” to support PC , but no previous research to our knowledge has tested implementation strategies to integrate routine assessment for AUDs and shared decision-making about treatment options into PC as a means to improve AUD diagnosis and treatment.
The Sustained Patient-centered Alcohol-related Care (SPARC) trial
The SPARC implementation intervention includes three strategies designed to support sustained delivery of the above SPARC clinical care: EHR clinical decision support; performance monitoring and feedback; and front-line support from practice coaches with expertise in alcohol-related care (Fig. 1). These strategies built on lessons learned from the VA [37, 38, 39, 61], and were refined in a pilot study in three Kaiser Permanente Washington (KPWA) clinics in 2015 .
Screen positive for unhealthy alcohol use and have documented brief interventions, and
Have AUDs identified and subsequently initiate and engage in treatment for AUDs.
The trial is conducted in the 22 PC clinics of KPWA, which includes all PC clinics that did not participate in the three-clinic SPARC pilot study . Prior to SPARC implementation, the health system had no population-based preventive SBI (e.g., when measured at three clinics, 8.9% of patients were screened for unhealthy alcohol use) , and of an estimated 381,550 total patients who received care at KPWA in 2014, only an estimated 0.04% per year were engaged in AUD care based on the International Classification of Diseases codes, 9th edition (ICD-9) used by the National Committee for Quality Assurance (NCQA) Healthcare Effectiveness Data and Information Set (HEDIS) measures for Alcohol and Drug Use Disorders.
Behavioral health integration added to SPARC
Clinical care implemented in the 22 PC clinics as part of behavioral health integration
SPARC clinical care
Unhealthy alcohol use
DSM-5 AUD Symptom
• Preventive brief intervention
• Shared decision-making: AUD treatment options
• AUD medications as indicated
• Warm handoffs to LICSWs
Other Behavioral Health Integration implemented at same time supported by the SPARC trial
Depression and suicidality
• Shared decision-making: depression treatment options
• Depression medications as indicated
• Crisis response plan
• Warm handoffs to LICSWs
DSM-5 DUD Symptom
• Shared decision-making about treatment options
• Warm handoffs to LICSWs
Single item 
DSM-5 DUD Symptom
• Shared decision-making about treatment options
• Prescribe or refer for medications for opioid use disorder
• Warm handoffs to LICSWs
Structure of the research-operations partnership
The trial is a partnership, begun in 2014, between researchers at Kaiser Permanente Washington Health Research Institute (KPWHRI) and KPWA clinical leaders in Behavioral Health Services. Details about organization of the research-operations partnership are included in an additional file [see Additional file 1].
Health system addition of integrated behavioral health clinicians trained in managing substance use disorders
The initial design of the SPARC intervention did not include integrated behavioral health clinicians because they did not exist in KPWA. In the year prior to the SPARC trial, KPWA leaders decided to shift the role of licensed independent clinical social workers (LICSWs) in PC from that of medical social workers to integrated behavioral health clinicians. Details about trainings and an EHR registry used to facilitate this shift are described in an additional file [see Additional file 1].
The three SPARC implementation strategies
EHR decision support. EHR decision support was developed to guide screening for, assessing, and managing unhealthy alcohol use (Table 1) . EHR tools are described in detail in an additional file [see Additional file 1]). Briefly, EHR prompts alert medical assistants (MAs) or other staff who room patients (MAs hereafter) to give patients a seven-item paper behavioral health screen, which includes the three-item Alcohol Use Disorders Identification Test-Consumption (AUDIT-C). Based on AUDIT-C results, the EHR alerts the MA to give providers a handout on alcohol use and health for patients needing a brief intervention (if AUDIT-C ≥ 3 points women or ≥ 4 men), and/or to ask patients to complete the paper Alcohol Symptom Checklist, which includes 11 questions based on DSM, 5th Edition (DSM-5) AUD criteria (if AUDIT-C 7-12). EHR prompts were also developed to alert providers about the need for a “warm handoff” to an LICSW or to schedule follow-up care to initiate treatment for patients with new AUDs. The EHR also prompts MAs at future visits to ask patients with an AUD diagnosis to complete a “monitoring tool” that includes the AUDIT-C.
Performance monitoring and feedback. Audit and feedback can be effective for changing health care practices, especially when it is repeated and includes targets . The study team developed several metrics for monitoring and providing weekly feedback to PC clinics and delivery system leaders based on data extracted from the EHR . Details about performance monitoring and feedback are provided in an additional file [see Additional file 1].
- 3.External practice coaches provide ongoing front-line support for ~ 6 months. Practice coaching is also a proven approach to quality improvement in PC . This third strategy is a multi-pronged approach using practice coaches to help overcome stigma, improve knowledge, and enhance perceived importance of alcohol-related care (Table 2), while supporting quality improvement processes. Each of these is described in further detail below.Table 2
Front-line support led by practice coaches in the SPARC trial
Partner with a local implementation team
• Initial clinic leadership meeting—to schedule meetings and form local implementation team
• Initial local implementation team meetings—two 2-h meetings
• Weekly 1-h meetings with local implementation team
• Monthly meetings with local implementation team and leaders (behavioral health and PC)
• One-hour training for all PC providers and staff together
• One-hour PC provider and RN training
• One-hour MA training for medical assistants and licensed practical nurses
• Learning sessions for PC champions from local implementation teams every 2 weeks by telephone
• Ten-minute white board video reframing alcohol and heath by Dr. Mike Evans 
• Handout reframing alcohol and health (Additional file 2)
Practice coaches work with interdisciplinary local implementation teams
During the usual care phase (1 month prior to preparation), the practice coach, PI, and behavioral health leaders have an initial in-person meeting with local clinic leadership to provide an overview of the implementation timeline, guidance for choosing the clinic’s interdisciplinary local implementation team, and set the local meeting schedule. The local implementation team includes an MA, PC provider, and LICSW from each clinic, at a minimum, and if possible a registered nurse (RN), the clinic manager, and the PC clinic medical director.
The preparation phase begins 2 months before each clinic’s randomly assigned launch date for SPARC clinical care (and Behavioral Health Integration). At the start of the preparation phase, practice coaches have two 2-h meetings to introduce local implementation team members to SPARC clinical care, as well as Behavioral Health Integration generally. The goal of this meeting is to build team cohesiveness and engage team members in sharing how providing integrated behavioral health care will benefit their patients and support the clinic’s mission. Practice coaches and the team also develop a deeper understanding of the clinic’s mission, patients, staff, communication practices, and workflows. Subsequently, coaches meet weekly with the local implementation team for the remainder of the preparation phase while they pilot and iteratively adapt the core workflow to fit with the clinic’s local culture, develop job aids and clinical tools, and make communication plans with the rest of the PC clinic. The coach also teaches quality improvement skills to team members.
The active implementation phase begins on the randomly assigned day when the clinic is intended to launch SPARC (and Behavioral Health Integration) clinical care. During active implementation, the coach has weekly meetings with the local implementation team for 3 months, and then every other week meetings for the last month. These plan-do-check-adjust (PDCA) meetings use performance feedback data to help teams identify gaps in SPARC and Behavioral Health Integration clinical care and test solutions. One meeting per month is replaced with a larger “PDCA meeting” with local and/or regional leaders and behavioral health partners to increase sustainability by problem-solving larger systemic issues.
The sustainment phase begins after the 4 months of active implementation have concluded, when clinics are no longer supported by a practice coach. During sustainment, clinics receive monthly performance monitoring and feedback and have quarterly PDCA meetings with Behavioral Health Service leaders.
In addition to weekly meetings with the local implementation team, practice coaches and/or other SPARC team members lead three 1-h trainings for each PC clinic during the preparatory phase prior to launching SPARC (and Behavioral Health Integration). Details about training content and participants are included in an additional file [see Additional file 1].
Innovative materials were developed to address stigma during the SPARC pilot, including a patient handout “Alcohol and Health” and a short entertaining video with whiteboard drawing . Both tools reframe unhealthy alcohol use by addressing stereotypes and providing new knowledge about alcohol and health. The handout was designed for PC providers and RNs to use with patients during a brief intervention and includes the following: current scientific views of screening for alcohol and AUDs in general (vs old stereotypes), recommended limits, alcohol-related medical conditions, and symptoms of AUDs. Providers and RNs are trained to offer preventive brief interventions to all patients who “drink regularly” (i.e., AUDIT-C ≥ 3 points women, ≥ 4 men) which is less stigmatized than referring to “positive” screens for risky drinking. The alcohol video is used as part of the initial 1-h training with all PC staff to help all staff understand a shift from an old focus of addressing alcohol use only with patients with recognized AUDs to a broader approach that addresses the entire spectrum of unhealthy alcohol use in PC (from risky drinking to AUDs), including prevention. A link to the video  is included in the patient handout.
Weekly formative evaluation meetings
Throughout the trial, practice coaches meet weekly with the trial’s principal investigator and the research project manager (who takes detailed notes) for formative evaluation to identify barriers, facilitators, and adaptations necessary for implementation strategies to be successful. Each practice coach reports on experiences in the field that week, by clinic, and issues are identified to discuss in the weekly Behavioral Health Integration operations team meeting.
Methods for evaluating the impact of the SPARC intervention
Study design and sample
Stratified randomization was used, with 9 clinics randomized in year 1 (three sites in each of three waves), and the remaining 13 clinics randomized in years 2–3 (Fig. 3). Clinics randomized in year 1 are referred to as Y1 sites and those randomized in years 2–3 as Y2 sites. The random assignment to study wave within Y1 and Y2 was generated using a computer-generated list of random numbers by the study biostatistician after all sites were recruited. An additional file describes our randomization scheme and rationale in detail [see Additional file 1].
Four phases of the SPARC trial
Figure 2 shows the four phases of implementation in each clinic. As above, each clinic has approximately 6 months of support from practice coaches, including up to 8 weeks in the “preparation” phase, before the official launch date of SPARC/Behavioral Health Integration, followed by the 4-month “active implementation” phase after the launch date. During the preparation phase, the local implementation team designs and pilots the workflow, with EHR prompts often activated for individuals involved in the piloting. The “launch date” is predetermined as the date when the clinic is intended to activate EHR clinical decision support for all its providers. The stepped-wedge design means that the clinics have varying amounts of time in the usual care phase—before the preparation phase begins, as well as in the sustainment phase—after the active implementation phase ends (Fig. 3).
All data used to identify the sample, quantitative outcomes, and covariates for this trial are obtained from the Epic EHR and insurance claims. Discrete EHR data and dates are obtained for screenings (e.g., AUDIT-C), assessments (e.g., Alcohol Symptom Checklist), ICD-9 and ICD-10 codes, procedure codes (e.g., V and Z codes used to document brief intervention), medications (e.g., naltrexone), and KPWA utilization inside and outside PC including location (e.g., PC visits to each clinic, visits to LICSWs or specialty mental health clinics). KPWA does not have any internal specialty addiction treatment programs, but data on utilization of specialty addiction treatment in the community will be available from insurance claims.
In addition, natural language processing (NLP) will be used to identify brief interventions documented as templated-free text in the EHR. To identify all templates used to document alcohol-related advice or counseling before and/or after SPARC implementation, including templates made by individual providers as well as those developed by a KPWA quality and clinical improvement office, NLP is used to identify text documentation that includes any keywords and their abbreviations (e.g., alcohol, EtOH, and drink). Identified text that repeats is reviewed by research staff to identify documentation that indicates alcohol-related counseling or advice to change drinking. Templated text identified as brief intervention includes documentation summarized in progress notes and after-visit summaries.
SPARC trial primary, secondary, and other outcomes from EHR and claims data
Alcohol Brief Intervention
Indicator for whether a patient had a brief intervention documented in the EHR* on the day of, or in the 14 days following a PC visit, and had a positive alcohol screen on the day of the visit or in the prior 365 days*
Treatment for Newly Diagnosed AUD (NCQA)
Indicator for whether a patient had a new AUD diagnosis* and initiated and engaged in AUD treatment*
Alcohol screening documented
Indicator for whether a patient had AUDIT-C screening documented in the EHR on the day of the visit or in the prior 365 days
Positive alcohol screen
Indicator for whether a patient screened positive on the AUDIT-C (3–12 women and 4–12 men)
High-positive alcohol screen
Indicator for whether a patient had a high-positive AUDIT-C score (7–12 points)
Assessed for DSM-5 AUD symptoms
Indicator for whether a patient with a high-positive screen completed an AUD Symptom Checklist on the day of the visit or in the prior 365 days
Past-year AUD diagnosis
Indicator for whether a patient had an AUD diagnosis defined as an ICD code for an AUD diagnosis per NCQA anywhere in or outside KPWA (e.g. includes claims) on the day of the PC visit or in the prior 365 days
New AUD diagnosis
Indicator that a “past-year AUD diagnosis” (defined immediately above) was new on the day of the PC visit, based on no AUD diagnosis in the prior 365 days
Initiation of AUD treatment (NCQA)
Indicator for whether a patient received a “new AUD diagnosis” (defined above) and initiated AUD treatment in the following 14 days, per HEDIS ICD codes
Engagement in AUD treatment (NCQA)
Indicator for whether a patient who initiated AUD treatment (defined above) had another 2 treatment visits in the following 30 days after initiation (“engagement”) per HEDIS ICD codes
Alcohol SBI. The primary measure of alcohol SBI requires that a patient who has a PC visit has screened positive for unhealthy alcohol use on the day of the visit or in the past year (AUDIT-C ≥ 3 for women and ≥ 4 for men) and has a brief intervention documented on the day of the visit or in the following 14 days . Our indicator of brief intervention is a composite measure based on two data sources: NLP and ICD codes. Patients are considered to have a brief intervention on a certain day if NLP indicates they had documentation of brief intervention with a template on that day (as described above under data collection) and/or if the PC visit is coded with a V or Z code for brief intervention, from ICD-9 and ICD-10 systems, respectively.
The NCQA released a new (2018) HEDIS performance measure for alcohol SBI with a 2-month window for follow-up, in contrast to the 14-day window of our primary outcome, so this will be evaluated as a secondary outcome . Changes over the four phases of implementation in the prevalence of alcohol screening and positive AUDIT-C screens will be described as intermediary measures.
AUD treatment. The primary measure of AUD treatment is whether patients with a new AUD diagnosis initiate and engage in treatment for AUD. The definitions for initiation and engagement are based on ICD-9 or ICD-10 codes and timeframes used in NCQA’s alcohol or drug (AOD) HEDIS measures , a commonly used definition of AUD treatment. However, the definition used for a “new AUD diagnosis” for the primary outcome differs from NCQA’s measure: instead of referring to the first AUD diagnosis in each calendar year with no AUD diagnosis in the prior 60 days, the measure of new AUD diagnoses used in this trial requires a 1-year “look-back” period with no AUD diagnosis. The primary measure requires a face-to-face visit coded with an AUD diagnosis within 14 days of a new diagnosis (consistent with the HEDIS AOD “initiation” measure during most of the trial), and two more visits coded with AUD diagnoses in the 30 days after initiation (consistent with HEDIS “engagement” visits). Because it often takes longer than 14 days to wait for a follow-up PC appointment, making it difficult for patients with AUD to have three visits in PC in 44 days, and because the HEDIS AOD measure changed to include telephone visits starting in 2018, sensitivity analyses will evaluate whether our findings are sensitive to timeframe and exclusion of telephone visits, by allowing initiation in 30 days, engagement in 60 days, and inclusion of telephone visits.
The HEDIS AOD measures might categorize health care visits as AUD treatment when in fact they are not because clinicians can appropriately code visits with an AUD diagnosis to indicate their care is complicated by AUDs rather than reflecting treatment of AUD. Therefore, to estimate how often patients are likely to be receiving behavioral or medication treatments for AUDs, secondary, more stringent measures of AUD treatment will consider visits coded for AUDs to indicate initiation and engagement of AUD treatment only if they are visits to a behavioral health provider or visits in which AUD medications are prescribed in the 44 days after the new diagnosis, or a visit to specialty addiction treatment outside KPWA (Table 3).
Samples and time intervals. A population-based denominator is used in all analyses as the least-biased denominator because clinical site implementation of the SPARC and Behavioral Health Integration interventions is expected to change the proportion and characteristics of patients screened, the proportion who screen positive for unhealthy alcohol use, and the proportion and characteristics of those diagnosed with AUDs. Unless otherwise specified, the sample for each measure is the set of patients who have a PC visit to a PC clinical site for any reason during each time interval used in analyses. Time intervals used in analyses are typically 4 weeks (i.e., 28-day intervals before and after each clinic’s specified launch date). This interval is selected to provide adequate numbers of outcomes per interval . Specifically, primary analyses will compare the monthly (28-day) proportion of patients with each outcome in the pre- versus post-implementation periods.
The primary analysis
Primary analyses compare months before vs. months after the assigned launch date (usual care + preparation phases vs. active implementation + sustainment phases).
a. Usual care vs. active implementation
b. Usual care vs. sustainment
c. Active implementation vs. sustainment
Secondary analyses, parallel to the primary analyses, will assess each intermediate outcome, as explanatory analyses, in the pre- versus post-implementation periods. If increases in alcohol screening and AUD assessment (Table 3) are observed, secondary patient-level analyses will evaluate whether screening is associated with increased brief interventions, and whether completing an Alcohol Symptom Checklist is associated with increased new AUD diagnoses. Additional secondary analyses and sensitivity analyses are described in an additional file [see Additional file 1].
With 19 sites, seven study waves (with number of sites per wave described above), and 4 months between launch dates across waves, and assuming an average of 1205 patients seen per site per month (based on baseline data obtained at the time of the grant proposal for the trial), we will have 80% (90%) power to detect an increase in brief intervention rates of 7.1 (8.2) per 10,000 patients seen and an increase in treatment engagement of 2.6 (3.1) per 10,000 patients seen. Calculations, which were based on a two-sided test and a type 1 error rate of 0.05 and used the method of Hussey and Hughes (2007), assumed the following usual care rates for the main study outcomes: 34.2 per 10,000 patients seen for the brief intervention outcome (BI; 0.342% = 19% screened × 36% screened positive × 5% brief intervention) and 3.9 per 10,000 for treatment initiation and engagement (0.039% = 1.26% newly diagnosed × 37.5% initiating treatment × 8.2% engaged). We further assumed a value for the intraclass correlation coefficient of 0.001, based on baseline data from the included sites.
Several sources of qualitative data are routinely collected during the trial. Detailed typed minutes are taken during weekly operations meetings. In addition, detailed typed notes are taken of discussions during weekly formative evaluation meetings, using a spreadsheet to document the meeting date, clinic site, and a summary of practice coaches’ descriptions of the current state of implementation at that site, including barriers and facilitators and any resulting implementation adaptations. All names are omitted from notes to protect confidentiality (only clinical roles are recorded).
We will use a rapid assessment process that was developed for this project, building on prior methods , to summarize findings regarding changes in the health system during the trial, adaptations to SPARC implementation strategies, and barriers and facilitators encountered during implementation. These analyses will be guided by Greenhalgh’s conceptual framework for dissemination of innovations [40, 41]. Details about the process for conducting these analyses and linking results to quantitative site performance data are included in an additional file [see Additional file 1]).
This protocol reflects a proposal reviewed by the Agency for Health Research and Quality (AHRQ) in 2013 and funded in 2014. At the time of submission, the research team is implementing care in the final wave of PC clinics (Fig. 3).
If implementation succeeds at implementing SBI and increasing diagnosis and treatment of AUD in the SPARC trial, findings of this trial will help other systems wishing to implement alcohol-related care in PC. This study will create a roadmap and make widely available online tools to help other healthcare organizations improve the quality of alcohol-related care. We will disseminate findings via AHRQ’s online site for integrating behavioral health and PC  as well as via our own research website.
Strengths and limitations
A significant strength of this pragmatic trial is that it evaluates a range of outcomes using secondary data. This strategy does not rely on patient interviews, which yield smaller, biased samples and impose significant recruitment and consent burdens and survey costs. However, this design introduces other limitations. Primary outcomes are defined based on EHR documentation and assumed to be absent if EHR documentation is lacking. We use an NLP measure of brief intervention based on templates because clinical leaders wanted to focus providers on offering brief counseling or advice rather than standardized documentation by “clicking a box” in the EHR . However, resources were insufficient to develop and validate an NLP measure of any alcohol-related advice or counseling in the EHR. We therefore use text from repeated EHR templates identified with NLP and coded as brief intervention. Although most clinicians use or develop templates to speed frequent documentation, this approach to measurement likely underestimates brief intervention. Moreover, documentation does not reflect the quality of the discussion about alcohol, and whether the discussion included explicit advice to cut down or abstain . Secondary data are being sought to use a 2017 Washington State Health Alliance survey  that includes KPWA and included a previously used patient-report measure of brief intervention , to compare rates of patient-reported alcohol-related advice in KPWA sites surveyed before, during, and after SPARC implementation. In addition, the primary outcome measure for AUD treatment is defined based on ICD codes and time frames used for NCQA’s HEDIS measures for AUD treatment. Documentation of an AUD ICD code is assumed to represent AUD treatment. We use this definition for AUD treatment to maximize relevance to healthcare systems. However, documentation of an ICD codes for AUD is not an indicator of AUD treatment, as AUD ICD-9 or ICD-10 codes can be used in billing for a medical visit any time the condition is relevant to care (e.g., if a condition impacts care of another condition). Therefore, secondary analyses will assess a more stringent definition of AUD treatment [43, 74]. Moreover, while patients may underreport their alcohol use or their symptoms in clinical care, many patients do not . Finally, this study was limited to adults visiting family medicine clinics. Future research is needed to determine the optimal approach to implementing alcohol-related care for adolescents less than 18 years old.
Alcohol is the third greatest cause of disability and death in the USA [5, 76, 77], but prevention and treatment of unhealthy alcohol use has not historically been integrated into routine medical care. With evidence-based interventions for unhealthy alcohol use available, experts now realize the crucial step is providing screening and treatment in routine medical settings [78, 79, 80, 81, 82, 83]. Developing an effective set of strategies to implement and sustain evidence-based alcohol-related care, testing them in a pragmatic trial, and disseminating the results widely, has the potential to transform healthcare practice to address the full spectrum of unhealthy alcohol use in PC settings.
The authors would like to thank the leaders and clinicians of Kaiser Permanente Washington who supported or participated in this pilot, including Medical Director of Behavioral Health Services Larry Marx, and Tory Gildred. We also acknowledge Eric Goemer for the assistance in preparing the manuscript and figures. Finally, we would like to thank the Kaiser Permanente Washington patients.
The Agency for Healthcare Research and Quality (AHRQ) R18 HS023173 provided the funding for this study. The Group Health Foundation and Kaiser Permanente Washington Health Research Institute Development Fund also contributed to the funding. Dr. Glass was supported by the National Institutes of Health Extramural Loan Repayment Program for Health Disparities Research (L60 MD009373) and a Mentored Research Scientist Development Award (K01 AA023859). Dr. Bradley was supported by a National Institutes of Health Midcareer Investigator Award (K24 AA022128). The funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
GTL, EL, RMC, PL, ECW, and KAB designed the SPARC program and its implementation. AKL, EL, CA, RP, RMC, JER, and KAB oversaw the implementation. JFB and KAB designed the quantitative evaluation. AKL, JER, and KAB designed the qualitative evaluation. All co-authors edited the paper and contributed to the interpretation of the results. All authors read and approved the final manuscript.
Ethics approval and consent to participate
Ethics approval was granted by the Kaiser Permanente Washington Health Research Institute Human Subjects Committee, approval number IRBnet 710232.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 1.Lim S, The Global Burden of Disease Collaborators. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012;380(9859):2224–60.Google Scholar
- 3.Moyer VA, Preventive Services Task Force. Screening and behavioral counseling interventions in primary care to reduce alcohol misuse: U.S. preventive services task force recommendation statement. Ann Intern Med 2013;159(3):210–8.Google Scholar
- 4.National Institute on Alcohol Abuse and Alcoholism. Helping patients who drink too much: a clinician’s guide (updated 2005 edition). Washington, D.C: National Institutes of Health, U.S. Department of Health and Human Services; 2005. NIH Publication 07–3769Google Scholar
- 21.Rosner S, Hackl-Herrwerth A, Leucht S, Lehert P, Vecchi S, Soyka M. Acamprosate for alcohol dependence. Cochrane Database Syst Rev. 2010(9):CD004332.http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD004332.pub2/epdf. Accessed 31 Aug 2017.
- 22.Rosner S, Hackl-Herrwerth A, Leucht S, Vecchi S, Srisurapanont M, Soyka M. Opioid antagonists for alcohol dependence. Cochrane Database Syst Rev. 2010:CD001867.http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD001867.pub3/epdf. Accessed 31 Aug 2017.
- 26.VA Office of Quality and Performance. VA/DoD clinical practice guideline for the management of substance use disorders, version 2.0. 2009; https://www.healthquality.va.gov/guidelines/MH/sud/. Accessed 10 Jun 2014.Google Scholar
- 27.National Quality Forum. National Voluntary Consensus Standards for the Treatment of Substance Use Conditions: Evidence-Based Treatment Practices. Washington, DC: Robert Wood Johnson Foundation; 2007.Google Scholar
- 36.Turner BJ, Mathias CW. Increasing prevalence of alcohol use disorders: meeting the challenge in primary care : commentary on Williams et al., barriers to and facilitators of alcohol use disorder pharmacotherapy in primary care: a qualitative study in five VA clinics. J Gen Intern Med. 2018;33(3):236–7.CrossRefGoogle Scholar
- 37.Bradley KA, Williams EC, Achtmeyer CE, Volpp B, Collins BJ, Kivlahan DR. Implementation of evidence-based alcohol screening in the Veterans Health Administration. Am J Manag Care. 2006;12(10):597–606.Google Scholar
- 39.Bradley KA, Williams EC. Implementation of SBI in clinical settings using quality improvement principles. In: Ries RK, Miller SC, Fiellin DA, Saitz R, editors. Principles of addiction medicine. 5th ed. Philadelphia, PA: Lippincott Williams & Wilkins; 2013. p. 291–2.Google Scholar
- 50.Berger D, Lapham GT, Shortreed SM, et al. Increased Rates of Documented Alcohol Counseling in Primary Care: More Counseling or Just More Documentation? J Gen Intern Med. 2018;33(3):268-74.Google Scholar
- 52.Anton RF, O'Malley SS, Ciraulo DA, et al. Combined pharmacotherapies and behavioral interventions for alcohol dependence: the COMBINE study: a randomized controlled trial. JAMA. 2006;295(17):2003-17.Google Scholar
- 53.Bradley KA, Bobb JF, Ludman EJ, et al. Alcohol-Related Nurse Care Management in Primary Care: A Randomized Clinical Trial. JAMA Intern Med. 2018;178(5):613-21.Google Scholar
- 54.Sheehan DV, Lecrubier Y, Sheehan KH, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33. quiz 34–57Google Scholar
- 59.National Council for Behavioral Health. Implementing Care for Alcohol & Other Drug Use in Medical Setting: An Extension of SBIRT. Washington DC: National Council for Behavioral Health; 2018.Google Scholar
- 62.Bobb JF, Lee AK, Lapham GT, et al. Evaluation of a Pilot Implementation to Integrate Alcohol-Related Care within Primary Care. Int J Environ Res Public Health. 2017;14(9).Google Scholar
- 65.Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259.Google Scholar
- 69.National Committee for Quality Assurance. HEDIS 2018. Washington, DC: National Committee for Quality Assurance; 2018.Google Scholar
- 72.Beebe J. Rapid Assessment Process: An Introduction. Lanham: Altmira Press; 2001.Google Scholar
- 75.Washington Health Alliance. Washington Health Alliance survey. 2018; https://wahealthalliance.org/alliance-reports-websites/your-voice-matters/. Accessed May 2 2018.Google Scholar
- 76.Lim SS, Vos T, Flaxman AD, et al. A comparative risk assessment of burden of disease and injury attributable to 67 risk factors and risk factor clusters in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380(9859):2224–60.PubMedCentralCrossRefGoogle Scholar
- 78.Institute of Medicine. Broadening the base of treatment for alcohol problems: a report of the committee for the study of treatment and rehabilitation for alcoholism. Washington DC: National Academy Press; 1990.Google Scholar
- 79.Institute of Medicine (US) Committee on Crossing the Quality Chasm: Adaptation to Mental Health and Addictive Disorders. Improving the quality of health care for mental and substance-use conditions: quality chasm series. Washington, DC: National Academies Press; 2006.Google Scholar
- 84.Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a Brief Screen for Alcohol Misuse in Primary Care. Alcoholism: Clin Exp Res. 2007;31(7):1208–1217.Google Scholar
- 85.Johnson JA, Lee A, Vinson D, Seale JP. Use of AUDIT-Based Measures to Identify Unhealthy Alcohol Use and Alcohol Dependence in Primary Care: A Validation Study. Alcoholism: Clin Exp Res. 2013;37:E253-E259.Google Scholar
- 86.Lowe B, Kroenke K, Grafe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res. 2005;58(2):163–171.Google Scholar
- 87.Kroenke K, Spitzer RL, Williams JB. The PHQ-9. J Gen Intern Med. 2001;16(9):606-613.Google Scholar
- 88.Posner K, Brown GK, Stanley B, et al. The Columbia–Suicide Severity Rating Scale: Initial Validity and Internal Consistency Findings From Three Multisite Studies With Adolescents and Adults. Am J Psychiatry. 2011;168(12):1266-1277.Google Scholar
- 89.Lapham GT, Lee AK, Caldeiro RM, et al. Frequency of Cannabis Use Among Primary Care Patients in Washington State. J the Am Board Fam Med. 2017;30(6):795-805.Google Scholar
- 90.Humeniuk R, Ali R, Babor TF, et al. Validation of the alcohol, smoking and substance involvement screening test (ASSIST). Addiction. 2008;103(6):1039-1047.Google Scholar
- 91.Smith PC, Schmidt SM, Allensworth-Davies D, Saitz R. A Single-Question Screening Test for Drug Use in Primary Care. Arch Int Med. 2010;170(13).Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.