Clinician dashboard views and improvement in preventative health outcome measures: a retrospective analysis
Measuring and reporting outcome data is fundamental for health care systems to drive improvement. Our electronic health record built a dashboard that allows each primary care provider (PCP) to view real-time population health quality data of their patient panel and use that information to identify care gaps. We hypothesized that the number of dashboard views would be positively associated with clinical quality improvement.
We performed a retrospective analysis of change in quality scores compared to number of dashboard views for each PCP over a five-month period (2017–18). Using the manager dashboard, we recorded the number of views for each provider. The quality scores analyzed were: colorectal cancer (CRC) screening rates and diabetic patients with an A1c greater than 9% or no A1c in the past year.
Data from 120 PCPs were included. The number of dashboard views by each PCP ranged from 0 to 222. Thirty-one PCPs (25.8%) did not view their dashboard. We found no significant correlation between views and change in quality scores (correlation coefficient = 0.06, 95% CI [− 0.13, 0.25] and − 0.05, 95% CI [− 0.25, 0.14] for CRC and diabetes, respectively).
Clinical dashboards provide feedback to PCPs and are likely to become more available as healthcare systems continue to focus on improving population health. However, dashboards on their own may not be sufficient to impact clinical quality improvement. Dashboard viewership did not appear to impact clinician performance on quality metrics.
KeywordsClinical dashboards Quality improvement Colorectal cancer Screening Hemoglobin A1c
Electronic health record
Generalized estimating equations
Primary care provider
Measuring and reporting outcome data are keys for health care systems to identify opportunities to improve care . One proposed method of achieving this is using dashboards . Dashboards are associated with reduced length of stay, timeliness of discharges, improved patient outcomes, increase grant funding, and staff participation when end-user input is incorporated [3, 4, 5]. Dashboards have the potential to guide program development, mobilize healthcare providers to improve care, and demonstrate program value to stakeholders . Clinical dashboards are designed to display data to clinicians that impact quality of care . Our health care system partnered with our electronic health record (EHR), Epic Systems, to build a clinical dashboard that allows each primary care provider (PCP) to view quality data of their primary care panel and reveal the registry of their patients with a care gap for each metric for a limited number of chronic diseases and preventive cancer quality measures. A manager dashboard displayed the number of times each PCP viewed the clinical dashboard. We report the correlation of dashboard views and quality improvement. We hypothesized that clinical dashboard views lead to the providers having real-time feedback and thus more views would be associated with greater improvement in quality.
Change in quality scores for CRC and A1c > 9%
Diabetes A1c > 9% or Not Up to Date
We recorded the number of views between September 2017 (when the data was first available) and January 2018 for each provider. We chose to conclude our study window in January because in February 2018, clinician revenue productivity data was added to the dashboard which we felt would confound our dashboard views measure. Clinicians received monthly e-mail instructions for how to use the clinical dashboard and all clinicians attended an in-person training session during a retreat. Concrete suggestions for how to improve quality were included in newsletters but not on the clinical dashboard. PCPs were included if they had a panel at the beginning and end of the time interval. Trainees and the authors were excluded. The study was approved by the MetroHealth Institutional Review Board.
We calculated Spearman’s rank correlation coefficients between dashboard views and change in quality score. We used a generalized estimating equations (GEE) approach with a logit link function to account for differences in the raw counts (numerator and denominator) and changes in percentage. Due to the extreme skewness of the distribution of dashboard views, we performed a log (dashboard views+ 1) transformation for this analysis.
Data from 120 PCPs were included. The number of dashboard views by each PCP ranged from 0 to 222 views in the 5-month interval (mean 14, median 2). Thirty-one PCPs (25.8%) did not view their dashboard. Baseline quality scores were highly variable between providers.
We found no significant correlation between views and change in quality scores (for CRC screening: correlation coefficient = 0.06, 95% CI [− 0.13, 0.25]; for diabetes: correlation coefficient = − 0.05, 95% CI [− 0.25, 0.14]). Likewise, the GEE procedure revealed no statistically significant correlation. Table 1 shows the total number and percentage of patients who were up to date (for CRC screening) or who had a care gap (for the diabetes metric) between June 2017 and January 2018. The was an overall improvement in the percentage of patients who were up to date for CRC screening (54.42 to 58.83%). Similarly, there was a decrease in the number of patients with a care gap or an A1c > 9% from June to January (35.08% vs. 33.62%).
Our findings show that adding a dashboard alone may not improve quality. Audit and feedback techniques have been shown to improve quality outcomes but depend on how the feedback is provided [2, 7]. Clearer targets, concrete suggestions, and combined oral and written feedback may have increased dashboard efficacy. Monthly during the intervention, we emailed reminders to clinicians on how to access their dashboard and suggestions for how to improve colorectal cancer screening and diabetes control. Our intervention fell short of providing timely, non-punitive feedback to providers with specific action items .
One limitation of our study was that the dashboard views were specific to provider views: we did not analyze the effect of views by practice managers, nurses, and other team members on quality improvement. Broader viewership may have enhanced the ability for care teams to improve quality data by contacting patients and addressing care gaps. A second important limitation was that six months may be too short a time to expect improved clinical quality.
As a stand-alone intervention, dashboards may not be sufficient for impacting clinician performance on quality metrics; however, using a multi-faceted approach which includes clinician dashboards may be an important ingredient for successful quality improvement efforts [1, 8]. Future studies should evaluate program implementation over longer periods of time and with a wider outcome assessment that incorporates more organizational personnel and stakeholders at multiple levels of health care provision . Hopefully others can learn from our missing components for using dashboards to drive improvement.
PAT, JRR: study design, data collection, drafting and finalizing manuscript; DG, JD: data analysis, drafting and finalizing manuscript; DM: study design, data collection, data analysis, drafting and finalizing manuscript. All authors have read and approved this manuscript.
No financial support was provided to fund this manuscript.
Ethics approval and consent to participate
Our research project was approved by the MetroHealth Hospital Institutional Review Board.
Consent for publication
No individual data is reported, so consent was not required.
The authors declare that they have no competing interests.
- 2.Ivers N, Jamtvedt G, Flottorp S, Young JM, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012. https://doi.org/10.1002/14651858.CD000259.pub3.
- 5.Ebinger JE, Porten BR, Strauss CE, Gaberich RF, Han C, et al. Design, challenges, and implications of quality improvement projects using the electronic medical record. Case study: a protocol to reduce the burden of post-operative atrial fibrillation. Circ Cardiovasc Qual Outcomes. 2016;9:593–9.CrossRefGoogle Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.