Prioritizing Primary Care Patients for a Communication Intervention Using the “Surprise Question”: a Prospective Cohort Study
Communication about priorities and goals improves the value of care for patients with serious illnesses. Resource constraints necessitate targeting interventions to patients who need them most.
To evaluate the effectiveness of a clinician screening tool to identify patients for a communication intervention.
Prospective cohort study.
Primary care clinics in Boston, MA.
Primary care physicians (PCPs) and nurse care coordinators (RNCCs) identified patients at high risk of dying by answering the Surprise Question (SQ): “Would you be surprised if this patient died in the next 2 years?”
Performance of the SQ for predicting mortality, measured by the area under receiver operating curve (AUC), sensitivity, specificity, and likelihood ratios.
Sensitivity of PCP response to the SQ at 2 years was 79.4% and specificity 68.6%; for RNCCs, sensitivity was 52.6% and specificity 80.6%. In univariate regression, the odds of 2-year mortality for patients identified as high risk by PCPs were 8.4 times higher than those predicted to be at low risk (95% CI 5.7–12.4, AUC 0.74) and 4.6 for RNCCs (3.4–6.2, AUC 0.67). In multivariate analysis, both PCP and RNCC prediction of high risk of death remained associated with the odds of 2-year mortality.
This study was conducted in the context of a high-risk care management program, including an initial screening process and training, both of which affect the generalizability of the results.
When used in combination with a high-risk algorithm, the 2-year version of the SQ captured the majority of patients who died, demonstrating better than expected performance as a screening tool for a serious illness communication intervention in a heterogeneous primary care population.
KEY WORDSpalliative care advance care planning patient identification end-of-life care
We would like to thank Brandon Neal for his analytical support.
The implementation of the Serious Illness Care Program at Brigham and Women’s Hospital was funded by Partners HealthCare and the Charina and Branta Foundations.
Compliance with Ethical Standards
The institutional review board of Partners HealthCare approved this study.
Conflict of Interest
Dr. Lakin and Dr. Bernacki are supported by the Cambia Sojourns Scholar Leadership Program. Dr. Block serves as the Palliative Care editor for UpToDate. The remainder of the authors declare no conflicts of interest.
- 3.Wright AA, Keating NL, Balboni TA, Matulonis UA, Block SD, Prigerson HG. Place of death: correlations with quality of life of patients with cancer and predictors of bereaved caregivers’ mental health. Journal of clinical oncology : official journal of the American Society of Clinical Oncology. 2010;28(29):4457–64. https://doi.org/10.1200/jco.2009.26.3863 CrossRefGoogle Scholar
- 7.Institute of Medicine. Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life. Washington, DC: National Academies Press; 2014.Google Scholar
- 11.Teno JM, Shu JE, Casarett D, Spence C, Rhodes R, Connor S. Timing of referral to hospice and quality of care: length of stay and bereaved family members’ perceptions of the timing of hospice referral. Journal of pain and symptom management. 2007;34(2):120–5. https://doi.org/10.1016/j.jpainsymman.2007.04.014.CrossRefGoogle Scholar
- 16.Teno JM, Gozalo PL, Bynum JP, Leland NE, Miller SC, Morden NE, et al. Change in end-of-life care for Medicare beneficiaries: site of death, place of care, and health care transitions in 2000, 2005, and 2009. JAMA : the journal of the American Medical Association. 2013;309(5):470–7. https://doi.org/10.1001/jama.2012.207624 CrossRefGoogle Scholar
- 19.Lakin JR, Block SD, Billings JA, Koritsanszky LA, Cunningham R, Wichmann L, et al. Improving Communication About Serious Illness in Primary Care: A Review. JAMA internal medicine. 2016. https://doi.org/10.1001/jamainternmed.2016.3212.
- 23.Block SD, Bernier GM, Crawley LM, Farber S, Kuhl D, Nelson W, et al. Incorporating palliative care into primary care education. National Consensus Conference on Medical Education for Care Near the End of Life. Journal of general internal medicine. 1998;13(11):768–73CrossRefPubMedCentralGoogle Scholar
- 25.Pang WF, Kwan BC, Chow KM, Leung CB, Li PK, Szeto CC. Predicting 12-month mortality for peritoneal dialysis patients using the “surprise” question. Peritoneal dialysis international : journal of the International Society for Peritoneal Dialysis. 2013;33(1):60–6. https://doi.org/10.3747/pdi.2011.00204 CrossRefGoogle Scholar
- 31.Lakin JR, Robinson MG, Bernacki RE, Powers BW, Block SD, Cunningham R, et al. Estimating 1-Year Mortality for High-Risk Primary Care Patients Using the “Surprise” Question. JAMA internal medicine. 2016. https://doi.org/10.1001/jamainternmed.2016.5928.
- 33.Downar J, Goldman R, Pinto R, Englesakis M, Adhikari NK. The “surprise question” for predicting death in seriously ill patients: a systematic review and meta-analysis. CMAJ : Canadian Medical Association journal = journal de l’Association medicale canadienne. 2017;189(13):E484-e93. https://doi.org/10.1503/cmaj.160775 CrossRefGoogle Scholar
- 34.Bernacki R, Hutchings M, Vick J, Smith G, Paladino J, Lipsitz S, et al. Development of the Serious Illness Care Program: a randomised controlled trial of a palliative care communication intervention. BMJ open. 2015;5(10):e009032. https://doi.org/10.1136/bmjopen-2015-009032 CrossRefPubMedCentralGoogle Scholar
- 36.Haime V, Hong C, Mandel L, Mohta N, Iezzoni LI, Ferris TG, et al. Clinician considerations when selecting high-risk patients for care management. The American journal of managed care. 2015;21(10):e576–82Google Scholar
- 38.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of biomedical informatics. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010 CrossRefGoogle Scholar
- 42.Gomez-Batiste X, Martinez-Munoz M, Blay C, Amblas J, Vila L, Costa X, et al. Utility of the NECPAL CCOMS-ICO((c)) tool and the Surprise Question as screening tools for early palliative care and to predict mortality in patients with advanced chronic conditions: A cohort study. Palliative medicine. 2017;31(8):754–63. https://doi.org/10.1177/0269216316676647.CrossRefGoogle Scholar