Debiasing versus knowledge retrieval checklists to reduce diagnostic error in ECG interpretation
- 63 Downloads
There is an ongoing debate regarding the cause of diagnostic errors. One view is that errors result from unconscious application of cognitive heuristics; the alternative is that errors are a consequence of knowledge deficits. The objective of this study was to compare the effectiveness of checklists that (a) identify and address cognitive biases or (b) promote knowledge retrieval, as a means to reduce errors in ECG interpretation. Novice postgraduate year (PGY) 1 emergency medicine and internal medicine residents (n = 40) and experienced cardiology fellows (PGY 4–6) (n = 21) were randomly allocated to three conditions: a debiasing checklist, a content (knowledge) checklist, or control (no checklist) to be used while interpreting 20 ECGs. Half of the ECGs were deliberately engineered to predispose to bias. Diagnostic performance under either checklist intervention was not significantly better than the control. As expected, more errors occurred when cases were designed to induce bias (F = 96.9, p < 0.0001). There was no significant interaction between the instructional condition and level of learner. Checklists attempting to help learners identify cognitive bias or mobilize domain-specific knowledge did not have an overall effect in reducing diagnostic errors in ECG interpretation, although they may help novices. Even when cognitive biases are deliberately inserted in cases, cognitive debiasing checklists did not improve participants’ performance.
KeywordsClinical reasoning Checklists Bias Diagnostic error
The authors wish to thank Betty Howey for her technical support and facilitation of the study.
This study was supported by a Medical Education Grant from the Royal College of Physicians and Surgeons of Canada.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
This study was approved by the Hamilton Integrated Ethics Board September 2017, #3856.
- Croskerry, P. (2003b). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78(8). Retrieved from https://journals.lww.com/academicmedicine/Fulltext/2003/08000/The_Importance_of_Cognitive_Errors_in_Diagnosis.3.aspx
- Croskerry, P., Singhal, G., & Mamede, S. (2013a). Cognitive debiasing 1: Origins of bias and theory of debiasing. BMJ Quality & Safety, 22(Suppl 2), ii58 LP–ii64. Retrieved from http://qualitysafety.bmj.com/content/22/Suppl_2/ii58.abstract
- Croskerry, P., Singhal, G., & Mamede, S. (2013b). Cognitive debiasing 2: Impediments to and strategies for change. BMJ Quality & Safety, 22(Suppl 2), ii65 LP–ii72. Retrieved from http://qualitysafety.bmj.com/content/22/Suppl_2/ii65.abstract
- Donaldson, M. S., Corrigan, J. M., & Kohn, L. T. (2000). To err is human: Building a safer health system. Washington: National Academies Press.Google Scholar
- ECG Made Simple. (2017). Stepwise videos. Retrieved from: http://www.ecgmadesimple.com/stepwise-vids/story_html5.html. Accessed 16 Sept 2017.
- Elstein, A. S., Friedman, C. P., Wolf, F. M., Murphy, G., Miller, J., Fine, P., et al. (1996). Effects of a decision support system on the diagnostic accuracy of users: A preliminary report. Journal of the American Medical Informatics Association, 3(6), 422–428. https://doi.org/10.1136/jamia.1996.97084515.CrossRefGoogle Scholar
- Graber, M. L., Kissam, S., Payne, V. L., Meyer, A. N. D., Sorensen, A., Lenfestey, N., et al. (2012). Cognitive interventions to reduce diagnostic error: a narrative review. BMJ Quality & Safety, 21(7), 535 LP–557. Retrieved from http://qualitysafety.bmj.com/content/21/7/535.abstract.
- Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A.-H. S., Dellinger, E. P., et al. (2009). A surgical safety checklist to reduce morbidity and mortality in a global population. New England Journal of Medicine, 360(5), 491–499. https://doi.org/10.1056/NEJMsa0810119.CrossRefGoogle Scholar
- Kahneman, D., & Egan, P. (2011). Thinking, fast and slow. New York: Farrar, Straus, and Giroux.Google Scholar
- Mamede, S., van Gog, T., van den Berge, K., Rikers, R. M. J. P., van Saase, J. L. C. M., van Guldener, C., et al. (2010). Effect of availability bias and reflective reasoning on diagnostic accuracy among internal medicine residents. JAMA, 304(11), 1198. https://doi.org/10.1001/jama.2010.1276.CrossRefGoogle Scholar
- Marsteller, J. A., Sexton, J. B., Hsu, Y.-J., Hsiao, C.-J., Holzmueller, C. G., Pronovost, P. J., et al. (2012). A multicenter, phased, cluster-randomized controlled trial to reduce central line-associated bloodstream infections in intensive care units*. Critical Care Medicine, 40(11), 2933–2939. https://doi.org/10.1097/CCM.0b013e31825fd4d8.CrossRefGoogle Scholar
- Norman, G. R., Brooks, L. R., Colle, C. L., & Hatala, R. M. (1999). The benefit of diagnostic hypotheses in clinical reasoning: Experimental study of an instructional intervention for forward and backward reasoning. Cognition and Instruction, 17(4), 433–448. https://doi.org/10.1207/S1532690XCI1704_3.CrossRefGoogle Scholar
- Reilly, J. B., Ogdie, A. R., Von Feldt, J. M., & Myers, J. S. (2013). Teaching about how doctors think: A longitudinal curriculum in cognitive bias and diagnostic error for residents. BMJ Quality & Safety, 22(12), 1044 LP–1050. Retrieved from http://qualitysafety.bmj.com/content/22/12/1044.abstract
- Shimizu, T., Matsumoto, K., & Tokuda, Y. (2013). Effects of the use of differential diagnosis checklist and general de-biasing checklist on diagnostic performance in comparison to intuitive diagnosis. Medical Teacher, 35(6), e1218–e1229. https://doi.org/10.3109/0142159X.2012.742493.CrossRefGoogle Scholar
- Zwaan, L., Monteiro, S., Sherbino, J., Ilgen, J., Howey, B., & Norman, G. (2017). Is bias in the eye of the beholder? A vignette study to assess recognition of cognitive biases in clinical case workups. BMJ Quality & Safety, 26(2), 104 LP–110. Retrieved from http://qualitysafety.bmj.com/content/26/2/104.abstract.