Evaluating Completeness of a Radiology Glossary Using Iterative Refinement
A lay-language glossary of radiology, built to help patients better understand the content of their radiology reports, has been analyzed for its coverage and readability, but not for its completeness. We present an iterative method to sample radiology reports, identify “missing” terms, and measure the glossary’s completeness. We hypothesized that the refinement process would reduce the number of missing terms to fewer than 1 per report. A random sample of 1000 radiology reports from a large US academic health system was divided into 10 cohorts of 100 reports each. Each cohort was reviewed in sequence by two investigators to identify terms (single words and multi-word phrases) absent from the glossary. Terms marked as new were added to the glossary and hence was shown as matched in subsequent cohorts. This HIPAA-compliant study was IRB-approved; informed consent was waived. The refinement process added a mean of 288.0 new terms per 100 reports in the first 5 cohorts vs. a mean of 66.0 new terms per 100 reports in the last 5 cohorts; the difference was statistically significant (p < .01). After reviewing 500 reports, the review process found fewer than 1 new term per report in each of 500 subsequent reports. The findings suggest that 500 to 1000 reports is adequate to test the completeness of a glossary, and that the glossary after iterative refinement achieved a high level of completeness to cover the vocabulary of radiology reports.
KeywordsRadiology reports Patient-centered care Vocabulary Patient portals Glossary
- 4.Gefen R, Bruno MA, Abujudeh HH: Online portals: Gateway to patient-centered radiology. AJR Am J Roentgenol:1–5, 2017Google Scholar
- 7.How to write easy-to-read health materials. Available at www.nlm.nih.gov/medlineplus/etr.html. Accessed 30 January 2017
- 8.Weiss BD: Health literacy and patient safety: Help patients understand: Manual for clinicians. Chicago, IL: American Medical Association Foundation. American Medical Association, 2007Google Scholar
- 10.Trofimova A, Vey BL, Safdar NM, Duszak R Jr, Kadom N: Radiology report readability: An opportunity to improve patient communication. J Am Coll Radiol: Published online: https://doi.org/10.1016/j.jacr.2018.1003.1032, 2018
- 12.Martin-Carreras T, Kahn CE Jr: Coverage and readability of information resources to help patients understand radiology reports. J Am Coll Radiol. https://doi.org/10.1016/j.jacr.2017.11.019, 2017