Inter-rater reliability between experienced and inexperienced otolaryngologists using Koo’s drug-induced sleep endoscopy classification system
- 35 Downloads
An ideal, drug-induced sleep endoscopy (DISE) classification system should cover all the upper airways, be simple and practical, and quantify the severity of any obstruction. Excellent validity and reliability are essential. We explored the inter-rater reliability of Koo’s DISE classification system in the hands of experienced and inexperienced otolaryngologists.
We retrospectively analyzed video images of 100 patients who underwent DISE examination in our hospital between 2015 and 2018. Three experienced and three inexperienced otolaryngologists reviewed and scored all images. We calculated the inter-rater reliabilities of the two groups of otolaryngologists.
Independent of the extent of experience with DISE, detection of retropalatal obstructions (overall agreement: 0.87; kappa value: 0.60), and the degree of such obstructions (overall agreement: 0.67; kappa value: 0.52) were more consistent than were the detection of retrolingual obstructions (overall agreement: 0.61, kappa value: 0.37) and the degree of retrolingual obstructions (overall agreement: 0.20, kappa value: 0.35). Inexperienced observers were in good agreement for palatal obstructions and experienced observers were in good agreement for tongue-base obstructions. All of the otolaryngologists found it difficult to detect a lateral pharyngeal wall obstruction at the retrolingual level.
Koo’s DISE classification system focuses on surgical treatment, especially by otolaryngologists, and the degree of agreement between the experienced and inexperienced observers was relatively high. The participants’ level of experience had a strong impact on scoring. The less-experienced otolaryngologists tended to overlook tongue-base obstructions, focusing instead on relatively simple retropalatal obstructions. In the future, development of a DISE classification system that can be accepted globally will be necessary.
KeywordsDrug-induced sleep endoscopy Sleep apnea, obstructive Observer variation Reliability
Compliance with ethical standards
Conflict of interest
We have no potential conflict of interest.
Research involving human participants and/or animals
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study. The study was approved by the Institutional Review Board of Busan Saint Mary’s Medical Center (Approval no. BSM-2018-13).
- 24.Samutsakorn P, Hirunwiwatkui P, Chaitusaney B, Charakorn N (2018) Lingual tonsillectomy with palatal surgery for the treatment of obstructive sleep apnea in adults: a systematic review and meta-analysis. Eur Arch Otorhinolaryngol 275(4):1005–1013. https://doi.org/10.1007/s00405-018-4887-6 CrossRefGoogle Scholar