Abstract
Between preoperative computed tomography (CT) image acquisition and endoscopic sinus surgery, the nasal cavity of a patient undergoes changes. These changes make it challenging for non-deformable vision-based registration algorithms to find accurate alignments between CT image and intraoperative video. Large alignment errors can lead to injuries to critical structures. In this paper, we present a deformable video-CT registration that deforms the patient shape extracted from CT according to statistics learned from population. We also associate confidence with regions of deformed shapes based on the location of matched video features. Experiments on both simulation and in vivo data produced < 1 mm errors (statistically significantly lower than prior work).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
All statistical significance figures reported in this paper are evaluated using the paired-sample Student’s t-test and indicate \(p<0.001\).
References
Beichel, R.R., et al.: Data from QIN-HEADNECK. The Cancer Imaging Archive (2015)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Billings, S.D., Boctor, E.M., Taylor, R.H.: Iterative most-likely point registration (IMLP): a robust algorithm for computing optimal shape alignment. PLoS ONE 10(3), 1–45 (2015)
Billings, S.D., et al.: Anatomically constrained video-CT registration via the V-IMLOP algorithm. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9902, pp. 133–141. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46726-9_16
Billings, S., Taylor, R.: Iterative most likely oriented point registration. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 178–185. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10404-1_23
Billings, S.D., Taylor, R.H.: Generalized iterative most likely oriented-point (G-IMLOP) registration. Int. J. Comput. Assist. Radiol. Surg. 10(8), 1213–1226 (2015)
Bosch, W.R., Straube, W.L., Matthews, J.W., Purdy, J.A.: Data from Head-Neck-Cetuximab. The Cancer Imaging Archive (2015)
Clark, K., et al.: The cancer imaging archive (TCIA): maintaining and operating a public information repository. J. Digit. Imaging 26(6), 1045–1057 (2013)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models - their training and application. Comput. Vis. Image Underst. 61, 38–59 (1995)
Fedorov, A., et al.: DICOM for quantitative imaging biomarker development: a standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 4, e2057 (2016)
Granger, S., Pennec, X.: Multi-scale EM-ICP: a fast and robust approach for surface registration. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2353, pp. 418–432. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47979-1_28
Hasegawa, M., Kern, E.B.: The human nasal cycle. Mayo Clin. Proc. 52(1), 28–34 (1977)
Hufnagel, H., Pennec, X., Ehrhardt, J., Ayache, N., Handels, H.: Computation of a probabilistic statistical shape model in a maximum-a-posteriori framework. Methods Inf. Med. 48(04), 314–319 (2009)
Kennedy, D.W.: Functional endoscopic sinus surgery. Technique. Arch. Otolaryngol. 111(10), 643–649 (1985). (Chicago, Ill.: 1960)
Leonard, S., et al.: Evaluation and stability analysis of video-based navigation system for functional endoscopic sinus surgery on in vivo clinical data. IEEE Trans. Med. Imaging 37(10), 2185–2195 (2018)
Leonard, S., Reiter, A., Sinha, A., Ishii, M., Taylor, R.H., Hager, G.D.: Image-based navigation for functional endoscopic sinus surgery using structure from motion. In: Proceedings SPIE Medical Imaging, vol. 9784, pp. 97840V–97840V-7 (2016)
Liu, X., et al.: Self-supervised learning for dense depth estimation in monocular endoscopy. In: Stoyanov, D., et al. (eds.) CARE/CLIP/OR 2.0/ISIC -2018. LNCS, vol. 11041, pp. 128–138. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01201-4_15
Mardia, K.V., Jupp, P.E.: Directional Statistics. Wiley Series in Probability and Statistics, pp. 1–432. Wiley, Hoboken (2008)
Myronenko, A., Song, X.: Point set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275 (2010)
Pulli, K.: Multiview registration for large data sets. In: Proceedings 2nd International Conference on 3-D Digital Imaging and Modeling, pp. 160–168 (1999)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings 3rd International Conference on 3-D Digital Imaging and Modeling, pp. 145–152 (2001)
Segal, A., Haehnel, D., Thrun, S.: Generalized-ICP. In: Proceedings Robotics: Science & Systems (2009)
Sinha, A.: Deformable registration using shape statistics with applications in sinus surgery. Ph.D. thesis, The Johns Hopkins University (2018)
Sinha, A., et al.: The deformable most-likely-point paradigm. Med. Image Anal. 55, 148–164 (2019)
Sinha, A., Ishii, M., Hager, G.D., Taylor, R.H.: Endoscopic navigation in the clinic: registration in the absence of preoperative imaging. Int. J. Comput. Assist. Radiol. Surg. 14, 12 (2019). IJCARS-MICCAI 2018
Sinha, A., Leonard, S., Reiter, A., Ishii, M., Taylor, R.H., Hager, G.D.: Automatic segmentation and statistical shape modeling of the paranasal sinuses to estimate natural variations. In: Proceedings SPIE Medical Imaging, vol. 9784, pp. 97840D–97840D-8 (2016)
Sinha, A., Liu, X., Reiter, A., Ishii, M., Hager, G.D., Taylor, R.H.: Endoscopic navigation in the absence of CT imaging. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11073, pp. 64–71. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00937-3_8
Sinha, A., Reiter, A., Leonard, S., Ishii, M., Hager, G.D., Taylor, R.H.: Simultaneous segmentation and correspondence improvement using statistical modes. In: Proceedings SPIE Medical Imaging, vol. 10133, pp. 101331B–101331B-8 (2017)
Acknowledgment
This work was funded by the Johns Hopkins University (JHU) Provost’s Postdoctoral Fellowship and other JHU internal funds. We would also like to thank Seth D. Billings for his invaluable feedback.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Sinha, A., Liu, X., Ishii, M., Hager, G.D., Taylor, R.H. (2019). Recovering Physiological Changes in Nasal Anatomy with Confidence Estimates. In: Greenspan, H., et al. Uncertainty for Safe Utilization of Machine Learning in Medical Imaging and Clinical Image-Based Procedures. CLIP UNSURE 2019 2019. Lecture Notes in Computer Science(), vol 11840. Springer, Cham. https://doi.org/10.1007/978-3-030-32689-0_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-32689-0_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32688-3
Online ISBN: 978-3-030-32689-0
eBook Packages: Computer ScienceComputer Science (R0)