Abstract
Accurate segmentation of optic disc (OD) and optic cup (OC) is a fundamental task for fundus image analysis. Most existing methods focus on segmenting OD and OC inside the optic nerve head (ONH) area but paying little attention to accurate ONH localization. In this paper, we propose a Mask-RCNN based paradigm to localize ONH and jointly segment OD and OC in a whole fundus image. However, directly using Mask-RCNN faces some critical issues: First, for some glaucoma cases, the highly overlapping of OD and OC may lead to the missing of OC proposals. Second, some proposals may not fully surround the object, and thus the segmentation can be incomplete. Last, the instance head in Mask-RCNN cannot well incorporate the prior such as the OC is inside the OD. To address these issues, we first propose a segmentation based region proposal network (RPN) to improve the accuracy of proposals and then propose a pyramid RoIAlign module to aggregate the multi-level information to get a better feature representation. Furthermore, we employ a multi-label head strategy to incorporate the prior for better performance. Extensive experiments verify our method.
P. Yin and Q. Wu—Equally contribution to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Almazroa, A., Burman, R., et al.: Optic disc and optic cup segmentation methodologies for glaucoma image detection: a survey. J. Ophthalmol. (2015)
Aquino, A., Gegúndez-Arias, M.E., et al.: Detecting the optic disc boundary in digital fundus images using morphological, edge detection, and feature extraction techniques. IEEE TMI 29(11), 1860–1869 (2010)
Chen, X., Xu, Y., Yan, S., Wong, D.W.K., Wong, T.Y., Liu, J.: Automatic feature learning for glaucoma detection based on deep learning. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 669–677. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_80
Chen, X., Xu, Y., et al.: Glaucoma detection based on deep convolutional neural network. In: EMBC, pp. 715–718. IEEE (2015)
Cheng, J., Liu, J., et al.: Automatic optic disc segmentation with peripapillary atrophy elimination. In: EMBC, pp. 6224–6227. IEEE (2011)
Cheng, J., Liu, J., et al.: Superpixel classification for initialization in model based optic disc segmentation. In: EMBC, pp. 1450–1453. IEEE (2012)
Cheng, J., Liu, J., et al.: Superpixel classification based optic disc and optic cup segmentation for glaucoma screening. IEEE TMI 32(6), 1019–1032 (2013)
Fu, H., Cheng, J., et al.: Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE TMI 37, 1597–1605 (2018)
Fu, H., Cheng, J., et al.: Disc-aware ensemble network for glaucoma screening from fundus image. IEEE TMI 30, 2493–2501 (2018)
Joshi, G.D., Sivaswamy, J., et al.: Optic disk and cup segmentation from monocular color retinal images for glaucoma assessment. IEEE TMI 30(6), 1192–1205 (2011)
Kaufman, P.L., Levin, L.A., Adler, F.H., Alm, A.: Adler’s Physiology of the Eye. Elsevier Health Sciences (2011)
Ren, S., He, K., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. In: NeurIPS, pp. 91–99 (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Sun, X., Xu, Y., et al.: Optic disc segmentation from retinal fundus images via deep object detection networks. In: EMBC, pp. 5954–5957, July 2018
Tang, L., Garvin, M.K., et al.: Segmentation of optic nerve head rim in color fundus photographs by probability based active shape model. IOVS 53(14), 2144 (2012)
Wong, D.W.K., Liu, J., et al.: Learning-based approach for the automatic detection of the optic disc in digital retinal fundus photographs. In: EMBC. IEEE (2010)
Xu, Y., Duan, L., Lin, S., Chen, X., Wong, D.W.K., Wong, T.Y., Liu, J.: Optic cup segmentation for glaucoma detection using low-rank superpixel representation. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8673, pp. 788–795. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10404-1_98
Xu, Y., Lin, S., Wong, D.W.K., Liu, J., Xu, D.: Efficient reconstruction-based optic cup localization for glaucoma screening. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013. LNCS, vol. 8151, pp. 445–452. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40760-4_56
Xu, Y., et al.: Efficient optic cup detection from intra-image learning with retinal structure priors. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012. LNCS, vol. 7510, pp. 58–65. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33415-3_8
Xu, Y., et al.: Sliding window and regression based cup detection in digital fundus images for glaucoma diagnosis. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011. LNCS, vol. 6893, pp. 1–8. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23626-6_1
Yin, F., Liu, J., et al.: Model-based optic nerve head segmentation on retinal fundus images. In: EMBC, pp. 2626–2629. IEEE (2011)
Zhao, H., Shi, J., et al.: Pyramid scene parsing network. In: CVPR (2017)
Zilly, J., Buhmann, J.M., et al.: Glaucoma detection using entropy sampling and ensemble learning for automatic optic cup and disc segmentation. Comput. Med. Imaging Graph. 55, 28–41 (2017)
Acknowledgement
This work was supported by National Natural Science Foundation of China (NSFC) 61602185, 61876208, Guangdong Introducing Innovative and Entrepreneurial Teams 2017ZT07X183, Guangdong Provincial Scientific and Technological Fund 2018B010107001, 2017B090901008, 2018B010108002, Pearl River S&T Nova Program of Guangzhou 201806010081, CCF-Tencent Open Research Fund RAGR20190103.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Yin, P. et al. (2019). PM-Net: Pyramid Multi-label Network for Joint Optic Disc and Cup Segmentation. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11764. Springer, Cham. https://doi.org/10.1007/978-3-030-32239-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-32239-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32238-0
Online ISBN: 978-3-030-32239-7
eBook Packages: Computer ScienceComputer Science (R0)
