Advertisement

Multipath Densely Connected Convolutional Neural Network for Brain Tumor Segmentation

  • Cong Liu
  • Weixin SiEmail author
  • Yinling Qian
  • Xiangyun Liao
  • Qiong Wang
  • Yong Guo
  • Pheng-Ann Heng
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11383)

Abstract

This paper presents a novel Multipath Densely Connected Convolutional Neural Network (MDCNN) for automatically segmenting glioma with unknown sizes, shapes and positions. Our network architecture is based on the Multipath Convolutional Neural Network [21], which considers both local and contextual patches of segmentation information, including original MRI images, symmetry information and spatial information. Motivated to reduce the feature loss induced by under-utility of feature maps, we propose to fuse feature maps from original local and contextual paths at three different units and introduce three more densely connected paths. Consequently, three auxiliary segmentation paths together with original local and contextural paths forms the complete segmentation network. The model’s training and validation are performed on the BraTS2017 dataset. Experimental results demonstrate that the proposed network is capable to effectively extract more accurate tumor locations and contours with improved stability.

This is a preview of subscription content, log in to check access.

Notes

Acknowledgment

This work was supported in part by the Shenzhen Science and Technology Program (No. JCYJ20160429190300857 and No. JCYJ20170413162617606), Research Grants Council of the Hong Kong Special Administrative Region (Project No. GRF 14203115) and the National Natural Science Foundation of China (Grant No. 61802385). Yinling Qian and Weixin Si are the corresponding authors.

References

  1. 1.
    Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)CrossRefGoogle Scholar
  2. 2.
    Bakas, S., et al.: Advancing The Cancer Genome atlas glioma MRI collections with expert segmentation labels and radiomic features. Sci. Data 4, 170117 (2017)CrossRefGoogle Scholar
  3. 3.
    Bauer, S., Wiest, R., Nolte, L.-P., Reyes, M.: A survey of MRI-based medical image analysis for brain tumor studies. Phys. Med. Biol. 58(13), R97 (2013)CrossRefGoogle Scholar
  4. 4.
    Dong, H., Yang, G., Liu, F., Mo, Y., Guo, Y.: Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. In: Valdés Hernández, M., González-Castro, V. (eds.) MIUA 2017. CCIS, vol. 723, pp. 506–517. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-60964-5_44CrossRefGoogle Scholar
  5. 5.
    Fidon, L., et al.: Generalised Wasserstein dice score for imbalanced multi-class segmentation using holistic convolutional networks. arXiv preprint arXiv:1707.00478 (2017)
  6. 6.
    Gittleman, H.R., et al.: Trends in central nervous system tumor incidence relative to other common cancers in adults, adolescents, and children in the United States, 2000 to 2010. Cancer 121(1), 102–112 (2015)CrossRefGoogle Scholar
  7. 7.
    Gordillo, N., Montseny, E., Sobrevilla, P.: State of the art survey on MRI brain tumor segmentation. Magn. Reson. Imaging 31(8), 1426–1438 (2013)CrossRefGoogle Scholar
  8. 8.
    Havaei, M., et al.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)CrossRefGoogle Scholar
  9. 9.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  10. 10.
    Huang, G., Chen, D., Li, T., Wu, F., van der Maaten, L., Weinberger, K.Q.: Multi-scale dense networks for resource efficient image classification. arXiv preprint arXiv:1703.09844 (2017)
  11. 11.
    Huang, G., Liu, Z., Van Der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)Google Scholar
  12. 12.
    Kamnitsas, K., et al.: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78 (2017)CrossRefGoogle Scholar
  13. 13.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
  14. 14.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)Google Scholar
  15. 15.
    Menze, B.H., et al.: The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imaging 34(10), 1993–2024 (2015)CrossRefGoogle Scholar
  16. 16.
    Paszke, A., Chaurasia, A., Kim, S., Culurciello, E.: ENet: a deep neural network architecture for real-time semantic segmentation. arXiv preprint arXiv:1606.02147 (2016)
  17. 17.
    Peng, C., Zhang, X., Yu, G., Luo, G., Sun, J.: Large kernel matters-improve semantic segmentation by global convolutional network. arXiv preprint arXiv:1703.02719 (2017)
  18. 18.
    Pohlen, T., Hermans, A., Mathias, M., Leibe, B.: Full-resolution residual networks for semantic segmentation in street scenes. arXiv preprint (2017)Google Scholar
  19. 19.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-24574-4_28CrossRefGoogle Scholar
  20. 20.
    Schwartzbaum, J.A., Fisher, J.L., Aldape, K.D., Wrensch, M.: Epidemiology and molecular pathology of glioma. Nat. Rev. Neurol. 2(9), 494 (2006)CrossRefGoogle Scholar
  21. 21.
    Sedlar, S.: Brain tumor segmentation using a multi-path CNN based method. In: Crimi, A., Bakas, S., Kuijf, H., Menze, B., Reyes, M. (eds.) BrainLes 2017. LNCS, vol. 10670, pp. 403–422. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-75238-9_35CrossRefGoogle Scholar
  22. 22.
    Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)MathSciNetzbMATHGoogle Scholar
  23. 23.
    Tabatabai, G., et al.: Molecular diagnostics of gliomas: the clinical perspective. Acta Neuropathol. 120(5), 585–592 (2010)CrossRefGoogle Scholar
  24. 24.
    Yamahara, T., et al.: Morphological and flow cytometric analysis of cell infiltration in glioblastoma: a comparison of autopsy brain and neuroimaging. Brain Tumor Pathol. 27(2), 81–87 (2010)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Cong Liu
    • 1
  • Weixin Si
    • 2
    • 3
    Email author
  • Yinling Qian
    • 2
  • Xiangyun Liao
    • 2
  • Qiong Wang
    • 2
  • Yong Guo
    • 1
  • Pheng-Ann Heng
    • 2
    • 3
  1. 1.College of Mechanical and Electrical EngineeringCentral South UniversityChangshaChina
  2. 2.Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality TechnologyShenzhen Institutes of Advanced Technology, Chinese Academy of SciencesShenzhenChina
  3. 3.Department of Computer Science and EngineeringThe Chinese University of Hong KongHong KongChina

Personalised recommendations

Cite paper

Buy options