Skip to main content
SpringerLink
Log in

Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

Nasopharyngeal carcinoma (NPC) is prevalent in certain areas, such as South China, Southeast Asia, and the Middle East. Radiation therapy is the most efficient means to treat this malignant tumor. Positron emission tomography–computed tomography (PET-CT) is a suitable imaging technique to assess this disease. However, the large amount of data produced by numerous patients causes traditional manual delineation of tumor contour, a basic step for radiotherapy, to become time-consuming and labor-intensive. Thus, the demand for automatic and credible segmentation methods to alleviate the workload of radiologists is increasing. This paper presents a method that uses fully convolutional networks with auxiliary paths to achieve automatic segmentation of NPC on PET-CT images. This work is the first to segment NPC using dual-modality PET-CT images. This technique is identical to what is used in clinical practice and offers considerable convenience for subsequent radiotherapy. The deep supervision introduced by auxiliary paths can explicitly guide the training of lower layers, thus enabling these layers to learn more representative features and improve the discriminative capability of the model. Results of threefold cross-validation with a mean dice score of 87.47% demonstrate the efficiency and robustness of the proposed method. The method remarkably outperforms state-of-the-art methods in NPC segmentation. We also validated by experiments that the registration process among different subjects and the auxiliary paths strategy are considerably useful techniques for learning discriminative features and improving segmentation performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Tang LL, Chen WQ, Xue WQ: Global trends in incidence and mortality of nasopharyngeal carcinoma. Cancer Lett 374(1):22–30, 2016

    Article  CAS  Google Scholar 

  2. Wu HB, Wang QS, Wang MF: Preliminary study of 11C-choline PET/CT for T staging of locally advanced nasopharyngeal carcinoma: comparison with 18F-FDG PET/CT. J Nucl Med 52(3):341–346, 2011

    Article  CAS  Google Scholar 

  3. Huang W, Chan KL, Zhou JY: Region-Based Nasopharyngeal Carcinoma Lesion Segmentation from MRI Using Clustering- and Classification-Based Methods with Learning. J Digit Imaging 26(3):472–482, 2013

    Article  PubMed  Google Scholar 

  4. Han DF, Bayouth J, Song Q: Globally Optimal Tumor Segmentation in PET-CT Images: A Graph-Based Co-Segmentation Method. International Conference on Information Processing in Medical Imaging, 2011, pp 245–256

  5. Song Q, Bai J, Han D: Optimal co-segmentation of tumor in PET-CT images with context information. IEEE Trans Med Imaging 32(9):1685–1697, 2013

    Article  PubMed  PubMed Central  Google Scholar 

  6. Ju W, Xiang D, Zhang B: Random Walk and Graph Cut for Co-Segmentation of Lung Tumor on PET-CT Images. IEEE Trans Image Process 24(12):5854–5867, 2015

    Article  PubMed  Google Scholar 

  7. Éloïse C, Talbot H, Passat N: Automated 3D lymphoma lesion segmentation from PET/CT characteristic. IEEE International Symposium on Biomedical Imaging, 2017, pp 174–178

  8. Wang Y, Zu C, Hu GL: Automatic Tumor Segmentation with Deep Convolutional Neural Networks for Radiotherapy Applications. Neural Process Lett 10:1–12, 2018

    Google Scholar 

  9. Tatanun C, Ritthipravat P, Bhongmakapat T: Automatic segmentation of nasopharyngeal carcinoma from CT images: Region growing based technique. 2010 2nd International Conference on Signal Processing System, 2010, pp 18–22

  10. Chanapai W, Bhongmakapat T, Tuntiyatorn L: Nasopharyngeal carcinoma segmentation using a region growing technique. Int J Comput Assist Radiol Surg 7(3):413–422, 2012

    Article  PubMed  Google Scholar 

  11. Huang KW, Zhao ZY, Gong Q: Nasopharyngeal carcinoma segmentation via HMRF-EM with maximum entropy. Eng Med Biol Soc:2968–2972, 2015

  12. Fitton I, Cornelissen SA, Duppen JC: Semi-automatic delineation using weighted CT-MRI registered images for radiotherapy of nasopharyngeal cancer. Med Phys 38(8):4662–4666, 2011

    Article  CAS  PubMed  Google Scholar 

  13. Wu PX, Khong PL, Chan T: Automatic detection and classification of nasopharyngeal carcinoma on PET/CT with support vector machine. Int J Comput Assist Radiol Surg 7(4):635–646, 2012

    Article  PubMed  Google Scholar 

  14. Mohammed MA, Ghani MKA, Hamed RI: Artificial neural networks for automatic segmentation and identification of nasopharyngeal carcinoma. J Comput Sci 21:263–274, 2017

    Article  Google Scholar 

  15. Men K, Chen X, Zhang Y: Deep Deconvolutional Neural Network for Target Segmentation of Nasopharyngeal Cancer in Planning Computed Tomography Images. Front Oncol 7:315–323, 2017

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ronneberger O, Fischer P, Brox T: U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015, pp 234–241

  17. Brosch T, Tang L, Yoo YJ: Deep 3D Convolutional Encoder Networks with Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation. IEEE Trans Med Imaging 35(5):1229–1239, 2016

    Article  PubMed  Google Scholar 

  18. Milletari F, Navab N, Ahmadi S: V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation. Fourth International Conference on 3d Vision, 2016, pp 565–571

  19. Dong H, Yang G, Liu F D: Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks. Conference on Medical Image Understanding and Analysis, 2017, pp 506–517

  20. Christ PF, Ettlinger F, Grün F: Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully Convolutional Neural Networks. arXiv preprint (arXiv:1702.05970v2), 2017

  21. Kamnitsas K, Ledig C, Newcombe VFJ: Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med Image Anal 36:61–78, 2017

    Article  PubMed  Google Scholar 

  22. Ioffe S, Szegedy C: Batch normalization: Accelerating deep network training by reducing internal covariate shift. International Conference on International Conference on Mach Learn, 2015, pp 448–456

  23. Dou Q, Yu L, Chen H: 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41:40–54, 2017

    Article  PubMed  Google Scholar 

  24. Tseng K L, Lin Y L, Hus W: Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation. arXiv preprint (arXiv:1704.07754), 2017

  25. Pereira S, Pinto A, Alves V: Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. IEEE Trans Med Imaging 35(5):1240–1251, 2016

    Article  PubMed  Google Scholar 

  26. He KM, Zhang XY, Ren SQ: Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE international conference on computer vision, 2015, pp 1026–1034

  27. Dice LR: Measures of the Amount of Ecologic Association Between Species. Ecology 26(3):297–302, 1945

    Article  Google Scholar 

Download references

Funding

This work was supported by the National Natural Science Foundation Joint Fund Key Support Project under Grant U1501256 and the Applied Science and Technology Research and Development Special Project in Guangdong Province (No. 2015B010131011).

Author information

Authors and Affiliations

  1. School of Biomedical Engineering, Southern Medical University, Guangzhou, 510515, China

    Lijun Zhao, Zixiao Lu, Jun Jiang, Yujia Zhou, Yi Wu & Qianjin Feng

Authors
  1. Lijun Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zixiao Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yujia Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yi Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Qianjin Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qianjin Feng.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, L., Lu, Z., Jiang, J. et al. Automatic Nasopharyngeal Carcinoma Segmentation Using Fully Convolutional Networks with Auxiliary Paths on Dual-Modality PET-CT Images. J Digit Imaging 32, 462–470 (2019). https://doi.org/10.1007/s10278-018-00173-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-018-00173-0

Keywords

Search

Navigation