Skip to main content

Cardio-Pulmonary Substructure Segmentation of CT Images Using Convolutional Neural Networks

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11850))

Abstract

Radiotherapy doses to some cardio-pulmonary substructures may be critical factors in the observed early mortality following radiotherapy for nonsmall cell lung cancer patients. Our goal is to provide an open-source tool to automatically segment cardio-vascular substructures for consistent outcomes analyses, and subsequently for radiation treatment planning of thoracic patients. Here, we built and validated a multi-label Deep Learning Segmentation (DLS) framework for accurate auto-segmentation of cardio-pulmonary substructures. The DLS framework utilized a deep neural network architecture to segment 12 cardio-pulmonary substructures from Computed Tomography (CT) scans of 217 patients previously treated with thoracic RT. The model was robust against variability in image quality characteristics, including the presence/absence of contrast. A hold-out dataset of additional 24 CT scans was used for quantitative evaluation of the final model against expert contours using Dice Similarity Coefficients (DSC) and 95th Percentile of Hausdorff Distance (HD95). DLS contours of an additional 10 CT scans were reviewed by a radiation oncologist to determine the number of slices in need of adjustment for each of the non-overlapping substructures. The DLS model reduced segmentation time per patient from about one hour of manual segmentation to 10 s. Quantitatively, the highest accuracy was observed for the Heart (median DSC = (0.96(\(0.91-0.93\))) and HD95 = (4.3 mm(3.8 mm − 5.5 mm)). The median DSC for the remaining structures was \(0.80-0.92\). The expert judged that, on average, 85% of the contours were equivalent to state-of-the-art manual contouring and did not require any modifications.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 833–851. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_49

    Chapter  Google Scholar 

  2. Deasy, J., Blanco, A., Clark, V.: CERR: a computational environment for radiotherapy research. Med. Phys. 30(5), 979–85 (2003)

    Article  Google Scholar 

  3. Dormer, J.D., et al.: Heart chamber segmentation from CT using convolutional neural networks. In: Proceedings of SPIE - The International Society for Optical Engineering (2018)

    Google Scholar 

  4. Feng, M., Moran, J., Koelling, T., et al.: Development and validation of a heart atlas to study cardiac exposure to radiation following treatment for breast cancer. Int. J. Radiat. Oncol. Biol. Phys. 79(1), 10–18 (2010)

    Article  Google Scholar 

  5. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, June 2016. https://doi.org/10.1109/CVPR.2016.90

  6. Isensee, F., et al.: nnU-Net: self-adapting framework for U-Net-based medical image segmentation. CoRR abs/1809.10486 (2018). http://arxiv.org/abs/1809.10486

  7. Jin, Q., Meng, Z., Sun, C., Wei, L., Su, R.: RA-UNet: a hybrid deep attention-aware network to extract liver and tumor in CT scans. CoRR abs/1811.01328 (2018). http://arxiv.org/abs/1811.01328

  8. Liu, W., Rabinovich, A., Berg, A.C.: ParseNet: looking wider to see better. CoRR abs/1506.04579 (2015). http://arxiv.org/abs/1506.04579

  9. Luo, Y., et al.: Automatic segmentation of cardiac substructures from noncontrast CT images: accurate enough for dosimetric analysis? Acta Oncol. 58(1), 81–87 (2019)

    Article  Google Scholar 

  10. McWilliam, A., Kennedy, J., et al.: Radiation dose to heart base linked with poorer survival in lung cancer patients. Eur. J. Cancer 85, 106–113 (2017)

    Article  Google Scholar 

  11. Milletari, F., Navab, N., Ahmadi, S.: V-Net: fully convolutional neural networks for volumetric medical image segmentation. CoRR abs/1606.04797 (2016). http://arxiv.org/abs/1606.04797

  12. Oktay, O., et al.: Anatomically constrained neural networks (ACNNs): application to cardiac image enhancement and segmentation. IEEE Trans. Med. Imaging 37(2), 384–395 (2018)

    Article  Google Scholar 

  13. Oktay, O., et al.: Attention U-Net: learning where to look for the pancreas. CoRR abs/1804.03999 (2018). http://arxiv.org/abs/1804.03999

  14. Dess, R.T., Sun, Y., et al.: Cardiac events after radiation therapy: combined analysis of prospective multicenter trials for locally advanced non-small-cell lung cancer. J. Clin. Oncol. 35, 1395–402 (2017)

    Article  Google Scholar 

  15. Thor, M., Deasy, J., et al.: The role of heart-related dose-volume metrics on overall survival in the RTOG 0617 clinical trial. Int. J. Radiat. Oncol. Biol. Phys. 102, S96 (2018)

    Article  Google Scholar 

  16. Vivekanandan, S., Landau, D., Counsell, N., Warren, D., Khwanda, A., et al.: The impact of cardiac radiation dosimetry on survival after radiation therapy for non-small cell lung cancer. Int. J. Radiat. Oncol. 99, 51–60 (2017)

    Article  Google Scholar 

Download references

Acknowledgments

This research is partially supported by NCI R01 CA198121.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rabia Haq .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Haq, R., Hotca, A., Apte, A., Rimner, A., Deasy, J.O., Thor, M. (2019). Cardio-Pulmonary Substructure Segmentation of CT Images Using Convolutional Neural Networks. In: Nguyen, D., Xing, L., Jiang, S. (eds) Artificial Intelligence in Radiation Therapy. AIRT 2019. Lecture Notes in Computer Science(), vol 11850. Springer, Cham. https://doi.org/10.1007/978-3-030-32486-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32486-5_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32485-8

  • Online ISBN: 978-3-030-32486-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics