Skip to main content

Semi-supervised Multi-task Learning with Chest X-Ray Images

  • Conference paper
  • First Online:
Machine Learning in Medical Imaging (MLMI 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11861))

Included in the following conference series:

Abstract

Discriminative models that require full supervision are inefficacious in the medical imaging domain when large labeled datasets are unavailable. By contrast, generative modeling—i.e., learning data generation and classification—facilitates semi-supervised training with limited labeled data. Moreover, generative modeling can be advantageous in accomplishing multiple objectives for better generalization. We propose a novel multi-task learning model for jointly learning a classifier and a segmentor, from chest X-ray images, through semi-supervised learning. In addition, we propose a new loss function that combines absolute KL divergence with Tversky loss (KLTV) to yield faster convergence and better segmentation performance. Based on our experimental results using a novel segmentation model, an Adversarial Pyramid Progressive Attention U-Net (APPAU-Net), we hypothesize that KLTV can be more effective for generalizing multi-tasking models while being competitive in segmentation-only tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Caruana, R.: Multitask learning: a knowledge-based source of inductive bias. In: International Conference on Machine Learning (1993)

    Google Scholar 

  2. Mittal, A., Hooda, R., Sofat, S.: LF-SegNet: a fully convolutional encoder-decoder network for segmenting lung fields from chest radiographs. WPC 101, 511–529 (2018)

    Google Scholar 

  3. Zhu, W., Xiang, X., Tran, T.D., Hager, G.D., Xie, X.: Adversarial deep structured nets for mass segmentation from mammograms. In: ISBI (2018)

    Google Scholar 

  4. Chen, C., Dou, Q., et al.: Semantic-aware generative adversarial nets for unsupervised domain adaptation in chest X-ray segment. arXiv:1806.00600 (2018)

  5. Dai, W., Dong, N., Wang, Z., Liang, X., Zhang, H., Xing, E.P.: SCAN: structure correcting adversarial network for organ segmentation in chest X-rays. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 263–273. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_30

    Chapter  Google Scholar 

  6. Madani, A., et al.: Semi-supervised learning with GANs for chest X-ray classification with ability of data domain adaptation. In: Proceedings of ISBI (2018)

    Google Scholar 

  7. Guan, Q., Huang, Y., et al.: Diagnose like a radiologist: attention guided convolutional net for thorax disease classification. arXiv:1801.09927 (2018)

  8. Imran, A.A.Z., Terzopoulos, D.: Multi-adversarial variational autoencoder networks. arXiv preprint arXiv:1906.06430 (2019)

  9. Rezaei, M., Yang, H., et al.: Multi-task generative adversarial network for handling imbalanced clinical data. CoRR (2018)

    Google Scholar 

  10. Girard, F., Kavalec, C., Cheriet, F.: Joint segmentation and classification of retinal arteries/veins from fundus images. AI Med. 94, 96–109 (2019)

    Google Scholar 

  11. Mehta, S., Mercan, E., Bartlett, J., Weaver, D., Elmore, J.G., Shapiro, L.: Y-Net: joint segmentation and classification for diagnosis of breast biopsy images. In: Frangi, A.F., Schnabel, J.A., Davatzikos, C., Alberola-López, C., Fichtinger, G. (eds.) MICCAI 2018. LNCS, vol. 11071, pp. 893–901. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00934-2_99

    Chapter  Google Scholar 

  12. Yang, X., Zeng, Z., Yeo, S.Y., et al.: A novel multi-task deep learning model for skin lesion segmentation and classification. arXiv:1703.01025 (2017)

  13. Khosravan, N., Bagci, U.: Semi-supervised multi-task learning for lung cancer diagnosis. In: EMBC (2018)

    Google Scholar 

  14. Fu, H., Cheng, J., Xu, Y., et al.: Joint optic disc and cup segmentation based on multi-label deep network and polar transformation. IEEE TMI 37, 1597–1605 (2018)

    Google Scholar 

  15. Imran, A.-A.-Z., Hatamizadeh, A., Ananth, S.P., Ding, X., Terzopoulos, D., Tajbakhsh, N.: Automatic segmentation of pulmonary lobes using a progressive dense V-network. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS 2018. LNCS, vol. 11045, pp. 282–290. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_32

    Chapter  Google Scholar 

  16. Oktay, O., Schlemper, J., Folgoc, L.L., et al.: Attention U-net: learning where to look for the pancreas. arXiv:1804.03999 (2018)

  17. Jaeger, S., Candemir, S., et al.: Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. Quant. Imaging Med. Surg. 4, 475 (2014)

    Google Scholar 

  18. Shiraishi, J., Katsuragawa, S., et al.: Development of a digital image database for chest radiographs with and without a lung nodule. J. Roentgenol. 174, 71–74 (2000)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdullah-Al-Zubaer Imran .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Imran, AAZ., Terzopoulos, D. (2019). Semi-supervised Multi-task Learning with Chest X-Ray Images. In: Suk, HI., Liu, M., Yan, P., Lian, C. (eds) Machine Learning in Medical Imaging. MLMI 2019. Lecture Notes in Computer Science(), vol 11861. Springer, Cham. https://doi.org/10.1007/978-3-030-32692-0_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-32692-0_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-32691-3

  • Online ISBN: 978-3-030-32692-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics