Abstract
Domain adaptation is a fundamental problem in the 3D medical image process. The current methods mainly cut the 3D image into 2D slices and then use 2D CNN for processing, which may ignore the inter-slice information of the 3D medical image. Methods based on 3D CNN can capture the inter-slice information but lead to extensive memory consumption and lots of training time. In this paper, we aim to model the inter-slice information in 2D CNN to realize the unsupervised 3D medical image’s domain adaptation without additional cost from 3D convolutions. To better capture the inter-slice information, we train the model from the adjacent (local) slices and the global slice sequence perspective. We first propose the Slice Subtract Module method (SSM), which can easily embed into 2D CNN and model the adjacent slices by introducing very limited extra computation cost. We then train the adaptation model with a distance consistency loss supervised by the LSTM component to model the global slice sequence. Extensive experiments on BraTS2019 and Chaos datasets show that our method can effectively improve the quality of domain adaptation and achieve state-of-the-art accuracy on segmentation tasks with little computation increased while remaining parameters unchanged.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dou, Q., Ouyang, C., Chen, C., Chen, H., Heng, P.-A.: Pnp-adanet: plug-and-play adversarial domain adaptation network with a benchmark at cross-modality cardiac segmentation. IEEE Access 7, 99065–99076 (2019)
Jia, X., Wang, S., Liang, X., Balagopal, A., Nguyen, D., Yang,, M., Wang, Z., Ji, J., Qian, X., Jiang, S.: Cone-beam computed tomography (cbct) segmentation by adversarial learning domain adaptation. In: Proceedings of the Medical Image Computing and Computer Assisted Intervention, pp. 567–575 (2019)
Pacheco, C., Vidal, R.: An unsupervised domain adaptation approach to classification of stem cell-derived cardiomyocytes. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 806–814 (2019)
Lee, K., Zlateski, A., Ashwin, V., Seung, H.S.: Recursive training of 2d–3d convolutional networks for neuronal boundary prediction. In: Advances in Neural Information Processing Systems, pp. 3573–3581 (2015)
Fripp, J., Crozier, S., Warfield, S.K., Ourselin, S.: Automatic segmentation and quantitative analysis of the articular cartilages from magnetic resonance images of the knee. IEEE Trans. Med. Imaging 29(1), 55–64 (2010)
Lai, M.: Deep learning for medical image segmentation. arXiv: preprint (2015)
Chen, J., Yang, L., Zhang, Y., Alber, M., Chen, D.Z.: Combining fully convolutional and recurrent neural networks for 3d biomedical image segmentation. In: Advances in Neural Information Processing Systems, pp. 3036–3044 (2016)
Stollenga, M.F., Byeon, W., Liwicki, M., Schmidhube, J.: Parallel multi-dimensional lSTM, with application to fast biomedical volumetric image segmentation. In: Advances in Neural Information Processing Systems, pp. 2998–3006 (2015)
Lin, J., Gan, C., Han, S.: Tsm: temporal shift module for efficient video understanding. In: Proceedings of the International Conference on Computer Vision, pp. 7082–7092 (2019)
Zadrozny, B.: Learning and evaluating classifiers under sample selection bias. In: Proceedings of the Twenty-First International Conference on Machine Learning, pp. 114–121 (2004)
Blitzer, J., Mcdonald, R., Pereira, F.: Domain adaptation with structural correspondence learning. In: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pp. 120–128 (2006)
Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)
Long, M., Zhu, H., Wang, J., Jordan, M.I.: Unsupervised domain adaptation with residual transfer networks. In: Proceedings of the 30th International Conference on Neural Information Processing Systems, pp. 136–144 (2016)
Isola, P., Zhu, J., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the Computer Vision and Pattern Recognition, pp. 5967–5976 (2016)
Liu, M., Breuel, T.M., Kautz, J.: Unsupervised image-to-image translation networks. Computer, Vision and Pattern Recognition. arXiv (2017)
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Proceedings of the Neural Information Processing Systems, pp. 2672–2680 (2014)
Luo Y., Zheng, L., Guan, T., Yu, J., Yang, Y.: Taking a closer look at domain shift: category-level adversaries for semantics consistent domain adaptation. In: Proceedings of Conference on Computer Vision and Pattern Recognition, pp. 2502–2511 (2019)
Zhu, J., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of International Conference on Computer Vision, pp. 2242–2251 (2017)
Royer, A., Bousmalis, K., Gouws, S., Bertsch, F., Mosseri, I., Cole, F., Murphy, K.: XGAN: unsupervised Image-to-Image Translation for many-to-many Mappings, pp. 33–49 (2020)
Anoosheh, A, Agustsson, E., Timofte, R., Van Gool, L.: Combogan: unrestrained scalability for image domain translation. In: Proceedings of the Computer Vision and Pattern Recognition Workshops, pp. 896–8967 (2018)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention, pp. 234–241 (2015)
Xia, Y., Xie, L., Liu, F., Zhu, Z., Fishman, E.K., Yuille, A.L.: Bridging the gap between 2d and 3d organ segmentation with volumetric fusion net. In: Proceedings of Medical Image Computing and Computer Assisted Intervention, pp. 445–453 (2018)
Çiçek, Ö., Abdulkadir, A., Lienkamp, S.S., Brox, T., Ronneberger, O.: 3d u-net: learning dense volumetric segmentation from sparse annotation. In: Proceedings of Medical Image Computing and Computer-Assisted Intervention, pp. 424–432 (2016)
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., Pal, C., Jodoin, P.-M., Larochelle, H.: Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31 (2017)
Acknowledgement
This work was supported by the National Key R&D Program of China under Grant NO.2018YFB0204303, Nature Science Foundation of China under Grant NO.U1811461, the Guangdong Natural Science Foundation under Grant NO.2018B030312002, and the Program for Guangdong Introducing Innovative and Entrepreneurial Teams under Grant NO.2016ZT06D211.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Deng, C., Li, K., Chen, Z. (2021). Unsupervised Domain Adaptation for 3D Medical Image with High Efficiency. In: Karlapalem, K., et al. Advances in Knowledge Discovery and Data Mining. PAKDD 2021. Lecture Notes in Computer Science(), vol 12712. Springer, Cham. https://doi.org/10.1007/978-3-030-75762-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-030-75762-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-75761-8
Online ISBN: 978-3-030-75762-5
eBook Packages: Computer ScienceComputer Science (R0)