Integrated Extractor, Generator and Segmentor for Ischemic Stroke Lesion Segmentation

  • Tao SongEmail author
  • Ning Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11383)


The challenge of Ischemic Stroke Lesion Segmentation 2018 asks for methods that allow the segmentation of stroke lesion based on acute CT perfusion data, and provided a data set of 103 stroke patients and matching expert segmentations. In this paper, a novel deep learning framework with extractor, generator and segmentor for ischemic stroke lesion segmentation has been proposed. Firstly, the extractor is to extract the feature map from processed perfusion weighted imaging (PWI). Secondly, the output of extractor, cerebral blood volume (CBV), cerebral blood flow (CBF), mean transit time (MTT) and time of peak of the residue function (Tmax), etc. as the input of the generator to generated the Diffusion weighted imaging (DWI) modality. Finally, the segmentor is to precisely segment the ischemic stroke lesion using the generated data. In order to overcome the over-fitting, the data augmentation (e.g. random rotations, random crop and radial distortion) is used in training phase. Therefore, generalized dice combined with cross entropy were used as loss function to handle unbalanced data. All networks are trained end-to-end from scratch using the 2018 Ischemic Stroke Lesion Challenge dataset which contains training set of 63 patients and testing set of 40 patients. Our method achieves state-of-the-art segmentation accuracy in the testing set.


Extractor Generator Segmentor Generalized dice 


  1. 1.
    Eastwood, J.D., Lev, M.H., Azhari, T.: CT perfusion scanning with deconvolution analysis: pilot study in patients with acute middle cerebral artery stroke. Radiology 222(1), 227–236 (2002)CrossRefGoogle Scholar
  2. 2.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: International Conference on Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  3. 3.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)Google Scholar
  4. 4.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). Scholar
  5. 5.
    Zhang, J., Shen, X., Zhuo, T., et al.: Brain tumor segmentation based on refined fully convolutional neural networks with a hierarchical dice loss. arXiv preprint arXiv:1712.09093 (2018)
  6. 6.
    Luo, P., Ren, J., Peng, Z., Zhang, R., Li, J.: Differentiable learning-to-normalize via switchable normalization. arXiv preprint arXiv:1806.10779 (2018)
  7. 7.
    Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. arXiv preprint arXiv:1709.01507 (2017)
  8. 8.
    Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., Jorge Cardoso, M.: Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In: Cardoso, M.J., et al. (eds.) DLMIA/ML-CDS - 2017. LNCS, vol. 10553, pp. 240–248. Springer, Cham (2017). Scholar
  9. 9.
  10. 10.
  11. 11.
  12. 12.
    Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093 (2014)
  13. 13.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. arXiv preprint arXiv:1512.03385 (2015)
  14. 14.
    Tieleman, T., Hinton, G.: Lecture 6.5-rmsprop: divide the gradient by a running average of its recent magnitude. COURSERA: Neural Netw. Mach. Learn. 4(2), 26–31 (2012)Google Scholar
  15. 15.
    Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)
  16. 16.

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.SenseTime Inc.ShanghaiChina

Personalised recommendations