A framework combining DNN and level-set method to segment brain tumor in multi-modalities MR image
- 80 Downloads
The magnetic resonance (MR) brain tumor image segmentation can quantitatively analyze the tumor size and provide a large number of brain functional and anatomical information, which to a certain degree can guide the brain disease diagnosis and treatment planning. In this paper, we proposed a framework for brain tumor MR image segmentation combining deep learning and level-set method. First of all, we trained deep neural network (DNN) to classify center pixel of the image patches according to four MR modalities (T1, T1c, T2 and flair) and generated the segmentation result as initialization for level-set method. Secondly, we refine the segmentation results in edema region by level set in flair modality, which compensated for the discontinuity of the DNN segmentation improving the segmentation accuracy. In order to balance tumor patches proportion in datasets increasing them from 2 to 15%, we select patches randomly with a fixed proportion between tumor and normal tissue. Experiments show that the proposed method can effectively overcome discontinuity in segmentation result and obtain a satisfied segmentation results.
KeywordsDeep neural network Brain tumor segmentation Level set Data balance
This study was funded by Nature Science Foundation of Shanxi Province (Funding Number: 2015011045).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
This article does not contain any studies with human participants or animal performed by any of the author.
- Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv: Distributed, Parallel, and Cluster ComputingGoogle Scholar
- Davy A, Havaei M, Warde-Farley D, Biard A, Tran L, Jodoin PM, Courville A, Larochelle H, Pal C, Bengio Y (2014) Brain tumor segmentation with deep neural networks. In: Proceedings of BRATS-MICCAIGoogle Scholar
- Dvořák P, Menze B (2015) Local structure prediction with convolutional neural networks for multimodal brain tumor segmentation. Medical computer vision: algorithms for big data. Springer, BerlinGoogle Scholar
- Farahani K, Menze B, Reyes M (2013) Multimodal brain tumor segmentation (BRATS 2013). https://www.smir.ch/BRATS/Start2013. Accessed 2017
- Girshick RB, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Computer vision and pattern recognition, pp 580–587Google Scholar
- Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: International conference on machine learningGoogle Scholar
- Goodfellow IJ, Wardefarley D, Mirza M, Courville AC, Bengio Y (2013) Maxout networks. In: International conference on machine learningGoogle Scholar
- Jarrett K, Kavukcuoglu K, Ranzato M, Lecun Y (2009) What is the best multi-stage architecture for object recognition? In: International conference on computer visionGoogle Scholar
- Jiang GP, Qin WJ, Zhou SJ, Wang CM (2015) State-of-the-art in medical image segmentation. Chin J Comput 38(6):1222–1242Google Scholar
- Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: International conference on learning representationsGoogle Scholar
- Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Neural information processing systems, pp 1097–1105Google Scholar
- Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Computer vision and pattern recognition, pp 3431–3440Google Scholar
- Pereira S, Pinto A, Alves V et al (2015) Deep convolutional neural networks for the segmentation of gliomas in multi-sequence MRI. Brainlesion: Glioma, multiple sclerosis, stroke and traumatic brain injuries. Springer International Publishing, BerlinGoogle Scholar
- Shi F, Fan Y, Tang S, Gilmore JH, Lin W, Shen D (2010) Neonatal brain image segmentation in longitudinal MRI studies. Neuro Image 49(1):391–400Google Scholar
- Sun G, Liang L, Chen T, Xiao F, Lang F (2018) Network traffic classification based on transfer learning. In: Computers & electrical engineering, pp 920–927Google Scholar
- Urban G, Bendszus M, Hamprecht FA, Kleesiek J (2014) Multi-modal brain tumor segmentation using deep convolutional neural networks. Miccai Brats Challenge, Winning ContributionGoogle Scholar
- Wang L, Shi F, Li G, Gao Y, Lin W, Gilmore JH, Shen D (2014) Segmentation of neonatal brain MR images using patch-driven level sets. Neuro Image 84:141–158Google Scholar
- Zheng S, Jayasumana S, Romeraparedes B, Vineet V, Su Z, Du D, Torr PH (2015) Conditional random fields as recurrent neural networks. In: International conference on computer vision, pp 1529–1537Google Scholar
- Zikic D, Ioannou Y, Brown M et al (2014) Segmentation of brain tumor tissues with convolutional neural networks. In: MICCAI workshop on multimodal brain tumor segmentation challengeGoogle Scholar