Abstract
Automatic segmentation of Multiple Sclerosis (MS) lesions is a challenging task due to their variability in shape, size, location and texture in Magnetic Resonance (MR) images. A reliable, automatic segmentation method can help diagnosis and patient follow-up while reducing the time consuming need of manual segmentation. In this paper, we present a fully automated method for MS lesion segmentation. The proposed method uses MR intensities and White Matter (WM) priors for extraction of candidate lesion voxels and uses Convolutional Neural Networks for false positive reduction. Our networks process longitudinal data, a novel contribution in the domain of MS lesion analysis. The method was tested on the ISBI 2015 dataset and obtained state-of-the-art Dice results with the performance level of a trained human rater.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aït-Ali, L.S., Prima, S., Hellier, P., Carsin, B., Edan, G., Barillot, C.: STREM: a robust multidimensional parametric method to segment MS lesions in MRI. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3749, pp. 409–416. Springer, Heidelberg (2005)
Styner, M., Lee, J., Chin, B., et al.: 3D segmentation in the clinic: a grand challenge II: MS lesion segmentation. MIDAS J. 2008, 1–5 (2008)
Maier, O., Handels, H.: MS-Lesion Segmentation in MRI with Random Forests. In: Proceedings of the 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, pp. 1–2 (2015)
Catanese, L., Commowick, O., Barillot, C.: Automatic graph cut segmentation of multiple Sclerosis lesions. In: Proceedings of the 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, pp. 1–2 (2015)
Ghafoorian, M., Platel, B.: Convolutional neural networks for MS lesion segmentation, method description of DIAG team. In: Proceedings of the 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, pp. 1–2 (2015)
Vaidya, S., et al.: Longitudinal multiple Sclerosis lesion segmentation using 3D convolutional neural networks. In: Proceedings of the 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, pp. 1–2 (2015)
Jesson, A., Arbel, T.: Hierarchical MRF and random forest segmentation of MS lesions and healthy tissues in brain MRI. In: Proceedings of the 2015 Longitudinal Multiple Sclerosis Lesion Segmentation Challenge, pp. 1–2 (2015)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Roth, H.R., et al.: A new 2.5D representation for lymph node detection using random sets of deep convolutional neural network observations. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014, Part I. LNCS, vol. 8673, pp. 520–527. Springer, Heidelberg (2014)
Mechrez, R., Goldberger, J., Greenspan, H.: Patch-based segmentation with spatial consistency: application to MS lesions in brain MRI. Int. J. Biomed. Imaging 2016, 1–13 (2016)
Mazziotta, J., Toga, A., Evans, A., et al.: A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philos. Trans. Roy. Soc. Lond. Ser. B 356(1412), 1293–1322 (2001)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)
Chollet, F.: Keras (2015). GitHub. https://github.com/fchollet/keras
Zeiler, M.D.: ADADELTA: an adaptive learning rate method. arXiv preprint arXiv:1212.5701
Roy, S., et al.: Subject-specific sparse dictionary learning for atlas-based brain MRI segmentation. IEEE J. Biomed. Health Inform. 19(5), 1598–1609 (2015)
ISBI 2015 Longitudinal MS Lesion Segmentation Evaluation Website. https://smart-stats-tools.org/lesion-challenge-2015
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Setio, A.A.A., et al.: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans. Med. Imaging 35(5), 1160–1169 (2016)
Acknowledgement
Part of this work was funded by the INTEL Collaborative Research Institute for Computational Intelligence (ICRI-CI).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Birenbaum, A., Greenspan, H. (2016). Longitudinal Multiple Sclerosis Lesion Segmentation Using Multi-view Convolutional Neural Networks. In: Carneiro, G., et al. Deep Learning and Data Labeling for Medical Applications. DLMIA LABELS 2016 2016. Lecture Notes in Computer Science(), vol 10008. Springer, Cham. https://doi.org/10.1007/978-3-319-46976-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-46976-8_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46975-1
Online ISBN: 978-3-319-46976-8
eBook Packages: Computer ScienceComputer Science (R0)