Abstract
The synapse, which is the carrier of neurotransmitter molecules to transmit and store information, is believed to be the key to the reconstruction of the neural circuit. To date, electron microscope (EM) is considered as one of the most important tools for observing and analyzing synaptic structures because they can clearly observe the internal structure of cells. Consequently, many meaningful researches are focused on how to detect and segment the synapses from EM images. In this paper, we propose a novel and effective method to automatically detect and segment the synaptic clefts by using Mask R-CNN. On this base, we utilize the context cues in adjacent sections to eliminate the misleading results. We apply the method to the CREMI challenge and the results demonstrate that our method is effective in segmenting the synaptic clefts of the drosophila. Specifically, we rank first in sample B+ dataset, and the CREMI score is 86.50 which outperforms most of state-of-the-art methods by a large margin.
This paper is supported by National Science Foundation of China (No. 61673381, No. 61201050, No. 61701497, No. 11771130), Scientific Instrument Developing Project of Chinese Academy of Sciences (No. YZ201671), Bureau of International Cooperation, CAS (No. 153D31KYSB20170059), and Special Program of Beijing Municipal Science & Technology Commission (No. Z161100000216146).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Keras: Deep learning library for theano and tensorflow (2015). http://keras.io/
Miccai challenge oncircuit reconstruction from electron microscopy images (2016). http://cremi.org/
Becker, C., Ali, K., Knott, G., Fua, P.: Learning context cues for synapse segmentation. IEEE Trans. Med. Imag. 32(10), 1864–1877 (2013)
Cardona, A., et al.: An integrated micro- and macroarchitectural analysis of the drosophila brain by computer-assisted serial section electron microscopy, 8(10), e1000502 (2010)
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR IEEE Computer Society Conference on 2005, pp. 886–893 (2005)
Dan, C.C., Giusti, A., Gambardella, L.M.: Schmidhuber: deep neural networks segment neuronal membranes in electron microscopy images. Adv. Neural Inf. Process. Syst. 25, 2852–2860 (2012)
He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask R-CNN (2017)
Huang, G.B., Scheffer, L.K., Plaza, S.M.: Fully-automatic synapse prediction and validation on a large data set (2016)
Kanner, L.: Irrelevant and metaphorical language in early infantile autism. Am. J. Psychiatry 151(2), 161–164 (1994)
Kreshuk, A.: Automated detection and segmentation of synaptic contacts in nearly isotropic serial electron microscopy images. PLoS One 6(10), e24899 (2011)
Kumar, P., Henikoff, S., Ng, P.C.: Predicting the effects of coding non-synonymous variants on protein function using the sift algorithm. Nat. Protoc. 4(7), 1073–1081 (2009)
Li, W., Deng, H., Rao, Q., Xie, Q., Chen, X., Han, H.: An automated pipeline for mitochondrial segmentation on atum-sem stacks. J. Bioinform. Comput. Biol. 15(3), 1750015 (2017)
Lin, T.Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection, pp. 936–944 (2016)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: International Conference on Neural Information Processing Systems, pp. 91–99 (2015)
Roth, H.R., Farag, A., Lu, L., Turkbey, E.B., Summers, R.M.: Deep convolutional networks for pancreas segmentation in CT imaging, 9413(9), 476–484 (2015)
Sun, M., Zhang, D., Guo, H., Deng, H., Li, W., Xie, Q.: 3D-reconstruction of synapses based on EM images. In: IEEE International Conference on Mechatronics and Automation, pp. 1959–1964 (2016)
Xiao, C., Rao, Q., Chen, X., Han, H.: 3D reconstruction of synapses with deep learning based on EM images. In: SPIE Medical Imaging, p. 101324N (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Hong, B., Liu, J., Li, W., Xiao, C., Xie, Q., Han, H. (2018). Fully Automatic Synaptic Cleft Detection and Segmentation from EM Images Based on Deep Learning. In: Ren, J., et al. Advances in Brain Inspired Cognitive Systems. BICS 2018. Lecture Notes in Computer Science(), vol 10989. Springer, Cham. https://doi.org/10.1007/978-3-030-00563-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-00563-4_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00562-7
Online ISBN: 978-3-030-00563-4
eBook Packages: Computer ScienceComputer Science (R0)