Abstract
The automatic reconstruction of neurons from stacks of electron microscopy sections is an important computer vision problem in neuroscience. Recent advances are based on a two step approach: First, a set of possible 2D neuron candidates is generated for each section independently based on membrane predictions of a local classifier. Second, the candidates of all sections of the stack are fed to a neuron tracker that selects and connects them in 3D to yield a reconstruction. The accuracy of the result is currently limited by the quality of the generated candidates. In this paper, we propose to replace the heuristic set of candidates used in previous methods with samples drawn from a conditional random field (CRF) that is trained to label sections of neural tissue. We show on a stack of Drosophila melanogaster neural tissue that neuron candidates generated with our method produce 30% less reconstruction errors than current candidate generation methods. Two properties of our CRF are crucial for the accuracy and applicability of our method: (1) The CRF models the orientation of membranes to produce more plausible neuron candidates. (2) The interactions in the CRF are restricted to form a bipartite graph, which allows a great sampling speed-up without loss of accuracy.
Chapter PDF
Similar content being viewed by others
Keywords
- Conditional Random Field
- Deep Neural Network
- Reconstruction Accuracy
- Candidate Sampling
- Conditional Random Field Model
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Cardona, A.: Towards Semi-Automatic Reconstruction of Neural Circuits. Neuroinformatics 11, 31–33 (2012)
Yuriy, M.: Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs. Journal of Neuroscience Methods 176(2), 276–289 (2009)
Jurrus, E., Paiva, A.R., Watanabe, S., Anderson, J.R., Jones, B.W., Whitaker, R.T., Jorgensen, E.M., Marc, R.E., Tasdizen, T.: Detection of neuron membranes in electron microscopy images using a serial neural network architecture. Medical Image Analysis 14(6), 770–783 (2010)
Kaynig, V., Fuchs, T.J., Buhmann, J.M.: Geometrical Consistent 3D Tracing of Neuronal Processes in ssTEM Data. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part II. LNCS, vol. 6362, pp. 209–216. Springer, Heidelberg (2010)
Kaynig, V., Fuchs, T., Buhmann, J.M.: Neuron Geometry Extraction by Perceptual Grouping in ssTEM Images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Los Alamitos, CA, USA, pp. 2902–2909 (2010)
Vitaladevuni, S.N.P., Basri, R.: Co-Clustering of Image Segments Using Convex Optimization Applied to EM Neuronal Reconstruction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2203–2210 (2010)
Vazquez-Reina, A., Huang, D., Gelbart, M., Lichtman, J., Miller, E., Pfister, H.: Segmentation Fusion for Connectomics. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain. IEEE (2011)
Funke, J., Andres, B., Hamprecht, F.A., Cardona, A., Cook, M.: Efficient Automatic 3D-Reconstruction of Branching Neurons from EM Data. In: CVPR, pp. 1004–1011 (2012)
Ciresan, D., Giusti, A., Gambardella, L.M., Schmidhuber, J.: Deep neural networks segment neuronal membranes in electron microscopy images. In: Pereira, F., Burges, C., Bottou, L., Weinberger, K. (eds.) NIPS, vol. 25, pp. 2843–2851. Curran Associates, Inc. (2012)
Kaynig, V., Vazquez-Reina, A., Knowles-Barley, S., Roberts, M., Jones, T.R., Kasthuri, N., Miller, E., Lichtman, J., Pfister, H.: Large-Scale Automatic Reconstruction of Neuronal Processes from Electron Microscopy Images. ArXiv e-prints (March 2013)
Geman, S., Geman, D.: Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6 (6), 721–741 (1984)
Sutton, C., McCallum, A.: An Introduction to Conditional Random Fields for Relational Learning. Technical report, Department of Computer Science University of Massachusetts (2006)
Gonzalez, J., Low, Y., Gretton, A., Guestrin, C.: Parallel Gibbs Sampling: From Colored Fields to Thin Junction Trees. In: Artificial Intelligence and Statistics (AISTATS), Ft. Lauderdale, FL (May 2011)
Gerhard, S., Funke, J., Martel, J., Cardona, A., Fetter, R.: Segmented anisotropic ssTEM dataset of neural tissue (2013), http://dx.doi.org/10.6084/m9.figshare.856713
Jones, R.: Component Trees for Image Filtering and Segmentation. In: Proceedings of the 1997 IEEE Workshop on Nonlinear Signal and Image Processing, Mackinac Island (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Funke, J. et al. (2014). Candidate Sampling for Neuron Reconstruction from Anisotropic Electron Microscopy Volumes. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2014. MICCAI 2014. Lecture Notes in Computer Science, vol 8673. Springer, Cham. https://doi.org/10.1007/978-3-319-10404-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-10404-1_3
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10403-4
Online ISBN: 978-3-319-10404-1
eBook Packages: Computer ScienceComputer Science (R0)