Instance Segmentation of Neural Cells

  • Jingru YiEmail author
  • Pengxiang Wu
  • Menglin Jiang
  • Daniel J. Hoeppner
  • Dimitris N. Metaxas
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11134)


Instance segmentation of neural cells plays an important role in brain study. However, this task is challenging due to the special shapes and behaviors of neural cells. Existing methods are not precise enough to capture their tiny structures, e.g., filopodia and lamellipodia, which are critical to the understanding of cell interaction and behavior. To this end, we propose a novel deep multi-task learning model to jointly detect and segment neural cells instance-wise. Our method is built upon SSD, with ResNet101 as the backbone to achieve both high detection accuracy and fast speed. Furthermore, unlike existing works which tend to produce wavy and inaccurate boundaries, we embed a deconvolution module into SSD to better capture details. Experiments on a dataset of neural cell microscopic images show that our method is able to achieve better performance in terms of accuracy and efficiency, comparing favorably with current state-of-the-art methods.


Neural cell Instance segmentation Cell detection Cell segmentation 


  1. 1.
    Dai, J., He, K., Sun, J.: Instance-aware semantic segmentation via multi-task network cascades. In: Proceedings of the IEEE CVPR, pp. 3150–3158 (2016)Google Scholar
  2. 2.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Li, F.F.: ImageNet: a large-scale hierarchical image database. In: Proceedings of the IEEE CVPR, pp. 248–255 (2009)Google Scholar
  3. 3.
    Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The PASCAL visual object classes (VOC) challenge. IJCV 88(2), 303–338 (2010)CrossRefGoogle Scholar
  4. 4.
    Fu, C.Y., Liu, W., Ranga, A., Tyagi, A., Berg, A.C.: DSSD: deconvolutional single shot detector. arXiv:1701.06659 (2017)
  5. 5.
    Girshick, R.B.: Fast R-CNN. In: Proceedings IEEE ICCV, pp. 1440–1448 (2015)Google Scholar
  6. 6.
    Girshick, R.B., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings IEEE CVPR, pp. 580–587 (2014)Google Scholar
  7. 7.
    He, K., Gkioxari, G., Dollár, P., Girshick, R.B.: Mask R-CNN. In: Proceedings IEEE ICCV, pp. 2980–2988 (2017)Google Scholar
  8. 8.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings IEEE CVPR, pp. 770–778 (2016)Google Scholar
  9. 9.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings NIPS, pp. 1097–1105 (2012)Google Scholar
  10. 10.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  11. 11.
    Li, Y., Qi, H., Dai, J., Ji, X., Wei, Y.: Fully convolutional instance-aware semantic segmentation. In: Proceedings IEEE CVPR, pp. 4438–4446 (2017)Google Scholar
  12. 12.
    Lin, T.Y., Dollár, P., Girshick, R.B., He, K., Hariharan, B., Belongie, S.J.: Feature pyramid networks for object detection. In: Proceedings IEEE CVPR, pp. 936–944 (2017)Google Scholar
  13. 13.
    Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). Scholar
  14. 14.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings IEEE CVPR, pp. 3431–3440 (2015)Google Scholar
  15. 15.
    Ravin, R., et al.: Potency and fate specification in CNS stem cell populations in vitro. Cell Stem Cell 3(6), 670–680 (2008)CrossRefGoogle Scholar
  16. 16.
    Redmon, J., Divvala, S., Girshick, R.B., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings IEEE CVPR, pp. 779–788 (2016)Google Scholar
  17. 17.
    Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: Proceedings IEEE CVPR, pp. 6517–6525 (2017)Google Scholar
  18. 18.
    Ren, S., He, K., Girshick, R.B., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings NIPS, pp. 91–99 (2015)Google Scholar
  19. 19.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). Scholar
  20. 20.
    Wu, P., Yi, J., Zhao, G., Huang, Z., Qiu, B., Gao, D.: Active contour-based cell segmentation during freezing and its application in cryopreservation. IEEE TBME 62(1), 284–295 (2015)Google Scholar
  21. 21.
    Yi, J., Wu, P., Hoeppner, D.J., Metaxas, D.N.: Fast neural cell detection using light-weight SSD neural network. In: Proceedings of the IEEE CVPR Workshop, pp. 860–864 (2017)Google Scholar
  22. 22.
    Yi, J., Wu, P., Hoeppner, D.J., Metaxas, D.N.: Pixel-wise neural cell instance segmentation. In: Proceedings IEEE ISBI, pp. 373–377 (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer ScienceRutgers UniversityPiscatawayUSA
  2. 2.Astellas Research Institute of AmericaSan DiegoUSA

Personalised recommendations