Advertisement

Two-Stream Bidirectional Long Short-Term Memory for Mitosis Event Detection and Stage Localization in Phase-Contrast Microscopy Images

  • Yunxiang Mao
  • Zhaozheng YinEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10434)

Abstract

In this paper, we propose a Two-Stream Bidirectional Long Short-Term Memory (TS-BLSTM) for the task of mitosis event detection and stage localization in time-lapse phase contrast microscopy image sequences. Our method consists of two steps. First, we extract candidate mitosis image sequences. Then, we solve the problem of mitosis event detection and stage localization jointly by the proposed TS-BLSTM, which utilizes both appearance and motion information from candidate sequences. The proposed method outperforms state-of-the-arts by achieving 98.4% precision and 97.0% recall for mitosis detection and 0.62 frame error on average for mitosis stage localization in five challenging image sequences.

Notes

Acknowledgement

This project was supported by NSF CAREER award IIS-1351049 and NSF EPSCoR grant IIA-1355406.

Supplementary material

451304_1_En_7_MOESM1_ESM.mov (5.4 mb)
Supplementary material 1 (mov 5508 KB)

References

  1. 1.
    Li, K., et al.: Computer vision tracking of stemness. In: Proceedings of IEEE International Symposium on Biomedical Imaging, pp. 847–850 (2008)Google Scholar
  2. 2.
    Li, K., et al.: Cell population tracking and lineage construction with spatiotemporal context. Med. Image Anal. 12(5), 546–566 (2008)CrossRefGoogle Scholar
  3. 3.
    Quattoni, A., et al.: Hidden conditional random fields. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1848–1853 (2007)CrossRefGoogle Scholar
  4. 4.
    Liu, A., et al.: Mitosis sequence detection using hidden conditional random fields. In: Proceedings of IEEE International Symposium on Biomedical Imaging (2010)Google Scholar
  5. 5.
    Huh, S., et al.: Automated mitosis detection of stem cell populations in phase-contrast microscopy images. IEEE Trans. Med. Imag. 30(3), 586–596 (2011)CrossRefGoogle Scholar
  6. 6.
    Liu, A., et al.: A semi-Markov model for mitosis segmentation in time-lapse phase contrast microscopy image sequences of stem cell populations. Proc. IEEE Trans. Med. Imag. 31(2), 359–369 (2012)CrossRefMathSciNetGoogle Scholar
  7. 7.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989)CrossRefGoogle Scholar
  8. 8.
    Suykens, J., et al.: Least squares support vector machine classifiers. Neural Process. Lett. 9(3), 293–300 (1999)CrossRefMathSciNetGoogle Scholar
  9. 9.
    Mao, Y., Yin, Z.: A hierarchical convolutional neural network for mitosis detection in phase-contrast microscopy images. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 685–692. Springer, Cham (2016). doi: 10.1007/978-3-319-46723-8_79 CrossRefGoogle Scholar
  10. 10.
    Liang, L., et al.: Mitosis cell identification with conditional random fields. In: Proceedings of Life Science Systems and Applications Workshop, p. 912, November 2007Google Scholar
  11. 11.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comp. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  12. 12.
    Nie, W., et al.: 3D convolutional networks-based mitotic event detection in time-lapse phase contrast microscopy image sequences of stem cell populations. In: Proceedings of CVPRW, June 2016Google Scholar
  13. 13.
    Krizhevsky, A., et al.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  14. 14.
    Hochreiter, S., et al.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  15. 15.
    Donahue, J., et al.: Long-term recurrent convolutional networks for visual recognition and description. In: Proceedings of CVPR (2015)Google Scholar
  16. 16.
    Mao, Y., et al.: Who missed the class? Unifying multi-face detection, tracking and recognition in videos. In: Proceedings of ICME (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Computer ScienceMissouri University of Science and TechnologyRollaUSA

Personalised recommendations