Skip to main content

A Survey for Breast Histopathology Image Analysis Using Classical and Deep Neural Networks

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1011))

Abstract

Because Breast Histopathology Image Analysis (BHIA) plays a very important role in breast cancer diagnosis and medical treatment processes, more and more effective Machine Learning (ML) techniques are developed and applied in this field to assist histopathologists to obtain a more rapid, stable, objective, and quantified analysis result. Among all the applied ML algorithms in the BHIA field, Artificial Neural Networks (ANNs) show a very positive and healthy development trend in recent years. Hence, in order to clarify the development history and find the future potential of ANNs in the BHIA field, we survey more than 60 related works in this paper, referring to classical ANNs, deep ANNs and methodology analysis.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Acs, B., Rimm, D.: Not just digital pathology, intelligent digital pathology. J. Am. Med. Assoc. 4(3), 403–404 (2018)

    Google Scholar 

  2. Anuranjeeta, Shukla, K., Tiwari, A., Sharma, S.: Classification of histopathological images of breast cancerous and non cancerous cells based on morphological features. Biomed. Pharmacol. J. 10(1), 353–366 (2017)

    Google Scholar 

  3. Araujo, T., Aresta, G., Castro, E., et al.: Classification of breast cancer histology images using convolutional neural networks. Plos One 12(6), 1–14 (2017)

    Article  Google Scholar 

  4. Arevalo, J., Cruz-Roa, A., Gonzelez, F.: Histopathology image representation for automatic analysis: a state-of-the-art review. Revista Med 22(2), 79–91 (2014)

    Article  Google Scholar 

  5. Aswathy, M., Jagannath, M.: Detection of breast cancer on digital histopathology images: present status and future possibilities. Inform. Med. Unlocked 8, 74–79 (2017)

    Article  Google Scholar 

  6. Bayramoglu, N., Kannala, J., Heikkilae, J.: Deep learning for magnification independent breast cancer histopathology image classification. In: Proceedings of ICPR 2016 (2016)

    Google Scholar 

  7. Bejnordi, B., Veta, M., Diest., P., et al.: Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318(22), 2199–2210 (2017)

    Google Scholar 

  8. BenTaieb, A., Hamarneh, G.: Predicting cancer with a recurrent visual attention model for histopathology images. In: Proceedings of MICCAI 2018, pp. 129–137 (2018)

    Google Scholar 

  9. Bhattacharjee, S., et al.: Review on histopathological slide analysis using digital microscopy. Int. J. Adv. Sci. Technol. 62, 65–96 (2014)

    Article  Google Scholar 

  10. Chen, J., Li, Y., Xu, J., et al.: Computer-aided prognosis on breast cancer with hematoxylin and eosin histopathology images: a review. Tumor Biol. 39(3), 1–12 (2017)

    Google Scholar 

  11. Chervony, L., Polak, S.: Fast Classification of Whole Slide Histopathology Images for Breast Cancer Detection. Camelyon Grand Challenge 2017 (2017)

    Google Scholar 

  12. Ciresan, D., et al.: Mitosis detection in breast cancer histology images with deep neural networks. In: Proceedings of MICCAI 2013, pp. 411–418 (2013)

    Google Scholar 

  13. Demir, C., Yener, B.: Automated cancer diagnosis based on histopathological images: a systematic survey. Technical Report, Rensselaer Polytechnic Institute, Department of Computer, TR-05-09 (2005)

    Google Scholar 

  14. Du, B., Qi, Q., Zheng, H., et al.: Breast cancer histopathological image classification via deep active learning and confidence boosting. In: Proceedings of ICANN 2018, pp. 109–116 (2018)

    Google Scholar 

  15. Gandomkar, Z., Brennan, P., Mello-Thoms, C.: A framework for distinguishing benign from malignant breast histopathological images using deep residual networks. In: Proceedings of SPIE 10718 (2018)

    Google Scholar 

  16. Gecer, B., Aksoy, S., Mercan, E., et al.: Detection and classification of cancer in whole slide breast histopathology images using deep convolutional networks. Pattern Recognit. 84, 345–356 (2018)

    Article  Google Scholar 

  17. Gil, J., Wu, H., Wang, B.Y.: Image analysis and morphometry in the diagnosis of breast cancer. Microsc. Res. Tech. 59(2), 109–118 (2002)

    Article  Google Scholar 

  18. Golatkar, A., Anand, D., Sethi, A.: Classification of breast cancer histology using deep learning. arXiv Breast Cancer Histology Challenge 2018 (2018)

    Google Scholar 

  19. Guo, G., Dyer, C.: Learning from examples in the small sample case: face expression recognition. IEEE Trans. Syst. Man Cybern. 35(3), 477–488 (2005)

    Article  Google Scholar 

  20. Gurcan, M., Boucheron, L., Can, A., et al.: Histopathological image analysis: a review. IEEE Rev. Biomed. Eng. 2, 147–171 (2009)

    Article  Google Scholar 

  21. Han, Z., Wei, B., Zheng, Y., et al.: Breast cancer multi-classification from histopathological images with structured deep learning model. Sci. Rep. 7(4172), 1–10 (2017)

    Google Scholar 

  22. He, L., Long, L., Antani, S., Thoma, G.: Computer assisted diagnosis in histopathology. In: Zhao, Z. (ed.) Sequence and Genome Analysis: Methods and Applications, pp. 271–287. iConcept Press, Hong Kong (2010)

    Google Scholar 

  23. He, L., Long, L., Antani, S., Thoma, G.: Histology image analysis for carcinoma detection and grading. Comput. Methods Programs Biomed. 107(3), 538–556 (2012)

    Article  Google Scholar 

  24. Irshad, H., Veillard, A., Roux, L., Racoceanu, D.: Methods for nuclei detection, segmentation, and classification in digital histopathology: a review - current status and future potential. IEEE Rev. Biomed. Eng. 7, 97–114 (2014)

    Article  Google Scholar 

  25. Kiambe, K.: Breast histopathological image feature extraction with convolutional neural networks for classification. ICSES Trans. Image Process. Pattern Recognit. 4(2), 4–12 (2018)

    Google Scholar 

  26. Kowal, M., et al.: Computer-aided diagnosis of breast cancer based on fine needle biopsy microscopic images. Comput. Biol. Med. 43(10), 1563–1572 (2013)

    Article  Google Scholar 

  27. Lee, G., et al.: Deep learning and color variability in breast cancer histopathological images: a preliminary study. In: Proceedings of SPIE 10718 (2018)

    Google Scholar 

  28. Li, Q., Li, W.: Using Deep Learning for Breast Cancer Diagnosis. Technical Report, Chinese University of Hong Kong, China (2017)

    Google Scholar 

  29. Litjens, G., et al.: Deep learning as a tool for increased accuracy and efficiency of histopathology diagnosis. Sci. Rep. 6(26286), 1–11 (2016)

    Google Scholar 

  30. Liu, Y., Gadepalli, K., Norouzi, M., et al.: Detecting Cancer Metastases on Gigapixel Pathology Images. arXiv Camelyon Grand Challenge 2016 (2017)

    Google Scholar 

  31. Loukas, C., Kostopoulos, S., Tanoglidi, A., et al.: Breast cancer characterization based on image classification of tissue sections visualized under low magnification. Comput. Math. Methods Med. 2013, 1–8 (2013)

    Article  MathSciNet  Google Scholar 

  32. Mahbod, A., et al.: Breast cancer histological image classification using fine-tuned deep network fusion. In: Proceedings of ICIAR 2018, pp. 754–762 (2018)

    Google Scholar 

  33. Malon, C., Cosatto, E.: Classification of mitotic figures with convolutional neural networks and seeded blob features. J. Pathol. Inform. 4(8) (2013)

    Google Scholar 

  34. Malona, C., et al.: Mitotic figure recognition: agreement among pathologists and computerized detector. Anal. Cell. Pathol. 35(2), 97–100 (2012)

    Article  Google Scholar 

  35. Motlagh, M., Jannesari, M., Aboulkheyr, H., et al.: Breast Cancer Histopathological Image Classification: A Deep Learning Approach. bioRxiv (2018)

    Google Scholar 

  36. Mouelhi, A., Sayadi, M., Fnaiech, F.: A supervised segmentation scheme based on multilayer neural network and color active contour model for breast cancer nuclei detection. In: Proceedings of ICEESA, pp. 1–6 (2013)

    Google Scholar 

  37. Nahid, A., Kong, Y.: Histopathological breast-image classification using local and frequency domains by convolutional neural network. Information 9(19), 1–26 (2018)

    Google Scholar 

  38. Nahid, A., Mehrabi, M., Kong, Y.: Histopathological breast Cancer image classification by deep neural network techniques guided by local clustering. BioMed Res. Int. 2018, 1–20 (2018)

    Article  Google Scholar 

  39. Nahid, A., Mikaelian, A., Kong, Y.: Histopathological breast-image classification with restricted boltzmann machine along with backpropagation. Biomed. Res. 29(10), 2068–2077 (2018)

    Article  Google Scholar 

  40. Nawaz, M., Sewissy, A., Soliman, T.: Automated classification of breast cancer histology images using deep learning based convolutional neural networks. Int. J. Comput. Sci. Netw. Secur. 18(4), 152–160 (2018)

    Google Scholar 

  41. Nawaz, M., Sewissy, A., Soliman, T.: Multi-class breast cancer classification using deep learning convolutional neural network. Int. J. Adv. Comput. Sci. Appl. 9(6), 316–332 (2018)

    Google Scholar 

  42. Nazeri, K., et al.: Two-stage convolutional neural network for breast cancer histology image classification. arXiv Breast Cancer Histology Challenge 2018

    Google Scholar 

  43. Nejad, E., Affendey, L., Latip, R., Ishak, I.: Classification of histopathology images of breast into benign and malignant using a single-layer convolutional neural network. In: Proceedings of ICISPC 2017, pp. 50–53 (2017)

    Google Scholar 

  44. Nielsen, M.: Neural Networks and Deep Learning. Determination Press (2015)

    Google Scholar 

  45. Pang, B., Zhang, Y., Chen, Q., et al.: Cell nucleus segmentation in color histopathological imagery using convolutional networks. In: Proceedings of CCPR, pp. 1–5 (2010)

    Google Scholar 

  46. Petushi, S., Garcia, P., Haber, M., et al.: Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer. BMC Med. Imaging 6(14), 1–11 (2006)

    Google Scholar 

  47. Rakhlin, A., Shvets, A., Iglovikov, V., Kalinin, A.: Deep convolutional neural networks for breast cancer histology image analysis. In: Proceedings of ICIAR 2018, pp. 737–744 (2018)

    Google Scholar 

  48. Ramos-Vara, J.: Principles and methods of immunohistochemistry. In: Gautier, J. (ed.) Drug Safety Evaluation. Methods in Molecular Biology (Methods and Protocols), vol. 691, pp. 83–96. Springer, Humana Press, Germany (2011)

    Google Scholar 

  49. Ranjan, N., et al.: Hierarchical approach for breast cancer histopathology images classification. In: Proceedings of MIDL 2018, pp. 1–7 (2018)

    Google Scholar 

  50. Shallu, Mehra, R.: Breast cancer histology images classification: training from scratch or transfer learning? ICT Express 4(4), 247–254 (2018)

    Google Scholar 

  51. Siegel, R., Miller, K., Fedewa, S., et al.: Colorectal cancer statistics, 2017. CA Cancer J. Clin. 67(3), 177–193 (2017)

    Google Scholar 

  52. Singh, S., Gupta, P., Sharma, M.: Breast cancer detection and classification of histopathological images. Int. J. Eng. Sci. Tech. (IJEST) 3(5), 4228–4332 (2011)

    Google Scholar 

  53. Song, Y., Zou, J., Chang, H., Cai, W.: Adapting fisher vectors for histopathology image classification. In: Proceedings of ISBI 2017, pp. 600–603 (2017)

    Google Scholar 

  54. Spanhol, F.: Automatic breast cancer classification from histopathological images: a hybrid approach. Ph.D. thesis. Federal University of Parana, Brazil (2018)

    Google Scholar 

  55. Spanhol, F., et al.: Deep features for breast cancer histopathological image classification. In: Proceedings of SMC, pp. 1868–1873 (2017)

    Google Scholar 

  56. Spanhol, F., et al.: A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63(7), 1455–1462 (2016)

    Article  Google Scholar 

  57. Spanhol, F., et al.: Breast cancer histopathological image classification using convolutional neural networks. In: Proceedings of IJCNN (2016)

    Google Scholar 

  58. Steiner, D., MacDonald, R., Liu, Y., et al.: Impact of deep learning assistance on the histopathologic review of lymph nodes for metastatic breast cancer. Am. J. Surg. Pathol. 42(12), 1636–1646 (2018)

    Article  Google Scholar 

  59. Theodoridis, S., Koutroumbas, K.: Pattern Recognition, 4th edn. Elsevier (2009)

    Google Scholar 

  60. Vapnik, V.: Statistical Learning Theory. Wiley-Interscience, US (1998)

    MATH  Google Scholar 

  61. Veta, M.: Breast cancer histopathology image analysis. Ph.D. thesis in Utrecht University, Netherlands (2014)

    Google Scholar 

  62. Veta, M., Pluim, J., Diest, P., Viergever, M.: Breast cancer histopathology image analysis: a review. IEEE Trans. Biomed. Eng. 61(5), 1400–1411 (2014)

    Article  Google Scholar 

  63. Wang, D., Khosla, A., Gargeya, R., et al.: Deep learning for identifying metastatic breast cancer. arXiv Camelyon Grand Challenge 2016 (2016)

    Google Scholar 

  64. Wang, H., Cruz-Roa, A., Basavahally, A., et al.: Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection. In: Proceedings of SPIE 9041 (2014)

    Google Scholar 

  65. Wang, Z., Dong, N., Dai, W., et al.: Classification of breast cancer histopathological images using convolutional neural networks with hierarchical loss and global pooling. In: Proceedings of ICIAR 2018, pp. 745–753 (2018)

    Google Scholar 

  66. Wu, J., Shi, J., Li, Y., et al.: Histopathological image classification using random binary hashing based PCANet and bilinear classifier. In: Proceedings of EUSIPCO, pp. 2050–2054 (2016)

    Google Scholar 

  67. Xu, J., Xiang, L., Liu, Q., et al.: Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans. Med. Imaging 35(1), 119–130 (2016)

    Article  Google Scholar 

  68. Zhang, Y., Zhang, B., Coenen, F., Lu, W.: Breast cancer diagnosis from biopsy images with highly reliable random subspace classifier ensembles. Mach. Vis. Appl. 24(7), 1405–1420 (2013)

    Article  Google Scholar 

  69. Zhang, Y., Zhang, B., Lu, W.: Breast cancer classification from histological images with multiple features and random subspace classifier ensemble. In: Proceedings of AIP 1371, no. 1, pp. 19–28 (2011)

    Google Scholar 

  70. Zhang, Y., Zhang, B., Lu, W.: Breast cancer histological image classification with multiple features and random subspace classifier ensemble. In: Pham, T.D., Jain, L.C. (eds.) Knowledge-based Systems in Biomedicine, SCI 450, pp. 27–42. Springer, Germany (2013)

    Chapter  Google Scholar 

  71. Zhi, W., Yueng, H., Chen, Z., et al.: Using transfer learning with convolutional neural networks to diagnose breast cancer from histopathological images. In: Proceeding of ICONIP 2017, pp. 669–676 (2017)

    Google Scholar 

Download references

Acknowledgment

We thank the funds supported by the “National Natural Science Foundation of China” (No. 61806047), the “Fundamental Research Funds for the Central Universities” (No. N171903004), and the “Scientific Research Launched Fund of Liaoning Shihua University” (No. 2017XJJ-061). We also thank Dan Xue, due to her contribution is considered as the same important as the first author in this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ning Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, C. et al. (2019). A Survey for Breast Histopathology Image Analysis Using Classical and Deep Neural Networks. In: Pietka, E., Badura, P., Kawa, J., Wieclawek, W. (eds) Information Technology in Biomedicine. ITIB 2019. Advances in Intelligent Systems and Computing, vol 1011. Springer, Cham. https://doi.org/10.1007/978-3-030-23762-2_20

Download citation

Publish with us

Policies and ethics