Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images

Abstract

Background

Traditional diagnosis methods for lymph node metastases are labor-intensive and time-consuming. As a result, diagnostic systems based on deep learning (DL) algorithms have become a hot topic. However, current research lacks testing with sufficient data to verify performance. The aim of this study was to develop and test a deep learning system capable of identifying lymph node metastases.

Methods

921 whole-slide images of lymph nodes were divided into two cohorts: training and testing. For lymph node quantification, we combined Faster RCNN and DeepLab as a cascade DL algorithm to detect regions of interest. For metastatic cancer identification, we fused Xception and DenseNet-121 models and extracted features. Prospective testing to verify the performance of the diagnostic system was performed using 327 unlabeled images. We further validated the proposed system using Positive Predictive Value (PPV) and Negative Predictive Value (NPV) criteria.

Results

We developed a DL-based system capable of automated quantification and identification of metastatic lymph nodes. The accuracy of lymph node quantification was shown to be 97.13%. The PPV of the combined Xception and DenseNet-121 model was 93.53%, and the NPV was 97.99%. Our experimental results show that the differentiation level of metastatic cancer affects the recognition performance.

Conclusions

The diagnostic system we established reached a high level of efficiency and accuracy of lymph node diagnosis. This system could potentially be implemented into clinical workflow to assist pathologists in making a preliminary screening for lymph node metastases in gastric cancer patients.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3

References

  1. 1.

    Golden JA. Deep learning algorithms for detection of lymph node metastases from breast cancer: helping artificial intelligence be seen. JAMA. 2017;318(22):2184–6. https://doi.org/10.1001/JAMA.2017.14580.

    Article  PubMed  Google Scholar 

  2. 2.

    Esteva A, Kuprel B, Novoa RA, Ko JM, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–8. https://doi.org/10.1038/NATURE21056.

    CAS  Article  Google Scholar 

  3. 3.

    Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. ImageNet Large scale visual recognition challenge. Int J Comput Vision. 2015;115(3):211–52. https://doi.org/10.1007/S11263-015-0816-Y.

    Article  Google Scholar 

  4. 4.

    Su F, Sun Y, Hu Y, Yuan P, Wang X, Wang Q, et al. Development and validation of a deep learning system for ascites cytopathology interpretation. Gastric Cancer. 2020. https://doi.org/10.1007/S10120-020-01093-1.

    Article  PubMed  PubMed Central  Google Scholar 

  5. 5.

    Steiner DF, MacDonald R, Liu Y, Truszkowski P, Hipp JD, Gammage C, et al. Impact of deep learning assistance on the histopathologic review of lymph nodes for metastatic breast cancer. Am J Surg Pathol. 2018;42(12):1636–46. https://doi.org/10.1097/PAS.0000000000001151.

    Article  PubMed  PubMed Central  Google Scholar 

  6. 6.

    Litjens G, Sánchez CI, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I, et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep. 2016;6(1):26286. https://doi.org/10.1038/SREP26286.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Janowczyk A, Madabhushi A. Deep learning for digital pathology image analysis: a comprehensive tutorial with selected use cases. J Pathol Inform. 2016;7(1):29. https://doi.org/10.4103/2153-3539.186902.

    Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Song Z, Zou S, Zhou W, Huang Y, Shao L, Yuan J, et al. Clinically applicable histopathological diagnosis system for gastric cancer detection using deep learning. Nature Commun. 2020. https://doi.org/10.1038/S41467-020-18147-8.

    Article  Google Scholar 

  9. 9.

    Zhao B, Huang R, Lu H, Mei D, Bao S, Xu H, et al. Risk of lymph node metastasis and prognostic outcome in early gastric cancer patients with mixed histologic type. Current Problems Cancer. 2020. https://doi.org/10.1016/J.CURRPROBLCANCER.2020.100579.

    Article  Google Scholar 

  10. 10.

    Sun F, Liu S, Song P, Zhang C, Liu Z, Guan W, et al. Impact of retrieved lymph node count on short-term complications in patients with gastric cancer. World J Surg Oncol. 2020;18(1):1–7. https://doi.org/10.1186/S12957-020-02000-9.

    Article  Google Scholar 

  11. 11.

    Shubhasini AR, Praveen BN, Usha Hegde UK, Shubha G, Keerthi G, et al. Inter- and intra-observer variability in diagnosis of oral dysplasia. Asian Pacific J Cancer Prevention. 2017;18(12):3251–4. https://doi.org/10.22034/APJCP.2017.18.12.3251.

    Article  Google Scholar 

  12. 12.

    Bhargava R, Madabhushi A. Emerging themes in image informatics and molecular analysis for digital pathology. Ann Rev Biomed Eng. 2016;18(1):387–412. https://doi.org/10.1146/ANNUREV-BIOENG-112415-114722.

    CAS  Article  Google Scholar 

  13. 13.

    Veta M, Pluim JPW, Diest PJ, Viergever MA. Breast cancer histopathology image analysis: a review. IEEE Trans Biomed Eng. 2014;61(5):1400–11. https://doi.org/10.1109/TBME.2014.2303852.

    Article  PubMed  Google Scholar 

  14. 14.

    Ren S, He K, Girshick R, Sun J. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Machine Intelligence. 2017;39(6):1137–49. https://doi.org/10.1109/TPAMI.2016.2577031.

    Article  Google Scholar 

  15. 15.

    Zhao H, Shi J, Qi X, Wang X, Jia J. Pyramid scene parsing network. Computer Vision and Pattern Recognition; 7/21/20172017. p. 6230–9

  16. 16.

    Targ S, Almeida D, Lyman K. Resnet in Resnet: generalizing residual architectures. 2016.

  17. 17.

    Ding L, Liu G-W, Zhao B-C, Zhou Y-P, Li S, Zhang Z-D, et al. Artificial intelligence system of faster region-based convolutional neural network surpassing senior radiologists in evaluation of metastatic lymph nodes of rectal cancer. Chin Med J. 2019;132(4):379–87. https://doi.org/10.1097/CM9.0000000000000095.

    Article  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Pan Y, Sun Z, Wang W, Yang Z, Jia J, Feng X, et al. Automatic detection of squamous cell carcinoma metastasis in esophageal lymph nodes using semantic segmentation. Clin Trans Med. 2020. https://doi.org/10.1002/CTM2.129.

    Article  Google Scholar 

  19. 19.

    Tang W, Zou D, Yang S, Shi J, Song GJNC. Applications. A two-stage approach for automatic liver segmentation with Faster R-CNN and DeepLab. Neural Comput Appl. 2020. https://doi.org/10.1007/s00521-019-04700-0.

    Article  Google Scholar 

  20. 20.

    Ardakani AA, Kanafi AR, Acharya UR, Khadem N, Mohammadi A. Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: results of 10 convolutional neural networks. Comput Biol Med. 2020. https://doi.org/10.1016/J.COMPBIOMED.2020.103795.

    Article  PubMed  PubMed Central  Google Scholar 

  21. 21.

    Minaee S, Kafieh R, Sonka M, Yazdani S, Soufi GJ. Deep-COVID: predicting COVID-19 from chest X-ray images using deep transfer learning. Med Image Anal. 2020. https://doi.org/10.1016/J.MEDIA.2020.101794.

    Article  PubMed  PubMed Central  Google Scholar 

  22. 22.

    Deng Z, Zhu L, Hu X, Fu CW, Heng PA, editors. Deep multi-model fusion for single-image Dehazing. International Conference on Computer Vision (ICCV), 2019; 2019.

  23. 23.

    Wang T, Zhang H, Toh WQ, Zhu H, Jing W, editors. Efficient Robotic Task Generalization Using Deep Model Fusion Reinforcement Learning. 2019 IEEE International Conference on Robotics and Biomimetics (ROBIO); 2019.

  24. 24.

    Sampson DK, Dwyer LM, Tseng EH, Lorell BH, Kavi KJ, FDA proposes regulatory framework for artificial intelligence/machine learning software as a medical device. J tl 2019;31(7):12–6.

  25. 25.

    Naylor CD. On the prospects for a (deep) learning health care system [published online August 30, 2018]. JAMA. 2018. https://doi.org/10.1001/jama.2018.11103.(1).

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Key Research and Development Program of China (2018YFC0910700), the Major Program of National Natural Science Foundation of China (91959205), and Capital’s Funds for Health Improvement and Research, CFH, No. 2018-2Z-1026.

Author information

Affiliations

Authors

Contributions

Conception and design: YS and JJ; development and methodology: YH, FS, and JL; acquisition of data (acquired and managed patients, provided facilities, etc.): YH, KD, XW, and YJ; analysis and interpretation of data (e.g., statistical analysis, computational analysis): YH, FS, KD, XW, XZ, JL, JJ, and YS; writing, review, and/or revision of the manuscript: YH, FS, KD, XW, XZ, JL, JJ, and YS; administrative, technical, or material support (i.e., reporting or organizing data, constructing databases): YS, JJ, and JL.

Corresponding author

Correspondence to Yu Sun.

Ethics declarations

Conflict of interest

The authors declare no potential conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Hu, Y., Su, F., Dong, K. et al. Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images. Gastric Cancer (2021). https://doi.org/10.1007/s10120-021-01158-9

Download citation

Keywords

  • Gastric cancer
  • Deep learning
  • Lymph node quantification
  • Lymph node metastasis