Annals of Surgical Oncology

, Volume 25, Issue 10, pp 3037–3043 | Cite as

Predicting Post Neoadjuvant Axillary Response Using a Novel Convolutional Neural Network Algorithm

  • Richard HaEmail author
  • Peter Chang
  • Jenika Karcich
  • Simukayi Mutasa
  • Eduardo Pascual Van Sant
  • Eileen Connolly
  • Christine Chin
  • Bret Taback
  • Michael Z. Liu
  • Sachin Jambawalikar
Breast Oncology



In the postneoadjuvant chemotherapy (NAC) setting, conventional radiographic complete response (rCR) is a poor predictor of pathologic complete response (pCR) of the axilla. We developed a convolutional neural network (CNN) algorithm to better predict post-NAC axillary response using a breast MRI dataset.


An institutional review board-approved retrospective study from January 2009 to June 2016 identified 127 breast cancer patients who: (1) underwent breast MRI before the initiation of NAC; (2) successfully completed Adriamycin/Taxane-based NAC; and (3) underwent surgery, including sentinel lymph node evaluation/axillary lymph node dissection with final surgical pathology data. Patients were classified into pathologic complete response (pCR) of the axilla group and non-pCR group based on surgical pathology. Breast MRI performed before NAC was used. Tumor was identified on first T1 postcontrast images underwent 3D segmentation. A total of 2811 volumetric slices of 127 tumors were evaluated. CNN consisted of 10 convolutional layers, 4 max-pooling layers. Dropout, augmentation and L2 regularization were implemented to prevent overfitting of data.


On final surgical pathology, 38.6% (49/127) of the patients achieved pCR of the axilla (group 1), and 61.4% (78/127) of the patients did not with residual metastasis detected (group 2). For predicting axillary pCR, our CNN algorithm achieved an overall accuracy of 83% (95% confidence interval [CI] ± 5) with sensitivity of 93% (95% CI ± 6) and specificity of 77% (95% CI ± 4). Area under the ROC curve (0.93, 95% CI ± 0.04).


It is feasible to use CNN architecture to predict post NAC axillary pCR. Larger data set will likely improve our prediction model.


  1. 1.
    Teshome M, Hunt KK. Neoadjuvant therapy in the treatment of breast cancer. Surg Oncol Clin N Am. 2014;23(3):505–23.CrossRefPubMedPubMedCentralGoogle Scholar
  2. 2.
    Hunt KK, Yi M, Mittendorf EA, et al. Sentinel lymph node surgery after neoadjuvant chemotherapy is accurate and reduces the need for axillary dissection in breast cancer patients. Ann Surg. 2009;250:558–66.PubMedGoogle Scholar
  3. 3.
    Rastogi P, Anderson SJ, Bear HD, et al. Preoperative chemotherapy: updates of National Surgical Adjuvant Breast and Bowel Project Protocols B-18 and B-27. J Clin Oncol. 2008;26:778–85.CrossRefGoogle Scholar
  4. 4.
    Akay CL, Meric-Bernstam F, Hunt KK, et al. Evaluation of the MD Anderson Prognostic Index for local-regional recurrence after breast conserving therapy in patients receiving neoadjuvant chemotherapy. Ann Surg Oncol. 2012;19:901–7.CrossRefGoogle Scholar
  5. 5.
    Mamounas EP, Anderson SJ, Dignam JJ, et al. Predictors of locoregional recurrence after neoadjuvant chemotherapy: results from combined analysis of National Surgical Adjuvant Breast and Bowel Project B-18 and B-27. J Clin Oncol. 2012;30(32):3960–6.CrossRefPubMedPubMedCentralGoogle Scholar
  6. 6.
    Cortazar P, Zhang L, Untch M, et al. Pathological complete response and long-term clinical benefit in breast cancer: The CTNeoBC pooled analysis. Lancet. 2014;384:164–72.CrossRefGoogle Scholar
  7. 7.
    von Minckwitz G, Untch M, Blohmer J-U, et al. Definition and impact of pathologic complete response on prognosis after neoadjuvant chemotherapy in various intrinsic breast cancer subtypes. J Clin Oncol. 2012;30:1796–804.CrossRefGoogle Scholar
  8. 8.
    Wang-Lopez Q, Chalabi N, Abrial C, et al. Can pathologic complete response (pCR) be used as a surrogate marker of survival after neoadjuvant therapy for breast cancer? Crit Rev Oncol Hematol. 2015;95:88–104.CrossRefGoogle Scholar
  9. 9.
    Hennessy BT, Hortobagyi GN, Rouzier R, et al. Outcome after pathologic complete eradication of cytologically proven breast cancer axillary node metastases following primary chemotherapy. J Clin Oncol. 2005;23:9304–11.CrossRefGoogle Scholar
  10. 10.
    Lobbes M, Prevos R, Smidt M, et al. The role of magnetic resonance imaging in assessing residual disease and pathologic complete response in breast cancer patients receiving neoadjuvant chemotherapy: a systematic review. Insights Imaging 2013;2:163–75.CrossRefGoogle Scholar
  11. 11.
    Weber JJ, Jochelson MS, Eaton A, et al. MRI and prediction of pathologic complete response in the breast and axilla after neoadjuvant chemotherapy for breast cancer. J Am Coll Surg. 2017;225(6):740–6.CrossRefPubMedPubMedCentralGoogle Scholar
  12. 12.
    LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521:436–44.CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    Hammond ME, Hayes DF, Dowsett M, et al. American Society of Clinical Oncology/College Of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer. J Clin Oncol. 28:2784–95, 2010CrossRefPubMedPubMedCentralGoogle Scholar
  14. 14.
    Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. In: ICLR, 2015.Google Scholar
  15. 15.
    Srivastava N, Hinton G, Krizhevsky A, et al. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15:1929–58.Google Scholar
  16. 16.
    Kingma DP, Ba JA. A method for Stochastic Optimization. arXiv:1412.6980 [cs.LG], December 2014.
  17. 17.
    Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning. 2015.Google Scholar
  18. 18.
    Boughey JC, Suman VJ, Mittendorf EA, et al. Sentinel lymph node surgery after neoadjuvant chemotherapy in patients with node-positive breast cancer: the ACOSOG Z1071 (Alliance) Clinical Trial. JAMA. 2013;310:1455–61.CrossRefPubMedPubMedCentralGoogle Scholar
  19. 19.
    Mattingly AE, Mooney B, Lin HY, et al. Magnetic resonance imaging for axillary breast cancer metastasis in the neoadjuvant setting: a prospective study. Clin Breast Cancer. 2017;17(3):180–7.CrossRefPubMedPubMedCentralGoogle Scholar
  20. 20.
    Harlow SP, Krag DN, Julian TB, et al. Prerandomization Surgical Training for the National Surgical Adjuvant Breast and Bowel Project (NSABP) B-32 trial: a randomized phase III clinical trial to compare sentinel node resection to conventional axillary dissection in clinically node-negative breast cancer. Ann Surg. 2005;241(1):48–54.PubMedPubMedCentralGoogle Scholar
  21. 21.
    Tan VK, Goh BK, Fook-Chong S, et al. The feasibility and accuracy of sentinel lymph node biopsy in clinically node-negative patients after neoadjuvant chemotherapy for breast cancer—a systematic review and meta-analysis. J Surg Oncol. 2011;104:97–103.CrossRefPubMedPubMedCentralGoogle Scholar

Copyright information

© Society of Surgical Oncology 2018

Authors and Affiliations

  • Richard Ha
    • 1
    Email author
  • Peter Chang
    • 2
  • Jenika Karcich
    • 1
  • Simukayi Mutasa
    • 1
  • Eduardo Pascual Van Sant
    • 1
  • Eileen Connolly
    • 3
  • Christine Chin
    • 3
  • Bret Taback
    • 4
  • Michael Z. Liu
    • 5
  • Sachin Jambawalikar
    • 5
  1. 1.Department of RadiologyColumbia University Medical CenterNew YorkUSA
  2. 2.Department of RadiologyUC San Francisco Medical CenterSan FranciscoUSA
  3. 3.Division of Radiation OncologyColumbia University Medical CenterNew YorkUSA
  4. 4.Department of SurgeryColumbia University Medical CenterNew YorkUSA
  5. 5.Department of Medical PhysicsColumbia University Medical CenterNew YorkUSA

Personalised recommendations