Treatment Response Prediction of Hepatocellular Carcinoma Patients from Abdominal CT Images with Deep Convolutional Neural Networks

  • Hansang Lee
  • Helen HongEmail author
  • Jinsil Seong
  • Jin Sung Kim
  • Junmo Kim
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11843)


Prediction of treatment responses of hepatocellular carcinoma (HCC) patients, such as local control (LC) and overall survival (OS), from CT images, has been of importance for treatment planning of radiotherapy for HCC. In this paper, we propose a deep learning method to predict LC and OS responses of HCC from abdominal CT images. To improve the prediction efficiency, we constructed a prediction model that learns both the intratumoral information and contextual information between the tumor and the liver. In our model, two convolutional neural networks (CNNs) are trained on each of the tumor image patch and the context image patch, and the features extracted from these two CNNs are combined to train a random forest classifier for predicting the LC and OS responses. In the experiments, we observed that (1) the CNN outperformed the conventional hand-crafted radiomic feature approaches for both the LC and OS prediction tasks, and (2) the contextual information is useful not only individually, but also in combination with the conventional intratumoral information in the proposed model.


Computed tomography Hepatocellular carcinoma Prediction model Treatment response Deep learning 



This work was supported by Radiation Technology R&D program through the NRF of Korea (NRF-2017M2A2A7A02070427).


  1. 1.
    Altekruse, S.F., et al.: Hepatocellular carcinoma incidence, mortality, and survival trends in the United States from 1975 to 2005. J. Clin. Oncol. 27, 1485–1491 (2009)CrossRefGoogle Scholar
  2. 2.
    El-Sera, H.B., Mason, A.C.: Rising incidence of hepatocellular carcinoma in the United States. N. Engl. J. Med. 340, 745–750 (1999)CrossRefGoogle Scholar
  3. 3.
    Tamandl, D., et al.: Early response evaluation using CT-perfusion one day after transarterial chemoembolization for HCC predicts treatment response and long-term disease control. Eur. J. Rad. 90, 73–80 (2017)CrossRefGoogle Scholar
  4. 4.
    Cozzi, L., et al.: Radiomics based analysis to predict local control and survival in hepatocellular carcinoma patients treated with volumetric mudulated arc therapy. BMC Cancer 17, 829 (2017)CrossRefGoogle Scholar
  5. 5.
    Zhou, Y., et al.: CT-based radiomics signature: a potential biomarker for preoperative prediction of early recurrence in hepatocellular carcinoma. Abd. Rad. 42, 1695–1704 (2017)CrossRefGoogle Scholar
  6. 6.
    Shan, Q., et al.: CT-based peritumoral radiomics signatures to predict early recurrence in hepatocellular carcinoma after curative tumor resection or ablation. Cancer Imaging 19, 11 (2019)CrossRefGoogle Scholar
  7. 7.
    Krizhevsky, A., et al.: ImageNet classification with deep convolutional neural networks. In: Proceedings of NIPS, pp. 1097–1105 (2012)Google Scholar
  8. 8.
    Lee, H., et al.: Differentiation of fat-poor angiomyolipoma from clear cell renal cell carcinoma in contrast-enhanced MDCT images using quantitative feature classification. Med. Phys. 44, 3604–3614 (2017)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Hansang Lee
    • 1
  • Helen Hong
    • 2
    Email author
  • Jinsil Seong
    • 3
  • Jin Sung Kim
    • 3
  • Junmo Kim
    • 1
  1. 1.School of Electrical EngineeringKorea Advanced Institute of Science and TechnologyDaejeonRepublic of Korea
  2. 2.Department of Software ConvergenceSeoul Women’s UniversitySeoulRepublic of Korea
  3. 3.Department of Radiation Oncology, Yonsei Cancer CenterYonsei University College of MedicineSeoulRepublic of Korea

Personalised recommendations