Modeling the Intra-class Variability for Liver Lesion Detection Using a Multi-class Patch-Based CNN

  • Maayan Frid-AdarEmail author
  • Idit Diamant
  • Eyal Klang
  • Michal Amitai
  • Jacob Goldberger
  • Hayit Greenspan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10530)


Automatic detection of liver lesions in CT images poses a great challenge for researchers. In this work we present a deep learning approach that models explicitly the variability within the non-lesion class, based on prior knowledge of the data, to support an automated lesion detection system. A multi-class convolutional neural network (CNN) is proposed to categorize input image patches into sub-categories of boundary and interior patches, the decisions of which are fused to reach a binary lesion vs non-lesion decision. For validation of our system, we use CT images of 132 livers and 498 lesions. Our approach shows highly improved detection results that outperform the state-of-the-art fully convolutional network. Automated computerized tools, as shown in this work, have the potential in the future to support the radiologists towards improved detection.


Liver lesion Detection Convolutional neural network Patch-based system Computer-aided detection 


  1. 1.
    Ben-Cohen, A., Diamant, I., Klang, E., Amitai, M., Greenspan, H.: Fully convolutional network for liver segmentation and lesions detection. In: Carneiro, G., et al. (eds.) LABELS/DLMIA -2016. LNCS, vol. 10008, pp. 77–85. Springer, Cham (2016). doi: 10.1007/978-3-319-46976-8_9 Google Scholar
  2. 2.
    Christ, P.F., et al.: Automatic liver and lesion segmentation in CT using cascaded fully convolutional neural networks and 3D conditional random fields. In: Ourselin, S., Joskowicz, L., Sabuncu, M.R., Unal, G., Wells, W. (eds.) MICCAI 2016. LNCS, vol. 9901, pp. 415–423. Springer, Cham (2016). doi: 10.1007/978-3-319-46723-8_48 CrossRefGoogle Scholar
  3. 3.
    Deng, X., Du, G.: Editorial: 3D segmentation in the clinic: a grand challenge ii-liver tumor segmentation. In: MICCAI Workshop (2008)Google Scholar
  4. 4.
    Greenspan, H., van Ginneken, B., Summers, R.: Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans. Med. Imaging 35, 1153–1159 (2016)CrossRefGoogle Scholar
  5. 5.
    Setio, A.A.A., et al.: Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans. Med. Imaging 35(5), 1160–1169 (2016)CrossRefGoogle Scholar
  6. 6.
    Shimizu, A., et al.: Ensemble segmentation using AdaBoost with application to liver lesion extraction from a ct volume. In: Proceedings of Medical Imaging Computing Computer Assisted Intervention Workshop on 3D Segmentation in the Clinic: A Grand Challenge II (2008)Google Scholar
  7. 7.
    Shin, H.C., et al.: Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans. Med. Imaging 35(5), 1285–1298 (2016)CrossRefGoogle Scholar
  8. 8.
    Vedaldi, A., Lenc, K.: Matconvnet: convolutional neural networks for matlab. In: Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, pp. 689–692 (2015)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Maayan Frid-Adar
    • 1
    Email author
  • Idit Diamant
    • 1
  • Eyal Klang
    • 2
  • Michal Amitai
    • 2
  • Jacob Goldberger
    • 3
  • Hayit Greenspan
    • 1
  1. 1.Department of Biomedical Engineering, Faculty of EngineeringTel Aviv UniversityTel AvivIsrael
  2. 2.Diagnostic Imaging DepartmentSheba Medical CenterTel HashomerIsrael
  3. 3.Faculty of EngineeringBar-Ilan UniversityRamat GanIsrael

Personalised recommendations