A Transfer Learning Method with Deep Convolutional Neural Network for Diffuse Lung Disease Classification

  • Hayaru ShounoEmail author
  • Satoshi Suzuki
  • Shoji Kido
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9489)


We introduce a deep convolutional neural network (DCNN) as feature extraction method in a computer aided diagnosis (CAD) system in order to support diagnosis of diffuse lung diseases (DLD) on high-resolution computed tomography (HRCT) images. DCNN is a kind of multi layer neural network which can automatically extract features expression from the input data, however, it requires large amount of training data. In the field of medical image analysis, the number of acquired data is sometimes insufficient to train the learning system. Overcoming the problem, we apply a kind of transfer learning method into the training of the DCNN. At first, we apply massive natural images, which we can easily collect, for the pre-training. After that, small number of the DLD HRCT image as the labeled data is applied for fine-tuning. We compare DCNNs with training of (i) DLD HRCT images only, (ii) natural images only, and (iii) DLD HRCT images + natural images, and show the result of the case (iii) would be better DCNN feature rather than those of others.


Idiopathic Pulmonary Fibrosis Natural Image Transfer Learning Idiopathic Interstitial Pneumonia Diffuse Lung Disease 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work is partly supported by MEXT/JSPS KAKENHI Grant number 25330285, and 26120515.


  1. 1.
    Classification of the Idiopathic Interstitial Pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors, June 2001 and by the ERS Executive Committee, June 2001. Am. J. Respir. Crit. Care Med. 165(2), 277–304 (2002)Google Scholar
  2. 2.
    Fukushima, K.: Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36(4), 193–202 (1980)CrossRefzbMATHGoogle Scholar
  3. 3.
    Gangeh, M.J., Sørensen, L., Shaker, S.B., Kamel, M.S., de Bruijne, M., Loog, M.: A texton-based approach for the classification of Lung Parenchyma in CT images. In: Jiang, T., Navab, N., Pluim, J.P.W., Viergever, M.A. (eds.) MICCAI 2010, Part III. LNCS, vol. 6363, pp. 595–602. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  4. 4.
    Hinton, G., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Kauczor, H.U., Heitmann, K., Heussel, C.P., Marwede, D., Uthmann, T., Thelen, M.: Automatic detection and quantification of ground-glass opacities on high-resolution CT using multiple neural networks: comparison with a density mask. AJR Am. J. Roentgenol. 175(5), 1329–1334 (2000)CrossRefGoogle Scholar
  6. 6.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C., Bottou, L., Weinberger, K. (eds.) Advances in Neural Information Processing Systems, vol. 25, pp. 1097–1105. Curran Associates, Inc., Red Hook (2012)Google Scholar
  7. 7.
    Le, Q.: Building high-level features using large scale unsupervised learning. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8595–8598, May 2013Google Scholar
  8. 8.
    Shouno, H.: Recent studies around the neocognitron. In: Ishikawa, M., Doya, K., Miyamoto, H., Yamakawa, T. (eds.) ICONIP 2007, Part I. LNCS, vol. 4984, pp. 1061–1070. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  9. 9.
    Webb, W., Müller, N.L., Naidich, D.: High Resolution CT of the Lung, 4th edn. Lippincott Williams & Wilkins, Baltimore (2008)Google Scholar
  10. 10.
    Xiaojin, Z.: Semi-Supervised learning literature survey. Technical report, Computer Sciences, University of Wisconsin-Madison (2005)Google Scholar
  11. 11.
    Xu, R., Hirano, Y., Tachibana, R., Kido, S.: Classification of diffuse lung disease patterns on high-resolution computed tomography by a bag of words approach. In: Fichtinger, G., Martel, A., Peters, T. (eds.) MICCAI 2011, Part III. LNCS, vol. 6893, pp. 183–190. Springer, Heidelberg (2011) CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.University of Electro-CommunicationsChofuJapan
  2. 2.Yamaguchi UniversityUbeJapan

Personalised recommendations