Advertisement

Painting Classification Using a Pre-trained Convolutional Neural Network

  • Sugata BanerjiEmail author
  • Atreyee Sinha
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10481)

Abstract

The problem of classifying images into different predefined categories is an important high-level vision problem. In recent years, convolutional neural networks (CNNs) have been the most popular tool for image classification tasks. CNNs are multi-layered neural networks that can handle complex classification tasks if trained properly. However, training a CNN requires a huge number of labeled images that are not always available for all problem domains. A CNN pre-trained on a different image dataset may not be effective for classification across domains. In this paper, we explore the use of pre-trained CNN not as a classification tool but as a feature extraction tool for painting classification. We run an extensive array of experiments to identify the layers that work best with the problems of artist and style classification, and also discuss several novel representation and classification techniques using these features.

Keywords

CNN Painting classification Feature extraction Image classification SVM Deep learning 

References

  1. 1.
    Arandjelović, R., Zisserman, A.: Three things everyone should know to improve object retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)Google Scholar
  2. 2.
    Banerji, S., Sinha, A., Liu, C.: New image descriptors based on color, texture, shape, and wavelets for object and scene image classification. Neurocomputing 117, 173–185 (2013). http://www.sciencedirect.com/science/article/pii/S0925231213001987 CrossRefGoogle Scholar
  3. 3.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: CVPR 2009 (2009)Google Scholar
  4. 4.
    Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., Darrell, T.: Decaf: a deep convolutional activation feature for generic visual recognition. CoRR abs/1310.1531 (2013). http://arxiv.org/abs/1310.1531
  5. 5.
    Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, Cambridge (1990)zbMATHGoogle Scholar
  6. 6.
    Khan, F.S., Beigpour, S., de Weijer, J.V., Felsberg, M.: Painting-91: a large scale database for computational painting categorization. Mach. Vis. Appl. (MVAP) 25(6), 1385–1397 (2014). http://cat.uab.es/joost/painting91
  7. 7.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS, pp. 1106–1114 (2012)Google Scholar
  8. 8.
    Liu, C., Wechsler, H.: Robust coding schemes for indexing and retrieval from large face databases. IEEE Trans. Image Process. 9(1), 132–137 (2000)CrossRefGoogle Scholar
  9. 9.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: CVPR, November 2015, (to appear)Google Scholar
  10. 10.
    Mousavian, A., Kosecka, J.: Deep convolutional features for image based retrieval and scene categorization. CoRR abs/1509.06033 (2015). http://arxiv.org/abs/1509.06033
  11. 11.
    Puthenputhussery, A., Liu, Q., Liu, C.: Color multi-fusion fisher vector feature for fine art painting categorization and influence analysis. In: 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1–9, March 2016Google Scholar
  12. 12.
    Razavian, A.S., Azizpour, H., Sullivan, J., Carlsson, S.: CNN features off-the-shelf: an astounding baseline for recognition. CoRR abs/1403.6382 (2014). http://arxiv.org/abs/1403.6382
  13. 13.
    Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: OverFeat: integrated recognition, localization and detection using convolutional networks. CoRR abs/1312.6229 (2013). http://arxiv.org/abs/1312.6229
  14. 14.
    Sinha, A., Banerji, S., Liu, C.: Novel color Gabor-LBP-PHOG (GLP) descriptors for object and scene image classification. In: ICVGIP, p. 58 (2012)Google Scholar
  15. 15.
    Vapnik, Y.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995). doi: 10.1007/978-1-4757-3264-1 CrossRefzbMATHGoogle Scholar
  16. 16.
    Vedaldi, A., Fulkerson, B.: VLFeat: an open and portable library of computer vision algorithms (2008)Google Scholar
  17. 17.
    Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8689, pp. 818–833. Springer, Cham (2014). doi: 10.1007/978-3-319-10590-1_53 Google Scholar
  18. 18.
    Zhou, B., Khosla, A., Lapedriza, À., Oliva, A., Torralba, A.: Object detectors emerge in deep scene CNNs. CoRR abs/1412.6856 (2014). http://arxiv.org/abs/1412.6856

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Lake Forest CollegeLake ForestUSA
  2. 2.Edgewood CollegeMadisonUSA

Personalised recommendations