Multimedia Tools and Applications

, Volume 75, Issue 7, pp 3565–3591 | Cite as

Toward automated discovery of artistic influence

  • Babak Saleh
  • Kanako Abe
  • Ravneet Singh Arora
  • Ahmed Elgammal


Considering the huge amount of art pieces that exist, there is valuable information to be discovered. Examining a painting, an expert can determine its style, genre, and the time period that the painting belongs. One important task for art historians is to find influences and connections between artists. Is influence a task that a computer can measure? The contribution of this paper is in exploring the problem of computer-automated suggestion of influences between artists, a problem that was not addressed before in a general setting. We first present a comparative study of different classification methodologies for the task of fine-art style classification. A two-level comparative study is performed for this classification problem. The first level reviews the performance of discriminative vs. generative models, while the second level touches the features aspect of the paintings and compares semantic-level features vs. low-level and intermediate-level features present in the painting. Then, we investigate the question “Who influenced this artist?” by looking at his masterpieces and comparing them to others. We pose this interesting question as a knowledge discovery problem. For this purpose, we investigated several painting-similarity and artist-similarity measures. As a result, we provide a visualization of artists (Map of Artists) based on the similarity between their works


Digital humanity Automated artistic-influence discovery Painting style classification Knowledge discovery Unsupervised learning Image similarity Content-based image retrieval 


  1. 1.
    Abdel-Hakim AE, Farag AA (2006) Csift: A sift descriptor with color invariant characteristics. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPRGoogle Scholar
  2. 2.
    Arora RS, Elgammal AM (2012) Towards automated classification of fine-art painting style: A comparative study. In: ICPRGoogle Scholar
  3. 3.
    Belkin M, Niyogi P (2002) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15:1373–1396CrossRefMATHGoogle Scholar
  4. 4.
    Blei D, Ng A, Jordan M (2003) Latent dirichlet allocation. In: Journal of Machine Learning ResearchGoogle Scholar
  5. 5.
    Borg I, Groenen PJF (2005) Modern multidimensional scaling: Theory and applications. SpringerGoogle Scholar
  6. 6.
    Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2:121–167CrossRefGoogle Scholar
  7. 7.
    Cabral RS, Costeira JP, De la Torre F, Bernardino A, Carneiro G (2011) Time and order estimation of paintings based on visual features and expert priors. In: SPIE Electronic Imaging, Computer Vision and Image Analysis of Art IIGoogle Scholar
  8. 8.
    Carneiro G (2011) Graph-based methods for the automatic annotation and retrieval of art prints. In: ICMRGoogle Scholar
  9. 9.
    Carneiro G, da Silva NP, Del Bue A, Costeira JP (2012) Artistic image classification: An analysis on the printart database. In: ECCVGoogle Scholar
  10. 10.
    Chang C-C, Lin C-J (2011) LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2:27:1–27:27CrossRefGoogle Scholar
  11. 11.
    Csurka G, Dance C, Fan LX, Willamowski J, Bray C (2004) Visual categorization with bags of keypoints. In: Proceedings of ECCV International Workshop on Statistical Learning in Computer VisionGoogle Scholar
  12. 12.
    Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. International Conference on Computer Vision & Pattern Recognition 2:886–893Google Scholar
  13. 13.
    Dubuisson M-P, Jain AK (1994) A modified hausdorff distance for object matching. In: Pattern RecognitionGoogle Scholar
  14. 14.
    Vanrell M, Shahbaz Khan F, van de Weijer J (2010) Who painted this painting? In: Proceedings of The CREATE 2010 Conference, pp 329–333Google Scholar
  15. 15.
    Fei-fei L (2005) A bayesian hierarchical model for learning natural scene categories. In: CVPRGoogle Scholar
  16. 16.
    Fichner-Rathus L (2008) Foundations of Art and Design. Clark BaxterGoogle Scholar
  17. 17.
    Graham D, Friedenberg J, Rockmore D (2010) Mapping the similarity space of paintings: Image statistics and visual perception. Visual cognitionGoogle Scholar
  18. 18.
  19. 19.
    Gevers Koen T, van de Sande EA, Snoek CGM (2010) Evaluating color descriptors for object and scene recognition. In: IEEE Transactions on Pattern Analysis and Machine IntelligenceGoogle Scholar
  20. 20.
    Li J, Yao L, Hendriks E, Wang JZ (2012) Rhythmic brushstrokes distinguish van gogh from his contemporaries: Findings via automated brushstroke extraction. In: IEEE Transactions on Pattern Analysis and Machine IntelligenceGoogle Scholar
  21. 21.
    Lombardi TE (2005) The classification of style in fine-art painting. ETD collection for Pace University. Paper AAI3189084Google Scholar
  22. 22.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. International journal on Computer VisionGoogle Scholar
  23. 23.
    Ng AY, Jordan MI (2001) On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayesGoogle Scholar
  24. 24.
    Oliva A, Torralba A (2001) Modeling the shape of the scene: A holistic representation of the spatial envelope. Int J Comput Vis 42:145–175CrossRefMATHGoogle Scholar
  25. 25.
    Polatkan G, Jafarpour S, Brasoveanu A, Hughes S, Daubechies I (2009) Detection of forgery in paintings using supervised learning. In: Image Processing (ICIP), 2009 16th IEEE International Conference on, pp 2921–2924Google Scholar
  26. 26.
    Sablatnig R, Kammerer P, Zolda E (1998) Hierarchical classification of paintings using face- and brush stroke models. In: ICPRGoogle Scholar
  27. 27.
    Sablatnig R, Kammerer P, Zolda E (1998) Structural analysis of paintings based on brush strokes. In: Proceedings of SPIE scientific detection of fakery in art. SPIEGoogle Scholar
  28. 28.
    Shi F, Huang X, Ye D (2009) Robust harris-laplace detector by scale multiplication. In: ISVC (1) Lecture notes in computer scienceGoogle Scholar
  29. 29.
    Sivic J, Russell BC, Efros AA, Zisserman A, Freeman WT (2005) Discovering objects and their location in images. In: ICCVGoogle Scholar
  30. 30.
    Sivic J, Zisserman A (April 2009) Efficient visual search of videos cast as text retrieval. In: IEEE Transactions on Pattern Analysis and Machine IntelligenceGoogle Scholar
  31. 31.
    Tenenbaum JB, Silva V, Langford J C (2000) A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290 (5500):2319–2323CrossRefGoogle Scholar
  32. 32.
    Toldo R, Castellani U, Fusiello A (2009) A bag of words approach for 3d object categorization. In: Proceedings of the 4th International Conference on Computer Vision/Computer Graphics Collaboration TechniquesGoogle Scholar
  33. 33.
    Torresani L, Szummer M, Fitzgibbon A (2010) Efficient object category recognition using classemes. In: ECCVGoogle Scholar
  34. 34.
    van de Sande T, Gevers K, Jan-Snoek CGM (2010) Evaluating color descriptors for object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(9):1582–1596Google Scholar
  35. 35.
    Weinberger KQ, Sha F, Saul LK (2004) Learning a kernel matrix for nonlinear dimensionality reduction. In: Proceedings of the twenty-first international conference on Machine learning, ACM. pp 106Google Scholar
  36. 36.
    Widjaja I, Leow W, Wu F (2003) Identifying painters from color profiles of skin patches in painting images. In: ICIPGoogle Scholar
  37. 37.
    Yang J, Jiang Y-G, Hauptmann AG, Ngo C-W (2007) Evaluating bag-of-visual-words representations in scene classification. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, MIR ’07Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Babak Saleh
    • 1
  • Kanako Abe
    • 1
  • Ravneet Singh Arora
    • 1
  • Ahmed Elgammal
    • 1
  1. 1.Department of Computer Science, RutgersThe State University of New JerseyPiscatawayUSA

Personalised recommendations