Attribute Learning in Large-Scale Datasets

  • Olga Russakovsky
  • Li Fei-Fei
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6553)


We consider the task of learning visual connections between object categories using the ImageNet dataset, which is a large-scale dataset ontology containing more than 15 thousand object classes. We want to discover visual relationships between the classes that are currently missing (such as similar colors or shapes or textures). In this work we learn 20 visual attributes and use them in a zero-shot transfer learning experiment as well as to make visual connections between semantically unrelated object categories.


Object Class Object Category Striped Zebra Attribute Learn Semantic Hierarchy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Lampert, C., Nickisch, H., Harmeling, S.: Learning to detect unseen object classes by between-class attribute transfer. In: CVPR (2009)Google Scholar
  2. 2.
    Ferrari, V., Zisserman, A.: Learning Visual Attributes. In: NIPS (2007)Google Scholar
  3. 3.
    Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: CVPR (2009)Google Scholar
  4. 4.
    Farhadi, A., Endres, I., Hoiem, D.: Attribute-Centric Recognition for Cross-category Generalization. In: CVPR (2010)Google Scholar
  5. 5.
    Kumar, N., Berg, A.C., Belhumeur, P.N., Nayar, S.K.: Attribute and Simile Classifiers for Face Verification. In: ICCV (2009)Google Scholar
  6. 6.
    Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., Schiele, B.: What Helps Where – And Why? Semantic Relatedness for Knowledge Transfer. In: CVPR (2010)Google Scholar
  7. 7.
    Yanai, K., Barnard, K.: Image Region Entropy: A Measure of ”Visualness” of Web Images Associated with One Concept. ACM Multimedia (2005)Google Scholar
  8. 8.
    Fellbaum, C.: WordNet: An Electronic Lexical Database. Bradford Books (1998)Google Scholar
  9. 9.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: A Large-Scale Hierarchical Image Database. In: CVPR (2009)Google Scholar
  10. 10.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV (2004)Google Scholar
  11. 11.
    Berg, A., Deng, J., Fei-Fei, L.: ImageNet Large Scale Visual Recognition Challenge development kit (2010)Google Scholar
  12. 12.
    Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. PAMI (2002)Google Scholar
  13. 13.
    Martin, D., Fowlkes, C., Malik, J.: Learning to detect natural image boundaries using brightness and texture. In: NIPS (2002)Google Scholar
  14. 14.
    Catanzaro, B., Su, B.Y., Sundaram, N., Lee, Y., Murphy, M., Keutzer, K.: Efficient, high-quality image contour detection. In: ICCV (2009)Google Scholar
  15. 15.
    Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines (2001)Google Scholar
  16. 16.
    Swain, M.J., Ballard, D.H.: Color indexing. IJCV (1991)Google Scholar
  17. 17.
    Platt, J.: Probabilistic outputs for support vector machines and comparison to regularized likelihood methods. In: Advances in Large Margin Classifiers (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Olga Russakovsky
    • 1
  • Li Fei-Fei
    • 1
  1. 1.Stanford UniversityUSA

Personalised recommendations