Invariant-based shape retrieval in pictorial databases

  • Michael Kliot
  • Ehud Rivlin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1406)


One of the strongest cues for retrieval of content information from images is shape. However, due to the wide range of transformations that an object might undergo, this is also the most difficult one to handle. It seems that shape retrieval is one of the major barriers nowadays on the way of image databases to become commonly used. Common approaches use global attributes (Faloutsos et al. [1]), feature points (Pentland et al. [2]), histograms (Jain and Vailaya [3]), or physical models of deformations (Del Bimbo and Pala [4]). We present an approach for shape retrieval from pictorial databases which is based on invariant features of the image. In particular we use a combination of semi-local multi-valued invariant signatures and global features. Spatial relations and global properties are used to eliminate non-relevant images before similarity is computed. Common approaches usually don't handle viewpoint transformations more complex than similarity and require the full shape in order to compute image features. The advantages of the proposed approach are its ability to handle images distorted by different viewpoint transformations, its ability to retrieve images even in situations in which part of the shape is missing (i.e., in case of occlusion or sketch-based queries), and its ability to support efficient indexing.

We have implemented our approach in a heterogeneous database having a SQL-like user interface augmented with sketch-based queries. The system is built on top of a commercial database system, and can be activated from the Web. We present experimental results demonstrating the effectiveness of the proposed approach.


Input Image Image Retrieval Affine Transformation Road Sign Shape Retrieval 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovich, and W. Equitz, Efficient and effective querying by image content, Journal of Intelligent Information Systems 3, 1994, 231–262.CrossRefGoogle Scholar
  2. 2.
    A. Pentland, R. Picard, and S. Sclaroff, Photobook: Tools for content-base manipulation of image databases, in Proceedings, SPIE Conf. on Storage and Retrieval of Image Databases II, 1994, pp. 37–50.Google Scholar
  3. 3.
    A. Jain and A. Vailaya, Image retrieval using color and shape, Pattern Recognition 29, 1996, 1233–1244.CrossRefGoogle Scholar
  4. 4.
    A. D. Bimbo and P. Pala, Visual image retrieval by elastic matching of user sketches, IEEE Trans. Patt. Anal. Mach. Intell. 19, 1997, 121–132.CrossRefGoogle Scholar
  5. 5.
    S.-F. Chang, J. Smith, and H. Wang, Automatic feature extraction and indexing for content-based visual query, Tech. Rep. 408-95-14, Columbia University Center for Telecommunications Research, New York, NY, 1995.Google Scholar
  6. 6.
    S.-F. Chang and J. Smith, Extracting multi-dimensional signal features for contentbased visual query, in SPIE Int. Symp. on Visual Communications and Image Processing, 1995.Google Scholar
  7. 7.
    R. Mehrotra and J. Gary, Similar-shape retrieval in shape data management, IEEE Computer 28, 1995, 57–62.Google Scholar
  8. 8.
    K. Shields, J. Eakins, and J. Boardman, Automatic image retrieval using shape features, New Review of Document and Text Management 1, 1995, 183–198.Google Scholar
  9. 9.
    S. Lee and F.J.Hsu, Spatial reasoning and similarity retrieval of images using 2D-C string knowledge representation, Pattern Recognition 25, 1992, 305–318.CrossRefGoogle Scholar
  10. 10.
    T. Moons, E. Pauwels, L. V. Gool, and A. Oosterlinck, Foundations of semidifferential invariants, Int. Journal Of Comput. Vision 14, 1995, 25–47.CrossRefGoogle Scholar
  11. 11.
    A. Bruckstein, J. Holt, A. Netravali, and T. Richardson, Invariant signatures for planar shape recognition under partial occlusion, CVGIP:Image Understanding 58, 1993, 49–65.CrossRefGoogle Scholar
  12. 12.
    A. Bruckstein, E. Rivlin, and I. Weiss, Recognizing objects using scale space local invariants, in Int. Conf. on Pattern Recognition, Vienna, 1996, p. A9M.6.Google Scholar
  13. 13.
    T. Moons, E. Pauwels, L. V. Gool, and A. Oosterlinck, Recognition of planar shapes under affine distortion, Int. Journal Of Comput. Vision 14, 1995, 49–65.CrossRefGoogle Scholar
  14. 14.
    J. Köbler, U. Schöning, and J. Torán, The graph isomorphism problem. Birkhäuser, Boston, 1993.Google Scholar
  15. 15.
    Kbs beer bottle collection, URL: Google Scholar
  16. 16.
    A. Zisserman, D. Forsyth, J. Mundy, C. Rothwell, J. Liu, and N. Pillow, 3d object recognition using invariance, Artificial Intelligence 78, 1995, 239–288.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • Michael Kliot
    • 1
  • Ehud Rivlin
    • 1
  1. 1.Computer Science DepartmentTechnion - Israel Institute of TechnologyHaifaIsrael

Personalised recommendations