Jet-Based Local Image Descriptors

  • Anders Boesen Lindbo Larsen
  • Sune Darkner
  • Anders Lindbjerg Dahl
  • Kim Steenstrup Pedersen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7574)


We present a general novel image descriptor based on higherorder differential geometry and investigate the effect of common descriptor choices. Our investigation is twofold in that we develop a jet-based descriptor and perform a comparative evaluation with current state-of-the-art descriptors on the recently released DTU Robot dataset. We demonstrate how the use of higher-order image structures enables us to reduce the descriptor dimensionality while still achieving very good performance. The descriptors are tested in a variety of scenarios including large changes in scale, viewing angle and lighting. We show that the proposed jet-based descriptor is superior to state-of-the-art for DoG interest points and show competitive performance for the other tested interest points.


Interest Point Image Patch View Angle Linear Path Interest Point Detector 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 91–110 (2004)CrossRefGoogle Scholar
  2. 2.
    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 1615–1630 (2005)CrossRefGoogle Scholar
  3. 3.
    Ke, Y., Sukthankar, R.: PCA-SIFT: A more distinctive representation for local image descriptors. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), vol. 2, pp. 506–513 (2004)Google Scholar
  4. 4.
    Winder, S., Hua, G., Brown, M.: Picking the best daisy. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009), pp. 178–185 (2009)Google Scholar
  5. 5.
    Tola, E., Lepetit, V., Fua, P.: Daisy: An efficient dense descriptor applied to wide-baseline stereo. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 815–830 (2010)CrossRefGoogle Scholar
  6. 6.
    Florack, L., ter Haar Romeny, B.M., Viergever, M., Koenderink, J.: The gaussian scale-space paradigm and the multiscale local jet. International Journal of Computer Vision 18, 61–75 (1996)CrossRefGoogle Scholar
  7. 7.
    Schmid, C., Mohr, R.: Local grayvalue invariants for image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 530–535 (1997)CrossRefGoogle Scholar
  8. 8.
    Balmashnova, E., Florack, L.: Novel similarity measures for differential invariant descriptors for generic object retrieval. Journal of Mathematical Imaging and Vision 31, 121–132 (2008)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Laptev, I., Lindeberg, T.: Local Descriptors for Spatio-temporal Recognition. In: MacLean, W.J. (ed.) SCVMA 2004. LNCS, vol. 3667, pp. 91–103. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    Aanæs, H., Dahl, A., Steenstrup Pedersen, K.: Interesting interest points: A comparative study of interest point performance on a unique data set. International Journal of Computer Vision 97, 18–35 (2012)CrossRefGoogle Scholar
  11. 11.
    Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. International Journal of Computer Vision 65, 43–72 (2005)CrossRefGoogle Scholar
  12. 12.
    Kaneva, B., Torralba, A., Freeman, W.T.: Evaluating image feaures using a photorealistic virtual world. In: IEEE International Conference on Computer Vision (2011)Google Scholar
  13. 13.
    Vedaldi, A., Ling, H., Soatto, S.: Knowing a Good Feature When You See It: Ground Truth and Methodology to Evaluate Local Features for Recognition. In: Cipolla, R., Battiato, S., Farinella, G. (eds.) Computer Vision. SCI, vol. 285, pp. 27–49. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  14. 14.
    Pedersen, K.S.: Statistics of natural image geometry. PhD thesis, University of Copenhagen, Department of Computer Science, Denmark (2003)Google Scholar
  15. 15.
    Markussen, B., Pedersen, K.S., Loog, M.: Second order structure of scale-space measurements. Journal of Mathematical Imaging and Vision 31, 207–220 (2008)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Dahl, A.L., Aanæs, H., Pedersen, K.S.: Finding the best feature detector-descriptor combination. In: The First Joint Conference of 3D Imaging, Modeling, Processing, Visualization and Transmission (2011)Google Scholar
  17. 17.
    Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: Speeded-up robust features (surf). Computer Vision and Image Understanding 110, 346–359 (2008)CrossRefGoogle Scholar
  18. 18.
    Matas, J., Chum, O., Urban, M., Pajdla, T.: Robust wide-baseline stereo from maximally stable extremal regions. Image and Vision Computing 22, 761–767 (2004)CrossRefGoogle Scholar
  19. 19.
    Mikolajczyk, K., Schmid, C.: Scale & affine invariant interest point detectors. International Journal of Computer Vision 60, 63–86 (2004)CrossRefGoogle Scholar
  20. 20.
    Lillholm, M., Nielsen, M., Griffin, L.D.: Feature-based image analysis. International Journal of Computer Vision 52, 73–95 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Anders Boesen Lindbo Larsen
    • 1
  • Sune Darkner
    • 1
  • Anders Lindbjerg Dahl
    • 2
  • Kim Steenstrup Pedersen
    • 1
  1. 1.Department of Computer ScienceUniversity of CopenhagenDenmark
  2. 2.Department of Informatics and Mathematical ModellingTechnical University of DenmarkDenmark

Personalised recommendations