Learning Algorithms and Frame Signatures for Video Similarity Ranking

  • Teruki Horie
  • Akihiro Shikano
  • Hiromichi Iwase
  • Yasuo MatsuyamaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9489)


Learning algorithms that harmonize standardized video similarity tools and an integrated system are presented. The learning algorithms extract exemplars reflecting time courses of video frames. There were five types of such clustering methods. Among them, this paper chooses a method called time-partition pairwise nearest-neighbor because of its reduced complexity. On the similarity comparison among videos whose lengths vary, the M-distance that can absorb the difference of the exemplar cardinalities is utilized both for global and local matching. Given the order-aware clustering and the M-distance comparison, system designers can build a basic similar-video retrieval system. This paper promotes further enhancement on the exemplar similarity that matches the video signature tools for the multimedia content description interface by ISO/IEC. This development showed the ability of the similarity ranking together with the detection of plagiarism of video scenes. Precision-recall curves showed a high performance in this experiment.


Video similarity ranking Exemplar Frame signature Numerical label M-distance 


  1. 1.
    Information technology – Multimedia content description interface, International Standard of ISO/IEC 15938-3, Amendment 4 (2010)Google Scholar
  2. 2.
    Matsuyama, Y., Shikano, A., Iwase, H., Horie, T.: Order-aware exemplars for structuring video sets: clustering, aligned matching and retrieval by similarity. In: Proceedings of IJCNN, TBA (2015)Google Scholar
  3. 3.
    Frey, B.J., Dueck, D.: Clustering by passing messages between data points. Science 315(5814), 972–976 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Matsuyama, Y.: Harmonic competition: a self-organizing multiple criteria optimization. IEEE Trans. Neural Netw. 7, 652–668 (1996)CrossRefGoogle Scholar
  5. 5.
    Equitz, W.: A new vector quantization algorithm. IEEE Trans. ASSP 37, 1568–1575 (1989)CrossRefGoogle Scholar
  6. 6.
    Yahoo! Webscope dataset YFCC-100M.
  7. 7.
    Needleman, S.B., Wunsch, C.D.: A general method applicable to the search for similarities in the amino acid sequence of two proteins. J. Mol. Bio. 48, 443–453 (1970)CrossRefGoogle Scholar
  8. 8.
    Smith, T.F., Waterman, M.S.: Identification of common molecular subsequences. J. Mol. Biol. 147, 195–197 (1981)CrossRefGoogle Scholar
  9. 9.
    Pachalakis, S., Iwamoto, K., et al.: The MPEG-7 video signature tools for content identification. IEEE Trans. Circ. Syst. Video Tech. 22, 1050–1063 (2012)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Teruki Horie
    • 1
  • Akihiro Shikano
    • 1
  • Hiromichi Iwase
    • 1
  • Yasuo Matsuyama
    • 1
    Email author
  1. 1.Department of Computer Science and EngineeringWaseda UniversityTokyoJapan

Personalised recommendations