Advertisement

Hierarchical one permutation hashing: efficient multimedia near duplicate detection

  • Chengyuan Zhang
  • Yunwu Lin
  • Lei Zhu
  • XinPan Yuan
  • Jun Long
  • Fang Huang
Article
  • 23 Downloads

Abstract

With advances in multimedia technologies and the proliferation of smart phone, digital cameras, storage devices, there are a rapidly growing massive amount of multimedia data collected in many applications such as multimedia retrieval and management system, in which the data element is composed of text, image, video and audio. Consequently, the study of multimedia near duplicate detection has attracted significant concern from research organizations and commercial communities. Traditional solution minwish hashing (MinWise) faces two challenges: expensive preprocessing time and lower comparison speed. Thus, this work first introduce a hashing method called one permutation hashing (OPH) to shun the costly preprocessing time. Based on OPH, a more efficient strategy group based one permutation hashing (GOPH) is developed to deal with the high comparison time. Based on the fact that the similarity of most multimedia data is not very high, this work design an new hashing method namely hierarchical one permutation hashing (HOPH) to further improve the performance. Comprehensive experiments on real multimedia datasets clearly show that with similar accuracy HOPH is five to seven times faster than MinWise.

Keywords

Hierarchical one permutation hashing Multimedia data Near duplicate detection 

Notes

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China (61379110, 61472450, 61702560), the Key Research Program of Hunan Province(2016JC2018), project (2016JC2011, 2018JJ3691) of Science and Technology Plan of Hunan Province, and Fundamental Research Funds for Central Universities of Central South University (2018zzts588).

References

  1. 1.
    Bayardo RJ, Ma Y, Srikant R (2007) Scaling up all pairs similarity search. In: Proceedings of the 16th International Conference on World Wide Web, WWW 2007, Banff, Alberta, Canada, May 8-12, 2007, pp 131–140Google Scholar
  2. 2.
    Broder AZ, Charikar M, Frieze AM, Mitzenmacher M (2000) Min-wise independent permutations. J Comput Syst Sci 60(3):630–659MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Broder AZ, Glassman SC, Manasse MS, Zweig G (1997) Syntactic clustering of the web. Comput Netw 29(8-13):1157–1166Google Scholar
  4. 4.
    Chum O, Philbin J, Isard M, Zisserman A (2007) Scalable near identical image and shot detection. In: Proceedings of the 6th ACM International Conference on Image and Video Retrieval, CIVR 2007, Amsterdam, The Netherlands, July 9-11, 2007, pp 549–556Google Scholar
  5. 5.
    Chum O, Philbin J, Zisserman A (2008) Near duplicate image detection: min-hash and tf-idf weighting. In: Proceedings of the British Machine Vision Conference 2008, Leeds, September 2008, pp 1–10Google Scholar
  6. 6.
    Hassanian-esfahani R, Kargar MJ (2018) Sectional minhash for near-duplicate detection. Expert Syst Appl 99:203–212CrossRefGoogle Scholar
  7. 7.
    Henzinger MR (2006) Finding near-duplicate web pages: a large-scale evaluation of algorithms. In: SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006, pp 284–291Google Scholar
  8. 8.
    Hoad TC, Zobel J (2003) Methods for identifying versioned and plagiarized documents. JASIST 54(3):203–215CrossRefGoogle Scholar
  9. 9.
    Indyk P, Motwani R (1998) Approximate nearest neighbors: Towards removing the curse of dimensionality. In: Proceedings of the Thirtieth Annual ACM Symposium on the Theory of Computing, Dallas, Texas, USA, May 23-26, 1998, pp 604–613Google Scholar
  10. 10.
    Jain P, Kulis B, Grauman K (2008) Fast image search for learned metrics. In: 2008 IEEE Computer society conference on computer vision and pattern recognition (CVPR 2008), 24-26 June 2008, Anchorage, Alaska, USAGoogle Scholar
  11. 11.
    Li P, Owen A, Zhang CH (2012) One permutation hashing for efficient search and learning. MathematicsGoogle Scholar
  12. 12.
    Li P, Shrivastava A, Moore JL, König AC (2011) Hashing algorithms for large-scale learning. In: Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011. Proceedings of a meeting held 12-14 December 2011, Granada, Spain, pp 2672–2680Google Scholar
  13. 13.
    Li P, Wang M, Cheng J, Xu C, Lu H (2013) Spectral hashing with semantically consistent graph for image indexing. IEEE Trans Multimed 15(1):141–152CrossRefGoogle Scholar
  14. 14.
    Lowe DG (1999) Object recognition from local scale-invariant features. In: ICCV, pp 1150–1157Google Scholar
  15. 15.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  16. 16.
    Nistér D, Stewénius H (2006) Scalable recognition with a vocabulary tree. In: 2006 IEEE Computer society conference on computer vision and pattern recognition (CVPR 2006), 17-22 June 2006, New York, NY, USA, pp 2161–2168Google Scholar
  17. 17.
    Pagh R, Stöckel M, Woodruff DP (2014) Is min-wise hashing optimal for summarizing set intersection?. In: Proceedings of the 33rd ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, PODS’14, Snowbird, UT, USA, June 22-27, 2014, pp 109–120Google Scholar
  18. 18.
    Philbin J, Chum O, Isard M, Sivic J, Zisserman A (2007) Object retrieval with large vocabularies and fast spatial matching. In: 2007 IEEE Computer society conference on computer vision and pattern recognition (CVPR 2007), 18-23 June 2007, Minneapolis, Minnesota, USAGoogle Scholar
  19. 19.
    Qu Y, Song S, Yang J, Li J (2013) Spatial min-hash for similar image search. In: International conference on internet multimedia computing and service, ICIMCS ’13, huangshan, China - August 17 - 19, 2013, pp 287–290Google Scholar
  20. 20.
    Shao J, Wu F, Ouyang C, Zhang X (2012) Sparse spectral hashing. Pattern Recogn Lett 33(3):271–277CrossRefGoogle Scholar
  21. 21.
    Sivic J, Zisserman A (2003) Video google: a text retrieval approach to object matching in videos. In: 9th IEEE international conference on computer vision (ICCV 2003), 14-17 October 2003, Nice, France, pp 1470–1477Google Scholar
  22. 22.
    Torralba A, Fergus R, Weiss Y (2008) Small codes and large image databases for recognition. In: 2008 IEEE Computer society conference on computer vision and pattern recognition (CVPR 2008), 24-26 June 2008, Anchorage, Alaska, USAGoogle Scholar
  23. 23.
    Vsemirnov M (2004) Automorphisms of projective spaces and min-wise independent sets of permutations. SIAM J Discrete Math 18(3):592–607MathSciNetCrossRefzbMATHGoogle Scholar
  24. 24.
    Wang Y, Lin X, Wu L, Zhang W (2015) Effective multi-query expansions: Robust landmark retrieval. In: Proceedings of the 23rd Annual ACM Conference on Multimedia Conference, MM ’15, Brisbane, Australia, October 26 - 30, 2015, pp 79–88Google Scholar
  25. 25.
    Wang Y, Lin X, Wu L, Zhang W (2017) Effective multi-query expansions: Collaborative deep networks for robust landmark retrieval. IEEE Trans. Image Processing 26(3):1393–1404MathSciNetCrossRefGoogle Scholar
  26. 26.
    Wang Y, Lin X, Wu L, Zhang W, Zhang Q (2014) Exploiting correlation consensus: towards subspace clustering for multi-modal data. In: Proceedings of the ACM International Conference on Multimedia, MM ’14, Orlando, FL, USA, November 03 - 07, 2014, pp 981–984Google Scholar
  27. 27.
    Wang Y, Lin X, Wu L, Zhang W, Zhang Q (2015) LBMCH: Learning bridging mapping for cross-modal hashing. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015, pp 999–1002Google Scholar
  28. 28.
    Wang Y, Lin X, Wu L, Zhang W, Zhang Q, Huang X (2015) Robust subspace clustering for multi-view data by exploiting correlation consensus. IEEE Trans Image Process 24(11):3939–3949MathSciNetCrossRefGoogle Scholar
  29. 29.
    Wang Y, Lin X, Zhang Q (2013) Towards metric fusion on multi-view data: a cross-view based graph random walk approach. In: 22nd ACM international conference on information and knowledge management, CIKM’13, San Francisco, CA, USA, October 27 - November 1, 2013, pp 805–810Google Scholar
  30. 30.
    Wang Y, Lin X, Zhang Q, Wu L (2014) Shifting hypergraphs by probabilistic voting. In: Advances in knowledge discovery and data mining - 18th pacific-asia conference, PAKDD 2014, Tainan, Taiwan, May 13-16, 2014. proceedings, Part II, pp 234–246Google Scholar
  31. 31.
    Wang Y, Wu L (2018) Beyond low-rank representations: Orthogonal clustering basis reconstruction with optimized graph structure for multi-view spectral clustering. Neural Netw 103:1–8CrossRefGoogle Scholar
  32. 32.
    Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Trans Neural Networks and Learning SystemsGoogle Scholar
  33. 33.
    Wang Y, Zhang W, Wu L, Lin X, Fang M, Pan S (2016) Iterative views agreement: an iterative low-rank based structured optimization method to multi-view spectral clustering. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI 2016, New York, NY, USA, 9-15 July 2016, pp 2153–2159Google Scholar
  34. 34.
    Wang Y, Zhang W, Wu L, Lin X, Zhao X (2017) Unsupervised metric fusion over multiview data by graph random walk-based cross-view diffusion. IEEE Trans Neural Netw Learning Syst 28(1):57–70CrossRefGoogle Scholar
  35. 35.
    Wu L, Wang Y (2017) Robust hashing for multi-view data: Jointly learning low-rank kernelized similarity consensus and hash functions. Image Vision Comput. 57:58–66CrossRefGoogle Scholar
  36. 36.
    Wu L, Wang Y, Gao J, Li X (2018) Deep adaptive feature embedding with local sample distributions for person re-identification. Pattern Recogn 73:275–288CrossRefGoogle Scholar
  37. 37.
    Wu L, Wang Y, Ge Z, Hu Q, Li X (2018) Structured deep hashing with convolutional neural networks for fast person re-identification. Comput Vis Image Underst 167:63–73CrossRefGoogle Scholar
  38. 38.
    Wu L, Wang Y, Li X, Gao J (2018) Deep attention-based spatially recursive networks for fine-grained visual recognition. IEEE Trans CyberneticsGoogle Scholar
  39. 39.
    Wu L, Wang Y, Li X, Gao J (2018) What-and-where to match: deep spatially multiplicative integration networks for person re-identification. Pattern Recogn 76:727–738CrossRefGoogle Scholar
  40. 40.
    Yang H, Callan JP (2006) Near-duplicate detection by instance-level constrained clustering. In: SIGIR 2006: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Seattle, Washington, USA, August 6-11, 2006, pp 421–428Google Scholar
  41. 41.
    Zhang D, Chang S (2004) Detecting image near-duplicate by stochastic attributed relational graph matching with learning. In: Proceedings of the 12th ACM International Conference on Multimedia, New York, NY, USA, October 10-16, 2004, pp 877–884Google Scholar
  42. 42.
    Zhang S, Yang M, Wang X, Lin Y, Tian Q (2015) Semantic-aware co-indexing for image retrieval. IEEE Trans Pattern Anal Mach Intell 37(12):2573–2587CrossRefGoogle Scholar
  43. 43.
    Zhou D, Li X, Zhang Y (2016) A novel cnn-based match kernel for image retrieval. In: 2016 IEEE International conference on image processing, ICIP 2016, Phoenix, AZ, USA, September 25-28, 2016, pp 2445–2449Google Scholar
  44. 44.
    Zhou W, Li H, Wang M, Lu Y, Tian Q (2012) Binary SIFT: towards efficient feature matching verification for image search. In: The 4th international conference on internet multimedia computing and service, ICIMCS ’12, Wuhan, China, September 9-11, 2012, pp 1–6Google Scholar
  45. 45.
    Zobel J, Moffat A (2006) Inverted files for text search engines. ACM Comput Surv 38(2):6CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018
corrected publication July/2018

Authors and Affiliations

  1. 1.School of Information Science and EngineeringCentral South UniversityChangshaPeople’s Republic of China
  2. 2.Big Data and Knowledge Engineering InstituteCentral South UniversityChangshaPeople’s Republic of China
  3. 3.School of ComputerHunan University of TechnologyZhuzhouPeople’s Republic of China

Personalised recommendations