Skip to main content

Shot-Based Keyframe Extraction Using Bitwise-XOR Dissimilarity Approach

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 709))

Abstract

Keyframe extraction is an essential task in many video analysis applications such as video summarization, video classification, video indexing and retrieval. In this paper, a method of extracting keyframes from the shots using bitwise XOR dissimilarity has been proposed. The task of segmenting continuous video into shots and selection of key frames from segmented shots has been addressed. The above task has been accomplished through a feature extraction technique, based on bitwise XOR operation between consecutive gray scale frames of the video. Thresholding mechanism is employed to segment the videos into shots. Dissimilarity matrix is constructed to select a representative keyframe from every shot of a video sequence. The proposed shot boundary detection and keyframe extraction approach is implemented and evaluated on a subset of TRECVID 2001 data set. The proposed approach outperform other contemporary approaches in terms of efficiency and accuracy. Also, the experimental results on the data set have demonstrated the efficacy of the proposed keyframe extraction technique in terms of fidelity measure.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Money, A.G., Agius, H.: Video summarisation: a conceptual framework and survey of the state of the art. J. Vis. Commun. Image Represent. 19(2), 121–143 (2008)

    Article  Google Scholar 

  2. Amiri, A., Fathy, M.: Hierarchical keyframe-based video summarization using QR-decomposition and modified k-means clustering. EURASIP J. Adv. Sig. Process. 2010 (2010). Article No. 102

    Google Scholar 

  3. Girgensohn, A., Boreczky, J.: Time-constrained keyframe selection technique. Multimedia Comput. Syst. IEEE Int. Conf. IEEE 1, 756–761 (1999)

    Article  MATH  Google Scholar 

  4. Gianluigi, C., Raimondo, S.: An innovative algorithm for key frame extraction in video summarization. J. Real-Time Image Process. 1(1), 69–88 (2006)

    Article  Google Scholar 

  5. Furini, M., Geraci, F., Montangero, M., Pellegrini, M.: STIMO: STIll and MOving video storyboard for the web scenario. Multimedia Tools Appl. 46(1), 47–69 (2010)

    Article  Google Scholar 

  6. Hu, W., Xie, N., Li, L., Zeng, X., Maybank, S.: A survey on visual content-based video indexing and retrieval. IEEE Trans. Syst. Man Cybern. C (Applications and Reviews), 41(6), 797–819 (2011)

    Google Scholar 

  7. Lian, S.: Automatic video temporal segmentation based on multiple features. Soft Comput. 15(3), 469–482 (2011)

    Article  Google Scholar 

  8. Küçüktunç, O., Güdükbay, U., Ulusoy, Ö.: Fuzzy color histogram based video segmentation. Comput. Vis. Image Underst. 114(1), 125–134 (2010)

    Google Scholar 

  9. Yoo, H.W., Ryoo, H.J., Jang, D.S.: Gradual shot boundary detection using localized edge blocks. Multimedia Tools Appl. 28(3), 283–300 (2006)

    Article  Google Scholar 

  10. Amel, A.M., Abdessalem, B.A., Abdellatif, M.: Video shot boundary detection using motion activity descriptor. arXiv preprint arXiv:1004.4605 (2010)

  11. Barbu, T.: Novel automatic video cut detection technique using Gabor filtering. Comput. Electr. Eng. 35(5), 712–721 (2009)

    Article  MATH  Google Scholar 

  12. Shekar, B.H., Uma, K.P.: Kirsch directional derivatives based shot boundary detection: an efficient and accurate method. Procedia Comput. Sci. 58, 565–571 (2015)

    Article  Google Scholar 

  13. Cernekova, Z., Pitas, I., Nikou, C.: Information theory based shot cut/fade detection and video summarization. IEEE Trans. Circ. Syst. Video Technol. 16(1), 82–91 (2006)

    Article  Google Scholar 

  14. Jiang, X., Sun, T., Liu, J., Chao, J., Zhang, W.: An adaptive video shot segmentation scheme based on dual detection model. Neurocomputing 116, 102–111 (2013)

    Article  Google Scholar 

  15. Birinci, M., Birinyaz, S.: A perceptual scheme for fully automatic video shot boundary detection. Sig. Process. Image Commun. 29(3), 410–423 (2014)

    Article  Google Scholar 

  16. Truong, B.T., Venkatesh, S.: Video abstraction: a systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. (TOMM) 3(1), 3 (2007)

    Google Scholar 

  17. Li, Y., Lee, S.H., Yeh, C.H., Kuo, C.C.: Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques. IEEE Sig. Process. Mag. 23(2), 79–89 (2006)

    Article  Google Scholar 

  18. Jiang, R.M., Sadka, A.H., Crookes, D.: Advances in video summarization and skimming. In: Grgic, M., Delac, K., Ghanbari, M. (eds.) Recent Advances in Multimedia Signal Processing and Communications, vol. 231, pp. 27–50. Springer, Heidelberg (2009)

    Google Scholar 

  19. Hanjalic, A., Lagendijk, R.L., Biemond, J.: A new keyframe allocation method for representing stored video streams. In: Proceedings of 1st International Workshop on Image Databases and Multimedia Search (1996)

    Google Scholar 

  20. Ejaz, N., Tariq, T.B., Baik, S.W.: Adaptive key frame extraction for video summarization using an aggregation mechanism. J. Vis. Commun. Image Represent. 23(7), 1031–1040 (2012)

    Article  Google Scholar 

  21. Yeung, M.M., Yeo, B.L.: Video visualization for compact presentation and fast browsing of pictorial content. IEEE Trans. Circ. Syst. Video Technol. 7(5), 771–785 (1997)

    Article  Google Scholar 

  22. Zhuang, Y., Rui, Y., Huang, T.S., Mehrotra, S.: Adaptive key frame extraction using unsupervised clustering. In: Proceedings of the International Conference on Image Processing, ICIP 1998, vol. 1, pp. 866–870. IEEE (1998)

    Google Scholar 

  23. Mundur, P., Rao, Y., Yesha, Y.: Keyframe-based video summarization using Delaunay clustering. Int. J. Digit. Libr. 6(2), 219–232 (2006)

    Article  Google Scholar 

  24. Gong, Y., Liu, X.: Generating optimal video summaries. In: 2000 IEEE International Conference on Multimedia and Expo, ICME, vol. 3, pp. 1559–1562. IEEE (2000)

    Google Scholar 

  25. Priya, G.L., Domnic, S.: Shot based keyframe extraction for ecological video indexing and retrieval. Ecol. Inf. 23, 107–117 (2014)

    Article  Google Scholar 

  26. Besiris, D., Makedonas, A., Economou, G., Fotopoulos, S.: Combining graph connectivity and dominant set clustering for video summarization. Multimedia Tools Appl. 44(2), 161–186 (2009)

    Article  Google Scholar 

  27. Chang, H.S., Sull, S., Lee, S.U.: Efficient video indexing scheme for content-based retrieval. IEEE Trans. Circ. Syst. Video Technol. 9(8), 1269–1279 (1999)

    Article  Google Scholar 

  28. http://www-nlpir.nist.gov/projects/trecvid/collection.html

  29. Adjeroh, D., Lee, M.C., Banda, N., Kandaswamy, U.: Adaptive edge-oriented shot boundary detection. EURASIP J. Image Video Process. 2009(1), 1 (2009). Article No. 5

    Google Scholar 

  30. Li, W.K., Lai, S.H.: Integrated video shot segmentation algorithm. In: Electronic Imaging 2003 International Society for Optics and Photonics, pp. 264–271 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rashmi B.S. .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

B.S., R., H.S., N. (2017). Shot-Based Keyframe Extraction Using Bitwise-XOR Dissimilarity Approach. In: Santosh, K., Hangarge, M., Bevilacqua, V., Negi, A. (eds) Recent Trends in Image Processing and Pattern Recognition. RTIP2R 2016. Communications in Computer and Information Science, vol 709. Springer, Singapore. https://doi.org/10.1007/978-981-10-4859-3_28

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-4859-3_28

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-4858-6

  • Online ISBN: 978-981-10-4859-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics