Multimedia Tools and Applications

, Volume 78, Issue 22, pp 31533–31555 | Cite as

Intra mode selection using classical secretary problem (CSP) in high efficiency video coding (HEVC)

  • Junaid TariqEmail author


In order to support fast distribution of multimedia contents on social media and internet, a fast intra mode decision strategy is proposed in this article to reduce the encoding time of multimedia contents by removing the brute force intra mode selection procedure of HEVC. This article, firstly, improves the performance of the rough-mode-decision (RMD) component of HEVC by constructing the candidate intra mode list by employing a new measure that is fusion of the Hadamard-cost and the statistical-inference formed using spatial/ temporal information. Later, an optimal stopping point prediction model is constructed that outperforms the existing optimal stopping models proposed for HEVC by giving promising balance between the increase in bit-rate and the decrease in complexity. Finally, an early intra mode termination is predicted using the proposed optimal stopping model. Simulation results demonstrate that the proposed model has a wide application and provides early termination for a generic class of decision problems.


Video coding Image coding HEVC Fast intra mode Optimal stopping theory 



  1. 1.
    Bjontegaard G (2001) Calculation of average PSNR differences between RD-curves VCEG-M33Google Scholar
  2. 2.
    Bo H, Chen Z, Cai Q, Zheng M, Wu D (2019) Rate-distortion-complexity optimized coding mode decision for HEVC. IEEE Transactions on Circuits and Systems for Video TechnologyGoogle Scholar
  3. 3.
    Bossen F (2011) Common test conditions and software reference configurations. Joint Collaborative Team on Video Coding (JCT-VC), JCTVC-F900Google Scholar
  4. 4.
    Bruss F, Ferguson TS (1992) Strategies for sequential search and selection in real time: proceedings of the AMS-IMS-SIAM joint summer research conference held June 21-27, 1990, with support from the National Science Foundation, the National Security Agency, and the Office of Naval Research. No. 125 American Mathematical Soc.Google Scholar
  5. 5.
    Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding. IEEE Trans Circ Syst Video Technol 23(9):1555–1564CrossRefGoogle Scholar
  6. 6.
    Gwon D, Choi H (2019) Relative SATD based minimum risk Bayesian framework for fast intra decision of HEVC. KSII Trans Internet Inf Syst 13:1Google Scholar
  7. 7.
    Hamout H, Elyousfi A (2017) An efficient edge detection algorithm for fast intra-coding for 3D video extension of HEVC. J Real-Time Image Proc, 1–13Google Scholar
  8. 8.
    HEVC Test Model (2016) Accessed: Aug 2016
  9. 9.
    Hosseini E, Pakdaman F, Hashemi MR, Ghanbari M (2019) A computationally scalable fast intra coding scheme for HEVC video encoder. Multimed Tools Appl 78 (9):11607–11630CrossRefGoogle Scholar
  10. 10.
    Hu Q, Shi Z, Zhang X, Gao Z (2016) Fast HEVC intra mode decision based on logistic regression classification. In: 2016 IEEE International on symposium broadband multimedia systems and broadcasting (BMSB). IEEE, pp 1–4Google Scholar
  11. 11.
    Jia Z, Liu Z, Wang D, Han Q, Song Y (2013) Fast prediction mode decision with Hadamard transform based rate-distortion cost estimation for HEVC intra coding. In: 2013 20th IEEE international conference on image processing (ICIP). IEEE, pp 1977–1981Google Scholar
  12. 12.
    Kim I-K, Min J, Lee T, Han W-J, Park J (2012) Block partitioning structure in the HEVC standard. IEEE Trans Circ Sys Vid Technol 22(12):1697–1706CrossRefGoogle Scholar
  13. 13.
    Kuanar S, Rao KR, Bilas M, Bredow J (2019) Adaptive CU mode selection in HEVC intra prediction: a deep learning approach. Circ Syst Signal Process, 1–22Google Scholar
  14. 14.
    Liao K-Y, Yang J-F, Sun M-T (2010) Rate-distortion cost estimation for H. 264/AVC. IEEE Trans Circ Syst Vid Technol 20(1):38–49CrossRefGoogle Scholar
  15. 15.
    Liu Z, Yu X, Gao Y, Chen S, Ji X, Wang D (2016) CU partition mode decision for HEVC hardwired intra encoder using convolution neural network. IEEE Trans Image Process 25(11):5088–5103MathSciNetCrossRefGoogle Scholar
  16. 16.
    Ohm JR, Sullivan GJ, Schwarz H, Tan TK, Wiegand T (2012) Comparison of the coding efficiency of video coding standards including high efficiency video coding (HEVC). IEEE Trans Circ Syst Vid Technol 22(12):1669–1684CrossRefGoogle Scholar
  17. 17.
    Presman EL, Sonin IM (1973) The best choice problem for a random number of objects. Theory Probab Appl 17(4):657–668CrossRefGoogle Scholar
  18. 18.
    Ramezanpour M, Zargari F (2016) Fast HEVC I-frame coding based on strength of dominant direction of CUs. J Real-time Image Process 12(2):397–406CrossRefGoogle Scholar
  19. 19.
    Ruiz D, Fernandez-Escribano G, Adzic V, Kalva H, Martinez JL, Cuenca P (2017) Fast CU partitioning algorithm for HEVC intra coding using data mining. Multimed Tools Appl 76(1):861–894CrossRefGoogle Scholar
  20. 20.
    Shi W, Song T, Katayama T, Jiang X, Shimamoto T (2018) Hardware implementation-oriented fast intra-coding based on downsampling information for HEVC. J Real-Time Image Proc 15(1):57–71CrossRefGoogle Scholar
  21. 21.
    Song Y, Ye Z, Li X, Cai B, Yang G (2017) Fast CU size decision and mode decision algorithm for intra prediction in HEVC. Multimed Tools Appl 76 (2):2001–2017CrossRefGoogle Scholar
  22. 22.
    Sun X, Chen X, Xu Y, Xiao Y, Yi W, Yu D (2017) Fast CU size and prediction mode decision algorithm for HEVC based on direction variance. J Real-Time Image Proc, 1–14Google Scholar
  23. 23.
    Tan HL, Yeo CH, Tan YH, Li ZG (2012) Non CE6: unification of the number of intra prediction modes. Joint Collaborative Team Video Coding (JCT-VC) ITU-T VCEG ISO/IEC MPEG, document JCTVCH0166, San Jose, CA USAGoogle Scholar
  24. 24.
    Tian R, Zhang Y, Duan Mi, Li X (2019) Adaptive intra mode decision for HEVC based on texture characteristics and multiple reference lines. Multimed Tools Appl 78(1):289–310CrossRefGoogle Scholar
  25. 25.
    Tariq J (2019) RD-cost as statistical inference for early intra mode decision in HEVC. Multimed Tools Appl, 1–19Google Scholar
  26. 26.
    Tariq J, Kwong S (2015) Efficient intra and most probable mode (MPM) selection based on statistical texture features. In: 2015 IEEE International conference on systems, man, and cybernetics (SMC). IEEE, pp 1776–1781Google Scholar
  27. 27.
    Tariq J, Kwong S (2015) Hybrid fast intra mode decision and early termination of prediction unit (PU) splitting for HEVC. In: 2015 IEEE International conference on systems, man, and Cybernetics (SMC). IEEE , pp 1782–1786Google Scholar
  28. 28.
    Tariq J, Kwong S (2018) Adaptive stopping strategies for fast intra mode decision in HEVC. J Vis Commun Image Represent 51:1–13CrossRefGoogle Scholar
  29. 29.
    Tariq J, Kwong S, Yuan H (2016) HEVC intra mode selection based on rate distortion (RD) cost and sum of absolute difference (SAD). J Vis Commun Image Represent 35:112–119CrossRefGoogle Scholar
  30. 30.
    Tariq J, Kwong S, Yuan H (2017) Spatial/temporal motion consistency based MERGE mode early decision for HEVC. J Vis Commun Image Represent 44:198–213CrossRefGoogle Scholar
  31. 31.
    Ugur K, Andersson K, Fuldseth A, Bjontegaard G, Endresen LP, Lainema J, Hallapuro A et al (2010) High performance, low complexity video coding and the emerging HEVC standard. IEEE Trans Circ Syst Video Technol 20(12):1688–1697CrossRefGoogle Scholar
  32. 32.
    Wang L-L, Siu W-C (2013) Novel adaptive algorithm for intra prediction with compromised modes skipping and signaling processes in HEVC. IEEE Trans Circ Syste Vid Technol 23(10):1686–1694CrossRefGoogle Scholar
  33. 33.
    Wang P, Ni C, Zhang G, Li K (2017) R-Lambda model based CTU-level rate control for intra frames in HEVC. Multimed Tools Appl, 1–15Google Scholar
  34. 34.
    Yan Z, Cho S-Y, Welsen S (2019) Fast intra prediction mode decision for HEVC using random forest. In: 2019 Proceedings of the international conference on image, video and signal processing. ACM, pp 45–49Google Scholar
  35. 35.
    Yeh C-H, Li M-F, Chen M-J, Chi M-C, Huang X-X, Chi H-W (2014) Fast mode decision algorithm through inter-view rate-distortion prediction for multiview video coding system. IEEE Trans Indus Inform 10(1):594–603CrossRefGoogle Scholar
  36. 36.
    Zhang H, Ma Z (2012) Fast intra prediction for high efficiency video coding. In: Pacific-Rim conference on multimedia. Springer, Berlin, pp 568–577CrossRefGoogle Scholar
  37. 37.
    Zhang H, Ma Z (2014) Fast intra mode decision for high efficiency video coding (HEVC). IEEE Trans Circ Syst Vid Technol 24(4):660–668CrossRefGoogle Scholar
  38. 38.
    Zhang Y, Kwong S, Zhang G, Pan Z, Yuan H, Jiang G (2015) Low complexity HEVC INTRA coding for high-quality mobile video communication. IEEE Trans Indust Inform 11(6):1492–1504CrossRefGoogle Scholar
  39. 39.
    Zhang T, Sun M-T, Zhao D, Gao W (2017) Fast intra-mode and CU size decision for HEVC. IEEE Trans Circ Syst Video Technol 27(8):1714–1726CrossRefGoogle Scholar
  40. 40.
    Zhao L, Li Z, Ma S, Zhao D (2011) Fast mode decision algorithm for intra prediction in HEVC. In: 2011 IEEE Visual communications and image processing (VCIP). IEEE, pp 1–4Google Scholar
  41. 41.
    Zhao T, Kwong S, Wang H, Jay C-C, Kuo H (2012) 264/SVC mode decision based on optimal stopping theory. IEEE Trans Image Process 21(5):2607–2618MathSciNetCrossRefGoogle Scholar
  42. 42.
    Zhe S, Zhou D, Sun H, Goto S (2014) Low-complexity rate-distortion optimization algorithms for HEVC intra prediction. In: International conference on multimedia modeling. Springer, Cham, pp 541–552Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringHITEC UniversityTaxilaPakistan

Personalised recommendations