Modeling Request Patterns in VoD Services with Recommendation Systems

  • Samarth Gupta
  • Sharayu MoharirEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10340)


Video on Demand (VoD) services like Netflix and YouTube account for ever increasing fractions of Internet traffic. It is estimated that this fraction will cross \(80\%\) in the next three years. Most popular VoD services have recommendation engines which recommend videos to users based on their viewing history, thus introducing time-correlation in user requests. Understanding and modeling this time-correlation in user requests is critical for network traffic engineering. The primary goal of this work is to use empirically observed properties of user requests to model the effect of recommendation engines on request patterns in VoD services. We propose a Markovian request model to capture the time-correlation in user requests and show that our model is consistent with the observations of existing empirical studies.

Most large-scale VoD services deliver content to users via a distributed network of servers as serving users requests via geographically co-located servers reduces latency and network bandwidth consumption. The content replication policy, i.e., determining which contents to cache on the servers is a key resource allocation problem for VoD services. Recent studies show that low start-up delay is a key Quality of Service (QoS) requirement of users of VoD services. This motivates the need to pre-fetch (fetch before contents are requested) and cache content likely to be requested in the near future. Since pre-fetching leads to an increase in the network bandwidth usage, we use our Markovian model to explore the trade-offs and feasibility of implementing recommendation based pre-fetching.


  1. 1.
    Adamic, L.A., Huberman, B.A.: Zipfs law and the internet. Glottometrics 3(1), 143–150 (2002)Google Scholar
  2. 2.
    Albert, R., Barabási, A.L.: Statistical mechanics of complex networks. Rev. Mod. Phys. 74(1), 47 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Bollobás, B., Borgs, C., Chayes, J., Riordan, O.: Directed scale-free graphs. In: Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 132–139. Society for Industrial and Applied Mathematics (2003)Google Scholar
  4. 4.
    Breslau, L., Cao, P., Fan, L., Phillips, G., Shenker, S.: Web caching and Zipf-like distributions: evidence and implications. In: Proceedings of Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM 1999, vol. 1, pp. 126–134. IEEE (1999)Google Scholar
  5. 5.
    Cheng, X., Dale, C., Liu, J.: Understanding the characteristics of internet short video sharing: Youtube as a case study. arXiv preprint arXiv:0707.3670 (2007)
  6. 6.
    Cheng, X., Liu, J.: NetTube: exploring social networks for peer-to-peer short video sharing. In: INFOCOM 2009, pp. 1152–1160. IEEE (2009)Google Scholar
  7. 7.
  8. 8.
    Davidson, J., Liebald, B., Liu, J., Nandy, P., Van Vleet, T., Gargi, U., Gupta, S., He, Y., Lambert, M., Livingston, B., et al.: The youtube video recommendation system. In: Proceedings of the Fourth ACM Conference on Recommender Systems, pp. 293–296. ACM (2010)Google Scholar
  9. 9.
    Du, M., Kihl, M., Arvidsson, Å., Lagerstedt, C., Gawler, A.: Analysis of prefetching schemes for TV-on-demand service. In: The Tenth International Conference on Digital Telecommunications, ICDT 2015. International Academy, Research and Industry Association (IARIA) (2015)Google Scholar
  10. 10.
    Fricker, C., Robert, P., Roberts, J., Sbihi, N.: Impact of traffic mix on caching performance in a content-centric network. In: 2012 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), pp. 310–315. IEEE (2012)Google Scholar
  11. 11.
    Gupta, S., Moharir, S.: Request patterns and caching in VoD services with recommendation systems. In: COMSNETS (2017)Google Scholar
  12. 12.
    Iamnitchi, A., Ripeanu, M., Foster, I.: Small-world file-sharing communities. In: Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM 2004, vol. 2, pp. 952–963. IEEE (2004)Google Scholar
  13. 13.
    Khemmarat, S., Zhou, R., Krishnappa, D.K., Gao, L., Zink, M.: Watching user generated videos with prefetching. Sig. Process. Image Commun. 27(4), 343–359 (2012)CrossRefGoogle Scholar
  14. 14.
    Krishnan, S.S., Sitaraman, R.K.: Video stream quality impacts viewer behavior: inferring causality using quasi-experimental designs. IEEE/ACM Trans. Networking 21(6), 2001–2014 (2013)CrossRefGoogle Scholar
  15. 15.
    Krishnappa, D.K., Khemmarat, S., Gao, L., Zink, M.: On the feasibility of prefetching and caching for online TV services: a measurement study on Hulu. In: Spring, N., Riley, G.F. (eds.) PAM 2011. LNCS, vol. 6579, pp. 72–80. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-19260-9_8 CrossRefGoogle Scholar
  16. 16.
    Krishnappa, D.K., Zink, M., Griwodz, C., Halvorsen, P.: Cache-centric video recommendation: an approach to improve the efficiency of youtube caches. ACM Trans. Multimed. Comput. Commun. Appl. (TOMM) 11(4), 48 (2015)Google Scholar
  17. 17.
    Liang, K., Hao, J., Zimmermann, R., Yau, D.K.: Integrated prefetching and caching for adaptive video streaming over HTTP: an online approach. In: Proceedings of the 6th ACM Multimedia Systems Conference, pp. 142–152. ACM (2015)Google Scholar
  18. 18.
    Liu, Y., Li, F., Guo, L., Shen, B., Chen, S.: A server’s perspective of internet streaming delivery to mobile devices. In: 2012 Proceedings of INFOCOM, pp. 1332–1340. IEEE (2012)Google Scholar
  19. 19.
    Liu, Y., Li, F., Guo, L., Shen, B., Chen, S., Lan, Y.: Measurement and analysis of an internet streaming service to mobile devices. IEEE Trans. Parallel Distrib. Syst. 24(11), 2240–2250 (2013)CrossRefGoogle Scholar
  20. 20.
    Moharir, S., Ghaderi, J., Sanghavi, S., Shakkottai, S.: Serving content with unknown demand: the high-dimensional regime. In: ACM SIGMETRICS (2014)Google Scholar
  21. 21.
  22. 22.
    Pleşca, C., Charvillat, V., Ooi, W.T.: Multimedia prefetching with optimal Markovian policies. J. Netw. Comput. Appl. 69, 40–53 (2016)CrossRefGoogle Scholar
  23. 23.
    Suman, S., Shubham, S.: Understanding the characteristic of youtube video graph (2016).
  24. 24.
    Veloso, E., Almeida, V., Meira, W., Bestavros, A., Jin, S.: A hierarchical characterization of a live streaming media workload. In: Proceedings of the 2nd ACM SIGCOMM Workshop on Internet Measurment, pp. 117–130. ACM (2002)Google Scholar
  25. 25.
    Wang, J.: A survey of web caching schemes for the internet. ACM SIGCOMM Comput. Commun. Rev. 29(5), 36–46 (1999)CrossRefGoogle Scholar
  26. 26.
    Watts, D.J., Strogatz, S.H.: Collective dynamics of small-world networks. Nature 393(6684), 440–442 (1998)CrossRefzbMATHGoogle Scholar
  27. 27.
  28. 28.
    Yu, H., Zheng, D., Zhao, B.Y., Zheng, W.: Understanding user behavior in large-scale video-on-demand systems. ACM SIGOPS Oper. Syst. Rev. 40, 333–344 (2006). ACMCrossRefGoogle Scholar
  29. 29.
    Zhou, R., Khemmarat, S., Gao, L.: The impact of youtube recommendation system on video views. In: Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement, pp. 404–410. ACM (2010)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Electrical EngineeringIndian Institute of Technology BombayMumbaiIndia

Personalised recommendations