• Vlado MenkovskiEmail author
Part of the Springer Theses book series (Springer Theses)


Each chapter of this book provides a perspective on key aspects of the given QoE managment proposition. This final chapter, reflects on each of these contributions, their main points and how they tie-together to form an approach for addressing the challenges of QoE management. Here, the main conclusions of each chapter are summarized in the context of the motivation given for the QoE ‘learning’ management proposition, mainly that the complexity of the multimedia systems is increasing, along with the diversification of content, devices and the evolution in user expectations. Furthermore, it continues to discuss work in the community that builds upon or is closely related to the given proposition. Finally it presents few open questions and directions for the future work in this domain.


Video Quality Video Streaming Multimedia Service Error Concealment Restrict Boltzmann Machine 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    V. Menkovski, A. Oredope, A. Liotta, A. Sánchez, Predicting quality of experience in multimedia streaming, in Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia. ACM, 2009, pp. 52–59Google Scholar
  2. 2.
    F. Agboma, A. Liotta, Addressing user expectations in mobile content delivery. J. Mob. Inf. Syst. (special issue on Improving Quality of Service in Mobile Information Systems) 3(3), 153–164 (IOS Press, 2007)Google Scholar
  3. 3.
    M. Alhaisoni, A. Liotta, Characterization of signalling and traffic in joost. J. P2P Netw. Appl. (special issue on Modelling and Applications of Computational P2P) 2 75–83, (Springer, 2009). doi: 10.1007/s12083-008-0015-5, ISSN:1936-6450
  4. 4.
    M. Alhaisoni, A. Liotta, M. Ghanbari, Resource-awareness and trade-off optimization in P2P video streaming. Int. J. Adv. Media Commun. (special issue on High-Quality Multimedia Streaming in P2P Environments) 4(1), 59–77 (Inderscience Publishers, 2010) doi: 10.1504/IJAMC.2010.030005 ISSN:1741-8003
  5. 5.
    M. Alhaisoni, M. Ghanbari, A. Liotta, Localized multistreams for P2P streaming. Int. J. Digit. Multimedia Broadcast. 843574, 12. Hindawi 2010, (2010). doi: 10.1155/2010/843574
  6. 6.
    M. Alhaisoni, A. Liotta, M. Ghanbari, Scalable P2P video streaming, Int. J. Bus. Data Commun. Netw. 6(3), 49–65 (IGI Global, 2010) doi: 10.4018/jbdcn.2010070103 ISSN:1548-0631
  7. 7.
    V. Menkovski, G. Exarchakos, A. Liotta, The value of relative quality in video delivery. J. Mob. Multimedia 7(3), 151–162 (2011)Google Scholar
  8. 8.
    G. Exarchakos, L. Druda, V. Menkovski, P. Bellavista, A. Liotta, Skype resilience to high motion videos. Int. J. Wavelets, Multiresolut. Inf. Process. 11(3), 2013 (World Scientific Publishing).
  9. 9.
    F. Agboma, A. Liotta, Quality of experience management in mobile content delivery systems, J. Telecommun. Syst. (special issue on the Quality of Experience issues in Multimedia Provision) 49(1), 85-98 (Springer, 2012). doi: 10.1007/s11235-010-9355-6
  10. 10.
    V. Menkovski, G. Exarchakos, A. Liotta, A. Cuadra Sánchez, Quality of experience models for Multimedia Streaming. Int. J. Mob. Comput. Multimedia Commun. 2(4), 1–20 (IGI Global, Oct–Dec 2010). doi: 10.4018/jmcmc.2010100101 ISSN:1937-9412 (
  11. 11.
    M. Torres Vega, S. Zou, D. Constantin Mocanu, E. Tangdiongga, A.M.J. Koonen, A. Liotta, End-to-end performance evaluation in high-speed wireless networks, in proceedings of the 10th International Conference on Network and Service Management (Rio de Janeiro, Brazil, 17–21 Nov 2014)Google Scholar
  12. 12.
    A. Liotta, L. Druda, G. Exarchakos, V. Menkovski, Quality of experience management for video streams: the case of skype, in proceedings of the 10th International Conference on Advances in Mobile Computing and Multimedia, Bali, Indonesia, 3–5 Dec 2012 (ACM).
  13. 13.
    G. Exarchakos, V. Menkovski, A. Liotta, Can skype be used beyond video calling?, in proceedings of the 9th International Conference on Advances in Mobile Computing and Multimedia, Ho Chi Minh City (Vietnam, 5–7 Dec 2011) (ACM)Google Scholar
  14. 14.
    V. Menkovski, G. Exarchakos, A. Liotta, Tackling the sheer scale of subjective QoE, in Proceedings of 7th International ICST Mobile Multimedia Communications Conference, Cagliari, Italy, 5–7 Sept 2011 (Springer, Lecture Notes of ICST, 2012), vol. 29, pp. 1–15 doi: 10.1007/978-3-642-30419-4_1.
  15. 15.
    J. Okyere-Benya, M. Aldiabat, V. Menkovski, G. Exarchakos, A. Liotta, Video quality degradation on IPTV networks, in Proceedings of International Conference on Computing, Networking and Communications, Maui, Hawaii, USA, Jan 30–Feb 2, 2012 (IEEE)Google Scholar
  16. 16.
    K. Yaici, A. Liotta, H. Zisimopoulos, T. Sammut, User-centric quality of service management in UMTS, in Proceedings of the 4th Latin American Network Operations and Management Symposium (LANOMS’05), Porto Alegre, Brazil, 29–31 Aug 2005 (Springer)Google Scholar
  17. 17.
    F. Agboma, A. Liotta, User-centric assessment of mobile content delivery, in Proceedings of the 4th International Conference on Advances in Mobile Computing and Multimedia, (Yogyakarta, Indonesia, 4–6 Dec 2006)Google Scholar
  18. 18.
    F. Agboma, A. Liotta, Managing the user’s quality of experience. in Proceedings of the second IEEE/IFIP International Workshop on Business-driven IT Management (BDIM 2007). Munich, Germany, 21th May 2007 (IEEE)Google Scholar
  19. 19.
    F. Agboma, M. Smy, A. Liotta, QoE analysis of a peer-to-peer television system, in Proceedings of the International Conference on Telecommunications, Networks and Systems (Amsterdam, Netherlands, 22–24 July 2008)Google Scholar
  20. 20.
    F. Agboma, A. Liotta, QoE-aware QoS management, in Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (Linz, Austria, 24–26 Nov 2008)Google Scholar
  21. 21.
    W. Hendee, P. Wells, The perception of visual information (Springer, 1997)Google Scholar
  22. 22.
    J. Li, Visual progressive coding, in SPIE proceedings series. Society of Photo-Optical Instrumentation Engineers, 1998, pp. 1143–1154Google Scholar
  23. 23.
    A. Watson, L. Kreslake, Measurement of visual impairment scales for digital video, in Proceedings of SPIE Human Vision, Visual Processing, and Digital Display, vol. 4299 (2001)Google Scholar
  24. 24.
    V. Menkovski, G. Exarchakos, A. Liotta, A. Sánchez, Measuring quality of experience on a commercial mobile tv platform, in IEEE Second International Conferences on Advances in Multimedia (MMEDIA), pp. 33–38 (2010)Google Scholar
  25. 25.
    V. Menkovski, G. Exarchakos, A. Liotta, Online QoE prediction, in Proceedings of the 2nd IEEE International Workshop on Quality of Multimedia Experience, Trondheim, Norway, June 21–23, 2010 (IEEE)Google Scholar
  26. 26.
    V. Menkovski, A. Oredope, A. Liotta, A. Cuadra-Sanchez, Optimized online learning for QoE prediction, in Proceedings of the 21st Benelux Conference on Artificial Intelligence, Eindhoven, The Netherlands, 29–30 Oct 2009., 169–176, ISSN:1568-7805
  27. 27.
    V. Menkovski, G. Exarchakos, A. Liotta, Online learning for quality of experience management, in Proceedings of the annual machine learning conference of Belgium and The Netherlands, Leuven, Belgium, May 27th–28th, 2010.
  28. 28.
    V. Menkovski, A. Liotta, Adaptive psychometric scaling for video quality assessment. J. Signal Process.: Image Commun. 26(8), 788–799 (Elsevier, 2012).
  29. 29.
    V. Menkovski, G. Exarchakos, A. Liotta, Machine learning approach for quality of experience aware networks, in Proceedings of Computational Intelligence in Networks and Systems, Thessaloniki, Greece, 24–26 Nov 2010 (IEEE)Google Scholar
  30. 30.
    V. Menkovski, G. Exarchakos, A. Liotta, Adaptive testing for video quality assessment, in Proceedings of Quality of Experience for Multimedia Content Sharing, Lisbon, Portugal, 29 June 2011 (ACM)Google Scholar
  31. 31.
    A. Liotta, D. Constantin Mocanu, V. Menkovski, L. Cagnetta, G. Exarchakos, Instantaneous video quality assessment for lightweight devices, in Proceedings of the 11th International Conference on Advances in Mobile Computing and Multimedia, Vienna, Austria, 2–4 Dec 2013 (ACM).
  32. 32.
    D. Constantin Mocanu, G. Exarchakos, H.B. Ammar, A. Liotta, Reduced reference image quality assessment via Boltzmann machines, in Proceedings of the 3rd IEEE/IFIP IM 2015 International Workshop on Quality of Experience Centric Management, Ottawa, Canada, 11–15 May 2015 (IEEE)Google Scholar
  33. 33.
    M. Torres Vega, D. Constantin Mocanu, R. Barresi, G. Fortino, A. Liotta, Cognitive streaming on android devices, in Proceedings of the 1st IEEE/IFIP IM 2015 International Workshop on Cognitive Network & Service Management, Ottawa, Canada, 11–15 May, 2015 (IEEE).
  34. 34.
    M. Torres Vega, E. Giordano, D. C. Mocanu, D. Tjondronegoro, A. Liotta, Cognitive no-reference video quality assessment for mobile streaming services, in Proceedings of the 7th International Workshop on Quality of Multimedia Experience, Messinia, Greece, 26–29 May 2015 (IEEE).
  35. 35.
    V. Menkovski, G. Exarchakos, A. Liotta, A. Sánchez, Estimations and remedies for quality of experience in multimedia streaming, in IEEE Third International Conference on Advances in Human-Oriented and Personalized Mechanisms, Technologies and Services (CENTRIC), 2010, 2010, pp. 11–15Google Scholar
  36. 36.
    S. Winkler, On the properties of subjective ratings in video quality experiments, in IEEE International Workshop on Quality of Multimedia Experience, QoMEx 2009, pp. 139–144 (2009)Google Scholar
  37. 37.
    S. Winkler, P. Mohandas, The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans. Broadcast. 54(3), 660668 (2008).
  38. 38.
    K. Seshadrinathan, R. Soundararajan, A. Bovik, L. Cormack, A subjective study to evaluate video quality assessment algorithms, in SPIE Proceedings Human Vision and Electronic Imaging, vol. 7527 (Citeseer, 2010)Google Scholar
  39. 39.
    P. Corriveau, C. Gojmerac, B. Hughes, L. Stelmach, All subjective scales are not created equal: the effects of context on different scales. Signal Process 77(1), 1–9 (1999)CrossRefzbMATHGoogle Scholar
  40. 40.
    V. Menkovski, G. Exarchakos, A. Liotta, Tackling the sheer scale of subjective QoE, in Mobile Multimedia Communications (Springer, 2012) pp. 1–15Google Scholar
  41. 41.
    V. Menkovski, A. Liotta, Adaptive psychometric scaling for video quality assessment, Signal Processing: Image Communication, 2012Google Scholar
  42. 42.
    V. Menkovski, A. Liott, QoE for mobile streaming, in Mobile Multimedia—User and Technology Perspectives, ed. by D. Tjondronegoro (InTech, 2012).
  43. 43.
    V. Menkovski, G. Exarchakos, A. Liotta, A. C. Sánchez, Quality of experience models for multimedia streaming, in Advancing the Next-Generation of Mobile Computing: Emerging Technologies: Emerging Technologies, p. 112, 2012Google Scholar
  44. 44.
    J. Chakareski, B. Girod, Rate-distortion optimized video streaming over internet packet traces, in IEEE International Conference on Image Processing, 2005. ICIP 2005, vol. 2 (2005), pp. II–161Google Scholar
  45. 45.
    D. Jarnikov, T. Özçelebi, Client intelligence for adaptive streaming solutions. Signal Process.: Image Commun. 26(7), 378–389 (2011)Google Scholar
  46. 46.
    V. Menkovski, A. Liotta, Intelligent control for adaptive video streaming, in Proceedings of the international conference on consumer electronics (Las Vegas, 2013)Google Scholar
  47. 47.
    V. Menkovski, Computational inference and control of quality in multimedia services, Ph.D. dissertation, Ph.D. Thesis, University of Eindhoven, 2013. ISBN: 978-90-386-3355-8Google Scholar
  48. 48.
    W. Song, D. W. Tjondronegoro, M. Docherty, in Understanding user experience of mobile video: framework, measurement, and optimization (INTECH Open Access Publisher, 2012)Google Scholar
  49. 49.
    W. Song, D.W. Tjondronegoro, Acceptability-based qoe models for mobile video. IEEE Trans. Multimedia 16(3), 738–750 (2014)CrossRefGoogle Scholar
  50. 50.
    K. Mitra, A. Zaslavsky, C. Ahlund, Context-aware QoE modelling, measurement and prediction in mobile computing systems (2013)Google Scholar
  51. 51.
    S. Ickin, M. Fiedler, K. Wac, P. Arlos, C. Temiz, K. Mkocha, Electronic research archive of blekinge institute of technology (2014)Google Scholar
  52. 52.
    S. Ickin, M. Fiedler, K. Wac, P. Arlos, C. Temiz, K. Mkocha, VLQoE: Video QoE instrumentation on the smartphone, in Multimedia Tools and Applications, pp. 1–31, 2014Google Scholar
  53. 53.
    P. A. Kara, L. Bokor, and S. Imre, Analysis of assessment alteration phenomena of subjective quality of experience measurements in 2d and 3d mobile video services (2014)Google Scholar
  54. 54.
    N. Staelens, J. De Meulenaere, M. Claeys, G. Van Wallendael, W. Van den Broeck, J. De Cock, R. Van de Walle, P. Demeester, F. De Turck, Subjective Quality Assessment of Longer Duration Video Sequences Delivered Over http Adaptive Streaming to Tablet Devices (2014)Google Scholar
  55. 55.
    F. Surez, A. Garca, J. Granda, D. Garca, and P. Nuo, Assessing the QoE in video services over lossy networks. J. Netw. Syst. Manag. 1–24 (2015).
  56. 56.
    D. C. Mocanu, A. Liotta, A. Ricci, M. T. Vega, G. Exarchakos, When does lower bitrate give higher quality in modern video services?, in IEEE Network Operations and Management Symposium (NOMS), 2014 (2014) pp. 1–5Google Scholar
  57. 57.
    G. Exarchakos, L. Druda, V. Menkovski, A. Liotta, I. Khalil, I. Khalil, Network analysis on skype end-to-end video quality. Int. J. Pervasive Comput. Commun. 11(1) (2015)Google Scholar
  58. 58.
    R. K. Mok, X. Luo, E. W. Chan, R. K. Chang, Qdash: a QoE-aware dash system, in Proceedings of the 3rd Multimedia Systems Conference (ACM, 2012) pp. 11–22Google Scholar
  59. 59.
    J. van der Hooft, S. Petrangeli, M. Claeys, J. Famaey, F. De Turck, A learning-based algorithm for improved bandwidth-awareness of adaptive streaming clients (2015), pp. 131–138Google Scholar
  60. 60.
    S. Petrangeli, M. Claeys, S. Latré, J. Famaey, and F. De Turck, A multi-agent q-learning-based framework for achieving fairness in http adaptive streaming, in IEEE Network Operations and Management Symposium (NOMS), 2014 (2014), pp. 1–9Google Scholar
  61. 61.
    M. Claeys, S. Latré, J. Famaey, T. Wu, W. Van Leekwijck, F. De Turck, Design and optimisation of a (fa) q-learning-based http adaptive streaming client. Connection Sci. 26(1), 25–43 (2014)CrossRefGoogle Scholar
  62. 62.
    S. Tavakoli, J. Gutiérrez, N. Garcia, Subjective quality study of adaptive streaming of monoscopic and stereoscopic video. IEEE J. Sel. Areas Commun. 32(4), 684–692 (2014)CrossRefGoogle Scholar
  63. 63.
    B. Vankeirsbilck, T. Verbelen, D. Verslype, N. Staelens, F. De Turck, P. Demeester, B. Dhoedt, Quality of experience driven control of interactive media stream parameters, in IEEE International Symposium on Integrated Network Management IFIP/IEEE (IM, 2013), pp. 1282–1287 (2013)Google Scholar
  64. 64.
    A. Liotta, Farewell to deterministic networks, in IEEE 19th Symposium on Communications and Vehicular Technology in the Benelux (SCVT), 2012, pp. 1–4 (2012)Google Scholar
  65. 65.
    A. Liotta, The cognitive net is coming, IEEE Spectr. 50(8), 26–31, Aug 2013 (IEEE).
  66. 66.
    C. Ragusa, A. Liotta, G. Pavlou, An adaptive clustering approach for the management of dynamic systems. IEEE J. Sel. Areas Commun. (JSAC), (special issue on Autonomic Communication Systems) 23(12), 2223–2235, IEEE, Dec 2005 (IF 4.138; SJR 3.34).
  67. 67.
    J. Zhang, N. Ansari, On assuring end-to-end QoE in next generation networks: challenges and a possible solution. IEEE Commun. Mag. 49(7), 185–191 (2011)CrossRefGoogle Scholar
  68. 68.
    D. C. Mocanu, G. Santandrea, W. Cerroni, F. Callegati, A. Liotta, Network performance assessment with quality of experience benchmarks, in IEEE 10th International Conference onNetwork and Service Management (CNSM), 2014 (2014), pp. 332–335Google Scholar
  69. 69.
    K.D. Teket, M. Sayit, G. Kardas, Software agents for peer-to-peer video streaming. IET Softw. 8(4), 184–192 (2014)CrossRefGoogle Scholar
  70. 70.
    R. K. Mok, E. W. Chan, X. Luo, R. K. Chang, Inferring the qoe of http video streaming from user-viewing activities, in Proceedings of the first ACM SIGCOMM workshop on Measurements up the stack, (ACM, 2011), pp. 31–36Google Scholar
  71. 71.
    J. Deng, L. Zhang, J. Hu, D. He, Adaptation of Ann Based Video Stream Qoe Prediction Model. Advances Multimedia Information Processing-PCM (Springer, 2014), pp. 313–322Google Scholar
  72. 72.
    D. C. Mocanu, G. Exarchakos, A. Liotta, Deep learning for objective quality assessment of 3d images (IEEE Service Center, 2014)Google Scholar
  73. 73.
    V. Mnih, K. Kavukcuoglu, D. Silver, A.A. Rusu, J. Veness, M.G. Bellemare, A. Graves, M. Riedmiller, A.K. Fidjeland, G. Ostrovski et al., Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Philips ResearchEindhovenThe Netherlands

Personalised recommendations