Personalized Content Adaptation Using Multimodal Highlights of Soccer Video

  • Shenghong Hu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6297)


The personalized video adaptation may be the most inspiring weapon to solve the contradiction between the optimized unified accessing in internet occupied by massive video contents and limited client’s resources, but how to predict semantic utility which links the semantic contents to video adaptation is not a well settled problem. The primary contributions of the paper include following. The multimodal highlights of soccer video are extracted with the affective content analysis; a unified semantic utility model for multi-level summary and frame dropping based transcoding; a Multiple-choice Multi-dimensional Knapsack Problem (MMKP) is proposed to solve the optimized semantic utility for personalized adaptation under the constraints of client’s resources. The experimental results show that our method on multimodal highlights has achieved reasonable accuracy among most of semantic events, and MMKP based solution proves better performance on optimized semantic events consumption than 0/1 Knapsack Problem (0/1KP) based solution.


Personalized content adaptation multimodal highlight semantic utility Multiple-Choice Multi-dimensional Knapsack Problem 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chang, S.-F., Vetro, A.: Video Adaptation: Concepts, Technologies, and Open Issues. Proceedings of the IEEE 93, 148–158 (2005)CrossRefGoogle Scholar
  2. 2.
    Kim, J.-G., Wang, Y., Chang, S.-F., Kim, H.-M.: An Optimal Framework of Video Adaptation and Its Application to Rate Adaptation Transcoding. ETRI Journal 27, 341–354 (2005)CrossRefGoogle Scholar
  3. 3.
    Wang, Y., Kim, J.-G., Chang, S.-F., Kim, H.-M.: Utility-Based Video Adaptation for Universal Multimedia Access (UMA) and Content-Based Utility Function Prediction for Real-Time Video Transcoding. IEEE Transactions on Multimedia 9, 213–220 (2007)CrossRefGoogle Scholar
  4. 4.
    Prangl, M., Szkaliczki, T., Hellwagner, H.: A Framework for Utility-Based Multimedia Adaptation. IEEE Transactions on Circuits and Systems for Video Technology 17, 719–728 (2007)CrossRefGoogle Scholar
  5. 5.
    Herranz, L., Martínez, J.M.: An integrated approach to summarization and adaptation using H.264/MPEG-4 SVC. Signal Processing: Image Communication 24, 499–509 (2009)CrossRefGoogle Scholar
  6. 6.
    Xu, M., Jin, J.S., Luo, S.: Personalized Video Adaptation Based on Video Content Analysis. In: MDM/KDD 2008, pp. 26–35. ACM, New York (2008)Google Scholar
  7. 7.
    Changsheng, X., Jian, C., Yi, Z., Yifan, Z., Hanqing, L.: Sports Video Analysis: Semantics Extraction, Editorial Content Creation and Adaptation. Journal of Multimedia 4, 69–79 (2009)Google Scholar
  8. 8.
    Chao, L., Yu, J., Jiang, C., Changsheng, X., Xiaowei, L., Jinqiao, W., Yu, F., Lu, H., Jiang, M.: Personalized Sports Video Customization for Mobile Devices. In: Boll, S., Tian, Q., Zhang, L., Zhang, Z., Chen, Y.-P.P. (eds.) MMM 2010. LNCS, vol. 5916, pp. 614–625. Springer, Heidelberg (2010)Google Scholar
  9. 9.
    Wei, Y., Bhandarkar, S., Li, K.: Video personalization in resource-constrained multimedia environments. In: ACM Multimedia, pp. 902–911. ACM, New York (2007)Google Scholar
  10. 10.
    Hanjalic, A.: Adaptive extraction of highlights from a sport video based on excitement modeling. IEEE Transactions on Multimedia 7, 1114–1122 (2005)CrossRefGoogle Scholar
  11. 11.
    Wheeler, E.S.: Zipf’s Law and Why It Works Everywhere. Glottometrics 4, 45–48 (2002)Google Scholar
  12. 12.
    Khan, S., Li, K.F., Manning, E.G., Akbar, M.M.: Solving the Knapsack Problem for Adaptive Multimedia Systems. Studia Informatica Universalis 2, 61–82 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Shenghong Hu
    • 1
    • 2
  1. 1.School of Computer Science & TechnologyHuazhong University of Science & TechnologyWuhanChina
  2. 2.Computer SchoolHubei University of EconomicsWuhanChina

Personalised recommendations