Shaping-Up Multimedia Analytics: Needs and Expectations of Media Professionals

  • Guillaume Gravier
  • Martin Ragot
  • Laurent AmsalegEmail author
  • Rémi Bois
  • Grégoire Jadi
  • Éric Jamet
  • Laura Monceaux
  • Pascale Sébillot
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9517)


This paper is intended to help clarifying what multimedia analytics encompasses by studying users expectations. As a showcase, we focus on the very specific family of applications doing search and navigation of broadcast and social news content. This paper is first describing what professional practitioners working with news currently do. Thanks to extensive conversations with media professionals, mockup interfaces and a human-centered design methodology, we analyze the perceived usefulness of a number of functionalities leveraging existing or upcoming technologies. This analysis helps (i) determining research directions for the technology underpinning the very recent field of (multi)media analytics and (ii) understanding how multimedia analytics should be defined. In particular, dependency to the domain is discussed: are multimedia analytics tasks domain-specific or can we find general definitions?



This work was funded via the CominLabs excellence laboratory financed by the National Research Agency under reference ANR-10-LABX-07-01.


  1. 1.
    Agarwal, R., Prasad, A.: A conceptual and operational definition of personal innovativeness in the domain of information technology. Inf. Syst. Res. 9(2), 204–215 (1998)CrossRefGoogle Scholar
  2. 2.
    Atif, J., Hudelot, C., Bloch, I.: Explanatory reasoning for image understanding using formal concept analysis and description logics. IEEE Trans. Syst. Man Cybern. Syst. 44(5), 552–570 (2014)CrossRefGoogle Scholar
  3. 3.
    Davis, F.D., Bagozzi, R.P., Warshaw, P.R.: User acceptance of computer technology: a comparison of two theoretical models. Manage. Sci. 35(8), 982–1003 (1989)CrossRefGoogle Scholar
  4. 4.
    Ding, D., Metze, F., Rawat, S., Schulam, P.F., Burger, S., Younessian, E., Bao, L., Christel, M.G., Hauptmann, A.: Beyond audio and video retrieval: towards multimedia summarization. In: Proceedings of the ACM International Conference on Multimedia Retrieval (2012)Google Scholar
  5. 5.
    Eskevich, M., Jones, G.J.F., Aly, R., et al.: Multimedia information seeking through search and hyperlinking. In: ACM International Conference on Multimedia Retrieval (2013)Google Scholar
  6. 6.
    Fraisse, A., Paroubek, P.: Toward a unifying model for opinion, sentiment and emotion information extraction. In: International Conference on Language Resources and Evaluation (2014)Google Scholar
  7. 7.
    Ghoniem, M., Luo, D., Yang, J., Ribarsky, W.: NewsLab: exploratory broadcast news video analysis. In: IEEE Symposium on Visual Analytics Science and Technology, pp. 123–130 (2007)Google Scholar
  8. 8.
    Hauptmann, A.G., Witbrock, M.J.: Informedia: news-on-demand multimedia information acquisition and retrieval. In: Intelligent Multimedia Information Retrieval, pp. 215–239 (1997)Google Scholar
  9. 9.
    Ide, I., Mo, H., Katayama, N., Satoh, S.: Topic threading for structuring a large-scale news video archive. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A.F., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 123–131. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  10. 10.
    Jiang, H.: Confidence measures for speech recognition: a survey. Speech Commun. 45(4), 455–470 (2005)CrossRefGoogle Scholar
  11. 11.
    Jónsson, B.T., Eiríksdóttir, Á., Waage, Ó., Tómasson, G.,Sigurthórsson, H., Amsaleg, L.: M3+ p3+ o3= multi-d photo browsing. In: MultiMedia Modeling, pp. 378–381 (2014)Google Scholar
  12. 12.
    Lee, H., Smeaton, A.F., O’Connor, N.E., Smyth, B.: User evaluation of Físchlár-news: an automatic broadcast news delivery system. ACM Trans. Inf. Syst. 24(2), 145–189 (2006)CrossRefGoogle Scholar
  13. 13.
    Merlino, A., Morey, D., Maybury, M.: Broadcast news navigation using story segmentation. In: ACM International Conference on Multimedia, pp. 381–391 (1997)Google Scholar
  14. 14.
    Mikolov, T., Yih, W.-T., Zweig, G.: Linguistic regularities in continuous space word representations. In: HLT-NAACL, pp. 746–751 (2013)Google Scholar
  15. 15.
    Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, CHI 1993, pp. 206–213. ACM, New York (1993)Google Scholar
  16. 16.
    Poignant, J., Bredin, H., Barras, C.: Multimodal person discovery in broadcast tv at mediaeval 2015. In: Working Notes Proceedings of MediaEval 2015 Workshop (2015)Google Scholar
  17. 17.
    Ratkiewicz, J., Conover, M., Meiss, M., Gonçalves, B., Flammini, A., Menczer, F.: Detecting and tracking political abuse in social media. In: ICWSM (2011)Google Scholar
  18. 18.
    Rizzo, G., Troncy, R.: NERD: a framework for unifying named entity recognition and disambiguation web extraction tools. In: Conference of the European Chapter of the Association for Computational Linguistics (2012)Google Scholar
  19. 19.
    Sakaki, T., Okazaki, M., Matsuo, Y.: Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th International Conference on World Wide Web, pp. 851–860. ACM (2010)Google Scholar
  20. 20.
    Turian, J., Ratinov, L., Bengio, Y.: Word representations: a simple and general method for semi-supervised learning. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 384–394 (2010)Google Scholar
  21. 21.
    Wu, X., Ngo, C.-W., Li, Q.: Threading and autodocumenting news videos: a promising solution to rapidly browse news topics. IEEE Signal Process. Mag. 23(2), 59–68 (2006)CrossRefGoogle Scholar
  22. 22.
    Zeng, D., Chen, H., Lusch, R., Li, S.-H.: Social media analytics and intelligence. IEEE J. Intell. Syst. 25(6), 13–16 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Guillaume Gravier
    • 1
  • Martin Ragot
    • 3
  • Laurent Amsaleg
    • 1
    Email author
  • Rémi Bois
    • 1
  • Grégoire Jadi
    • 4
  • Éric Jamet
    • 3
  • Laura Monceaux
    • 4
  • Pascale Sébillot
    • 2
  1. 1.CNRSIRISA and Inria RennesRennesFrance
  2. 2.INSA RennesIRISA and Inria RennesRennesFrance
  3. 3.Univ. Rennes 2, CRPCCRennesFrance
  4. 4.Univ. Nantes, LINANantesFrance

Personalised recommendations