Advertisement

Multimedia Tools and Applications

, Volume 63, Issue 2, pp 331–356 | Cite as

Finding a needle in a haystack: an interactive video archive explorer for professional video searchers

  • Mieke Haesen
  • Jan Meskens
  • Kris Luyten
  • Karin Coninx
  • Jan Hendrik Becker
  • Tinne Tuytelaars
  • Gert-Jan Poulisse
  • Phi The Pham
  • Marie-Francine Moens
Article

Abstract

Professional video searchers typically have to search for particular video fragments in a vast video archive that contains many hours of video data. Without having the right video archive exploration tools, this is a difficult and time consuming task that induces hours of video skimming. We propose the video archive explorer, a video exploration tool that provides visual representations of automatically detected concepts to facilitate individual and collaborative video search tasks. This video archive explorer is developed by employing a user-centred methodology, which ensures that the tool is more likely to fit to the end user needs. A qualitative evaluation with professional video searchers shows that the combination of automatic video indexing, interactive visualisations and user-centred design can result in an increased usability, user satisfaction and productivity.

Keywords

Searching and browsing video archives Information filtering User-centred software engineering Interactive visualisations 

Notes

Acknowledgements

This research was supported by the IWT Project AMASS+ + (SBO-060051). We would like to thank all members of the AMASS+ + user committee for their feedback about the results discussed during the half-yearly user committee meetings. Special thanks to the Flemish broadcasting company VRT to contribute to the user studies. Grateful acknowledgement is given to Koen Deschacht, Wim De Smet, Scott Martens, Ineke Schuurman, Vincent Vandeghinste, Frank Van Eynde and Luc Van Gool. Furthermore, we would like to thank Jimmy Cleuren for his contribution to the high-fidelity prototypes and Karel Robert for the graphic design of the user interface.

References

  1. 1.
    Adcock J, Cooper M, Pickens J (2008) Experiments in interactive video search by addition and subtraction. In: Proceedings of the 2008 international conference on content-based image and video retrieval, CIVR ’08, pp 465–474. ACM, New York, NY, USACrossRefGoogle Scholar
  2. 2.
    Arnowitz J, Arent M, Berger N (2006) Effective prototyping for software makers (the Morgan Kaufmann series in interactive technologies). Morgan Kaufmann, San Francisco, CA, USAGoogle Scholar
  3. 3.
    Beyer H, Holtzblatt K (1998) Contextual design: defining customer-centered systems. Morgan Kaufmann. ISBN: 1-55680-411-1Google Scholar
  4. 4.
    Boreczky J, Girgensohn A (2000) Gene Golovchinsky, and Shingo Uchihashi. An interactive comic book presentation for exploring video. In: CHI ’00: proceedings of the SIGCHI conference on human factors in computing systems, pp 185–192. ACM, New York, NY, USACrossRefGoogle Scholar
  5. 5.
    Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan KaufmannGoogle Scholar
  6. 6.
    Cheng K-Y, Luo S-J, Chen B-Y, Chu H-H (2009) Smartplayer: user-centric video fast-forwarding. In: CHI ’09: proceedings of the 27th international conference on human factors in computing systems, pp 789–798. ACM, New York, NY, USACrossRefGoogle Scholar
  7. 7.
    Christel MG (2008) Supporting video library exploratory search: when storyboards are not enough. In: CIVR ’08: proceedings of the 2008 international conference on content-based image and video retrieval, pp 447–456. ACM, New York, NY, USACrossRefGoogle Scholar
  8. 8.
    Christel MG, Smith MA, Taylor CR, Winkler DB (1998) Evolving video skims into useful multimedia abstractions. In: CHI ’98: proceedings of the SIGCHI conference on human factors in computing systems, pp 171–178. ACM Press/Addison-Wesley, New York, NY, USACrossRefGoogle Scholar
  9. 9.
    Cilella S (2011) Did you ever know that you’re my hero?: the power of storytelling. Interactions 18:62–66CrossRefGoogle Scholar
  10. 10.
    Dragicevic P, Ramos G, Bibliowitcz J, Nowrouzezahrai D, Balakrishnan R, Singh K (2008) Video browsing by direct manipulation. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, CHI ’08, pp 237–246. ACM, USA, New York, NYCrossRefGoogle Scholar
  11. 11.
    Grün C, Gerken J, Jetter H-C, König WA, Reiterer H (2005) Mediovis—a user-centred library metadata browser. In: ECDL 2005: proceedings of the 9th European conference on research and advanced technology for digital libraries 2005, pp 174–185. SpringerGoogle Scholar
  12. 12.
    Haesen M, Coninx K, Van den Bergh J, Luyten K (2008) Muicser: a process framework for multi-disciplinary user-centred software engineering processes. In: HCSE ’08: second conference on human-centered software engineering, pp 150–165Google Scholar
  13. 13.
    Haesen M, Meskens J, Luyten K, Coninx K (2010) Draw me a storyboard: incorporating principles and techniques of comics to ease communication and artefact creation in user-centred design. In: In Proc. of BCS conference on human computer interactionGoogle Scholar
  14. 14.
    Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST ’05: proceedings of the 18th annual ACM symposium on user interface software and technology, pp 115–118. ACM, New York, NY, USACrossRefGoogle Scholar
  15. 15.
    Haubold A, Kender JR (2007) Vast mm: multimedia browser for presentation video. In: CIVR ’07: proceedings of the 6th ACM international conference on image and video retrieval, pp 41–48. ACM, New York, NY, USACrossRefGoogle Scholar
  16. 16.
    Hauptmann AG, Christel MG, Yan R (2008) Video retrieval based on semantic concepts. Proc IEEE 96(4):602–622CrossRefGoogle Scholar
  17. 17.
    Hauptmann E, Baron RV, Chen MY, Christel M, Mummert L, Schlosser S, Sun X, Valdes V, Yang J (2008) Informedia trecvid2008: exploring new frontiers. In: Trecvid 2008Google Scholar
  18. 18.
    Heilig M, Demarmels M, König WA, Gerken J, Rexhausen S, Jetter H-C, Reiterer H (2008) Mediovis: visual information seeking in digital libraries. In: Proceedings of the working conference on advanced visual interfaces, AVI ’08, pp 490–491. ACM, New York, NY, USACrossRefGoogle Scholar
  19. 19.
    Hürst W, Götz G, Jarvers P (2004) Advanced user interfaces for dynamic video browsing. In: Proceedings of the 12th annual ACM international conference on multimedia, MULTIMEDIA ’04, pp 742–743. ACM, New York, NY, USACrossRefGoogle Scholar
  20. 20.
    International Standards Organization (1999) ISO 13407. Human centred design process for interactive systems. Geneva, SwissGoogle Scholar
  21. 21.
    Kankanhalli MS, Rui Y (2008) Application potential of multimedia information retrieval. Proc IEEE 96(4):712–720CrossRefGoogle Scholar
  22. 22.
    Karrer T, Weiss M, Lee E, Borchers J (2008) Dragon: a direct manipulation interface for frame-accurate in-scene video navigation. In: CHI ’08: proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, pp 247–250. ACM, New York, NY, USACrossRefGoogle Scholar
  23. 23.
    Masui T, Kashiwagi K, Borden IV GR (1995) Elastic graphical interfaces to precise data manipulation. In: Conference companion on human factors in computing systems, CHI ’95, pp 143–144. ACM, New York, NY, USACrossRefGoogle Scholar
  24. 24.
    Meskens J, Luyten K, Coninx K (2010) D-macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology, UIST ’10, pp 129–138. ACM, New York, NY, USACrossRefGoogle Scholar
  25. 25.
    Morris MR (2007) Interfaces for collaborative exploratory web search: motivations and directions for multi-user design. In: ACM SIGCHI 2007 workshop on exploratory search and HCI: designing and evaluating interfaces to support exploratory search interaction, pp 9–12Google Scholar
  26. 26.
    Patton J (2008) Consider multiple solutions. IEEE Softw 25:72–73CrossRefGoogle Scholar
  27. 27.
    Pham PT, Moens M-F, Tuytelaars T (2010) Cross-media alignment of names and faces. IEEE Trans Multimedia 12(1):13–27CrossRefGoogle Scholar
  28. 28.
    Pham PT, Moens M-F, Tuytelaars T (2010) Naming persons in news video with label propagation. In: International workshop on visual content identification and search (VCIDS), pp 1528–1533Google Scholar
  29. 29.
    Plaisant C, Milash B, Rose A, Widoff S, Shneiderman B (1996) Lifelines: visualizing personal histories. In: CHI ’96: proceedings of the SIGCHI conference on human factors in computing systems, pp 221–ff. ACM, New York, NY, USAGoogle Scholar
  30. 30.
    Poulisse G-J, Moens M-F, Dekens T, Deschacht K (2010) News story segmentation in multiple modalities. Multimed Tools Appl 48:3–22CrossRefGoogle Scholar
  31. 31.
    Redmond-Pyle D, Moore A (1995) Graphical user interface design and evaluation. Prentice Hall, LondonMATHGoogle Scholar
  32. 32.
    Smeaton A, Lee H, Foley C, McGivney S (2007) Collaborative video searching on a tabletop. Multimed Syst 12:375–391. doi: 10.1007/s00530-006-0064-7 CrossRefGoogle Scholar
  33. 33.
    Smeaton AF, Over P, Kraaij W (2006) Evaluation campaigns and trecvid. In: Proceedings of the 8th ACM international workshop on multimedia information retrieval, MIR ’06, pp 321–330. ACM, New York, NY, USACrossRefGoogle Scholar
  34. 34.
    Snoek CGM, Worring M, de Rooij O, van de Sande KEA, Yan R, Hauptmann AG (2008) VideOlympics: real-time evaluation of multimedia retrieval systems. IEEE Multimed 15(1):86–91CrossRefGoogle Scholar
  35. 35.
    Tang A, Greenberg S, Fels S (2008) Exploring video streams using slit-tear visualizations. In: AVI ’08: proceedings of the working conference on advanced visual interfaces, pp 191–198. ACM, New York, NY, USACrossRefGoogle Scholar
  36. 36.
    Twidale MB, Nichols DM, Paice CD (1997) Browsing is a collaborative process. Inf Process Manag 33:761–783CrossRefGoogle Scholar
  37. 37.
    Uchihashi S, Foote J, Girgensohn A, Boreczky J (1999) Video manga: generating semantically meaningful video summaries. In: MULTIMEDIA ’99: proceedings of the seventh ACM international conference on multimedia (part 1), pp 383–392. ACM, New York, NY, USACrossRefGoogle Scholar
  38. 38.
    University of Konstanz HCI Group, Mediovis—project description. http://hci.uni-konstanz.de/index.php?a=research&b=projects&c=16314278&lang=en#description
  39. 39.
    Wang S, Jing F, He J, Du Q, Zhang L (2007) Igroup: presenting web image search results in semantic clusters. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’07, pp 587–596. ACM, New York, NY, USACrossRefGoogle Scholar
  40. 40.
    Wassink I, Kulyk O, van Dijk EMAG, van der Veer GC, van der Vet PE (2008) Applying a user-centred approach to interactive visualization design. In: Trends in interactive visualization. Springer, London. ISBN: 978-1-84800-268-5Google Scholar
  41. 41.
    Worring M, Snoek CGM, de Rooij O, Nguyen GP, Smeulders AWM (2007) The MediaMill semantic video search engine. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing. Invited paper, pages –. Honolulu, Hawaii, USAGoogle Scholar
  42. 42.
    Zhang HJ, Tan SY, Smoliar SW, Yihong G (1995) Automatic parsing and indexing of news video. Multimed Syst 2:256–266. doi: 10.1007/BF01225243 CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Mieke Haesen
    • 1
  • Jan Meskens
    • 1
  • Kris Luyten
    • 1
  • Karin Coninx
    • 1
  • Jan Hendrik Becker
    • 2
  • Tinne Tuytelaars
    • 2
  • Gert-Jan Poulisse
    • 3
  • Phi The Pham
    • 3
  • Marie-Francine Moens
    • 3
  1. 1.Expertise Centre for Digital MediaHasselt University – tUL – IBBTDiepenbeekBelgium
  2. 2.ESAT/PSIK.U. LeuvenHeverleeBelgium
  3. 3.Department of Computer ScienceK.U. LeuvenHeverleeBelgium

Personalised recommendations