Interactive Video Stories from User Generated Content: A School Concert Use Case

  • Michael Frantzis
  • Vilmos Zsombori
  • Marian Ursu
  • Rodrigo Laiola Guimaraes
  • Ian Kegel
  • Roland Craigie
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7648)


This paper describes a web-based narrative system able to generate video compilations, framed as event stories, from a shared repository of video recordings of the event itself and possibly of related events. For this, it employs narrative techniques informed by TV documentary. The generated stories are dynamically personalised, in that the system is able to adapt them to the choices and preferences expressed by the active viewers during narration. The system has been prototyped for the case of school concerts. User evaluations indicate that experiences founded on story navigation rather than sharing individual media assets is a rewarding one and point to further areas of development in interactive storytelling in the context of user generated content.


interactive narrative interactive storytelling digital storytelling computational narrativity video user generated content media share interactive television NSL ShapeShifting media SMIL 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kennedy, L., Naaman, M.: Less talk, more rock: automated organization of community-contributed collections of concert videos. In: Proceedings of the Interactional Conference on WWW, pp. 311–320 (2009)Google Scholar
  2. 2.
    Shrestha, P., de With, P.H.N., Weda, H., Barbieri, M., Aarts, E.H.L.: Automatic mashup generation from multiple-camera concert recordings. In: Proceedings of the International Conference on Multimedia, pp. 541–550 (2010)Google Scholar
  3. 3.
    Shamma, D.A., Shaw, R., Shafton, P.L., Liu, Y.: Watch what I watch: using community activity to understand content. In: Proceedings of the International Workshop on Multimedia Information Retrieval, pp. 275–284 (2007)Google Scholar
  4. 4.
    Zsombori, V., Frantzis, M., Laiola-Guimares, R., Ursu, M.F., Cesar, P., Kegel, I., Craigie, R., Bulterman, C.A.: Automatic generation of video narratives from shared UGC. In: Proceedings of the 22nd ACM International Conference on Hypertext and Hypermedia (HT 2011), Eindhoven, The Netherlands, June 6-9, pp. 325–334. ACM, New York (2011)CrossRefGoogle Scholar
  5. 5.
    Cavazza, M., Champagnat, R., Leonardi, R.: The IRIS Network of Excellence: Future Directions in Interactive Storytelling. In: Iurgel, I.A., Zagalo, N., Petta, P. (eds.) ICIDS 2009. LNCS, vol. 5915, pp. 8–13. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  6. 6.
    Riedl, M., Young, R.M.: From Linear Story Generation to Branching Story Graphs. IEEE Journal of Computer Graphics and Applications, 23–31 (May/June 2006)Google Scholar
  7. 7.
    Ibanez, J., Aylett, R., Delgado-Mata, C., Molinuevo, E.: On the Implications of the Virtual Storyteller’s Point of View. The Knowledge Engineering Review 23(4), 339–367 (2009)CrossRefGoogle Scholar
  8. 8.
    Ronfard, R.: A Review of Film Editing Techniques for Digital Games. In: Workshop on Intelligent Cinematography and Editing, Raleigh, USA, May 28-29, pp. 381–389 (2012)Google Scholar
  9. 9.
    Mancini, J., Shum, S.B.: From Cinematic to Hypertext Narrative. In: Proceedings of 15th ACM Hypertext 2000, San Antonio TX, USA, May 30-June 3, pp. 236–237. ACM (2000)Google Scholar
  10. 10.
    Gilroy, S., Porteous, J., Charles, F., Cavazza, M.: Exploring Passive User Interaction for Adaptive Narratives. In: Proceedings of the 17th International Conference on Intelligent User Interfaces (IUI 2012), Lisbon, Portugal, pp. 119–128 (2012)Google Scholar
  11. 11.
    Davenport, G., Murtaugh, M.: ConText: Towards the Evolving Documentary. In: Proceedings of ACM Multimedia 1995, San Francisco, USA, November 5-9 (1995)Google Scholar
  12. 12.
    Porteous, J., Benini, S., Canini, L., Charles, F., Cavazza, M., Leonardi, R.: Interactive Storytelling via Video Content Recombination. In: Proceedings of the 18th ACM International Conference on Multimedia 2010 (Short Papers), Firenze, Italy, October 25-29 (2010)Google Scholar
  13. 13.
    Ursu, M.F., Thomas, M., Kegel, I., Williams, D., Tuomola, M., Lindstedt, I., Wright, T., Leurdijk, A., Zsombori, V., Sussner, J., Maystream, U., Hall, N.: Interactive TV Narratives: Opportunities, Progress and Challenges. ACM TOMCCAP 4(4), article 25 (2008b)Google Scholar
  14. 14.
    Bocconi, S., Nack, F., Hardman, L.: Automatic generation of matter-of-opinion video documentaries. Special Issue on Semantic Multimedia. Journal of Web Semantics (JWS) 6(2), 139–150 (2008)CrossRefGoogle Scholar
  15. 15.
    Ursu, M.F., Kegel, I., Williams, D., Thomas, M., Mayer, H., Zsombori, V., Tuomola, M.L., Larsson, H., Wyver, J.: ShapeShifting TV – Interactive Screen Media Narratives. Multimedia Systems Journal 14(2), 115–132 (2008)CrossRefGoogle Scholar
  16. 16.
    Ursu, M.F., Zsombori, V., Wyver, J., Conrad, L., Kegel, I., Williams, D.: Interactive Documentaries: A Golden Age. ACM Computers in Entertainment (CiE) 7(3), Special Issue: TV and Video Entertainment Environments, Section: Production, Interactivity, and Narrative (September 2009)Google Scholar
  17. 17.
    Barry, B.: The Mindful Camera: Common Sense for Documentary Videography. In: Proceedings of the Eleventh ACM International Conference on Multimedia, Berkeley, CA, USA, November 2-8, pp. 648–649 (2003)Google Scholar
  18. 18.
    Rabiger, M.: Directing the Documentary, 3rd edn., p. 67. Focal Press, London (1998)Google Scholar
  19. 19.
    Korchagin, D., Garner, P.N., Dines, J.: Automatic Temporal Alignment of AV Data with Confidence Estimation. In: Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, USA (2010)Google Scholar
  20. 20.
    D6.6 Summary report – Audio capture and data analysis, TA2 Public Deliverable,
  21. 21.
    Bulterman, D.C.A., Rutledge, L.W.: SMIL 3.0: Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books. Springer Publishing Company, Incorporated (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Michael Frantzis
    • 1
  • Vilmos Zsombori
    • 1
  • Marian Ursu
    • 1
  • Rodrigo Laiola Guimaraes
    • 2
  • Ian Kegel
    • 3
  • Roland Craigie
    • 3
  1. 1.Department of ComputingGoldsmiths, University of LondonUK
  2. 2.CWI: Centrum Wiskunde & InformaticaThe Netherlands
  3. 3.BT Research & TechnologyMartlesham HeathUK

Personalised recommendations