Abstract
This paper describes novel concepts for the interactive composition of artistic real-time graphics, so-called live visuals. By establishing two fundamental techniques dealing with the structured media integration and the intrinsic design process, we significantly increase the efficiency of interactive editing in live visuals applications. First, we present a media manager that supports the user in both retrieval and utilization of automatically annotated digital media. The computer-assisted application of individual media items permits the interactive control of non-linear editing (NLE) of video in real-time. Second, we optimize the design process by introducing the design tree, which collects and organizes the artist’s work in an intuitive way. Design tree operations provide interactive high-level editing methods which allow for exploration, combination, reuse, and evolution of designs before and particularly during the performance. We examined the effectiveness of our techniques on numerous long-lasting live performances from which representative examples are demonstrated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alton, J.: Painting With Light. University of California Press (1995)
Brossier, P., Bello, J.P., Plumbley, M.D.: Real-time temporal segmentation of note objects in music signals. In: Proceedings of the 2004 International Computer Music Conference, International Computer Music Association (2004)
Cederqvist, P.: Version Management with CVS. Signum Support AB (1993)
Eisenstein, S.: Selected Works 2: Towards a Theory of Montage. In: N. Glenny, R. Taylor, (eds.) British Film Institute (1994)
Foote, J., Cooper, M., Girgensohn, A.: Creating music videos using automatic media analysis. In: Proc. ACM Intl. Conf. on Multimedia, pp. 553–560. ACM, New York (2002)
Fowler, M.: Refactoring: Improving the Design of Existing Code. Addison-Wesley Object Technology Series. Addison-Wesley, Reading (1999)
Cube, G.: Modul8 real-time video mixing and compositing software. (2005), http://www.garagecube.com
Gorbmann, C.: Unheard Melodies: Narrative Film Music. Indiana University Press (1987)
Goto, M.: An audio-based real-time beat tracking system for music with or without drum sound. Journal of New Music Research 30(2), 158–171 (2001)
Jehan, T., Lew, M., Vaucelle, C.: Cati dance: Self-edited, self-synchronized music video. In: GRAPH 2003. Proceedings of the SIGGRAPH 2003 Conference on Sketches & Applications, ACM Press, New York (2003)
Kahrs, J.: Pixel cinematography: Lighting for computer graphics. In: ACM SIGGRAPH 1996 Course Notes, ACM Press, New York (1996)
Lienhard, R.: Comparison of automatic shot boundary detection algorithms. In: Image and Video Processing VII. Proc. SPIE 3656-29 (1999)
Manjunath, B.S., Salembier, P., Sikora, T.: Introduction to MPEG-7: Multimedia Content Description Interface. John Wiley and Sons, Chichester (2002)
Müller Arisona, S., Schubiger-Banz, S., Specht, M.: A real-time multimedia composition layer. In: Proceedings of AMCMM. Workshop on Audio and Music Computing for Multimedia, ACM Press, New York (2006)
Pukette, M.: Max at seventeen. Computer Music Journal 26(4), 31–43 (2002)
Ramakrishnan, R., Ram, D.J.: Modeling design versions. The VLDB Journal, pp. 556–566 (1996)
Rui, Y., Huang, T.S., Mehrotra, S.: Constructing table-of-content for videos. ACM Multimedia Systems 7(5), 359–368 (1999)
Scheirer, E.: Tempo and beat analysis of acoustic musical signals. J. Acoust. Soc. Am. 103(1), 588–601 (1998)
Schubiger, S., Müller, S.: Soundium2: An interactive multimedia playground. In: Proceedings of the 2003 International Computer Music Conference, International Computer Music Association (2003)
Simon, H.A.: The Sciences of the Artificial. MIT Press, Cambridge (1996)
Strauss, P.S., Carey, R.: An object-oriented 3D graphics toolkit. In: Computer Graphics (Proceedings of SIGGRAPH 1992), vol. 26(2), pp. 341–349. ACM, New York (1992)
Sutherland, I. E.: Sketchpad, a Man-Machine Graphical Communication System. PhD thesis, Massachusetts Institute of Technology (1963)
Tseng, B.L., Lin, C.-Y., Smith, J.R.: Video personalization and summarization system. In: Internet Multimedia Management Systems. SPIE Photonics East (2002)
Ulyate, R., Bianciardi, D.: The interactive dance club: Avoiding chaos in a multi-participant environment. Computer Music Journal 26(3), 40–49 (2002)
VJCentral (2005), http://www.vjcentral.com
Wagner, M.G., Carroll, S.: Deepwave: Visualizing music with VRML. In: VSMM 2001. Proceedings of the Seventh International Conference on Virtual Systems and Multimedia, p. 590. IEEE Computer Society Press, Los Alamitos (2001)
Wang, J., Bhat, P., Colburn, A., Agrawala, M., Cohen, M.: Interactive video cutout. In: Proceedings of ACM SIGGRAPH 2005 / ACM Transactions on Graphics, vol. 24(3), pp. 585–594. ACM, New York (2005)
Wonka, P., Wimmer, M., Sillion, F., Ribarsky, W.: Instant architecture. In: Proceedings of ACM SIGGRAPH 2003 / ACM Transactions on Graphics, vol. 22(3), pp. 669–677. ACM, New York (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Müller, P., Müller Arisona, S., Schubiger-Banz, S., Specht, M. (2007). Interactive Editing of Live Visuals. In: Braz, J., Ranchordas, A., Araújo, H., Jorge, J. (eds) Advances in Computer Graphics and Computer Vision. Communications in Computer and Information Science, vol 4. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75274-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-75274-5_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75272-1
Online ISBN: 978-3-540-75274-5
eBook Packages: Computer ScienceComputer Science (R0)