Abstract
This paper proposes a method for controlling video images during a performance using video signals in the audio domain, and applying an intentional misuse of video compression algorithms for artistic ends. A demonstration performance system using this representation method is also described. The system consists of hardware for converting a component video signal into an audio signal, and software for easy control of image to control the frequency, amplitude, rhythm, and wave shape. The proposed representation method seeks to create a unique relationship between video and audio signals, and shows a new perspective regarding the use of computational devices.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Iwamiya, S.: The Interaction Between Auditory and Visual Processing when Listening to Music via Audio-visual Media. Journal of the Acoustical Society of Japan 48(3), 146–153 (1992)
Iwamiya, S.: The Effect of the Matching of Sound and Video on the Interaction Between Auditory and Visual Processing in Communication via Audio-visual Media. Journal of the Acoustical Society of Japan 48(9), 649–657 (1992)
Sugano, Y.: Effects of Synchronization Between Musical Rhythm and Visual Motion on the Congruency of Music and Motion Picture. Journal of Music Perception and Cognition 5, 1–10 (1999)
Iwamiya, S., Seki, M., Yoshikawa, K., Takada, M.: Congruency Between Sound Effects and Switching Patterns of Images. The Japanese Journal of Ergonomics 39(6), 292–299 (2003)
Ghazala, R.: Circuit-Bending: Build Your Own Alien Instruments. Wiley Publishing, Inc. (2005)
Collins, N.: Handmade Electronic Music. Routledge (2006)
Kubota, A.: Bending Culture. IPSJ SIG technical reports, EC, Entertainment Computing 2006(39), 45–46 (2006)
Ito, Y., Stone, C., Yamada, M., Miyazaki, S.: Datamoshing Technique for Video Production, The Society for Art and Science. In: Proc. of NICOGRAPH International 2013, CD-ROM, pp. 60–71 (2013)
Ito, Y., Stone, C., Yamada, M., Miyazaki, S.: A Technique for Real-time Datamoshing Using Web Camera Input. The Journal of The Institute of Image Information and Television Engineers 67(11), J413–J416 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Ito, Y., Stone, C., Yamada, M., Miyazaki, S. (2014). Audio-Visual Art Performance System Using Computer Video Output Based on Component Video to Audio Signal Conversion. In: Gavrilova, M.L., Tan, C.J.K., Mao, X., Hong, L. (eds) Transactions on Computational Science XXIII. Lecture Notes in Computer Science, vol 8490. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-43790-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-662-43790-2_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-43789-6
Online ISBN: 978-3-662-43790-2
eBook Packages: Computer ScienceComputer Science (R0)