Abstract
This paper proposes a piece of interactive art installation named the “Juke Cylinder” to augment sound images through hand interaction and to metamorphose hands into a musical instrument. To augment a sound image onto users’ hands, we used a parametric loudspeaker because it can localize a sound image on a reflecting surface. When users interact with our system, they perceive that their hands are metamorphosed into various musical instruments such as a guitar, a piano, or a synthesizer. Users can control the pitches of the sounds depending on their hand interactions such as with real musical instruments. In a demonstration at a media art exhibition, this system provided visitors with extraordinary sound experiences, and we received positive feedback from them.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Pompei, F.J.: The use of airborne ultrasonics for generating audible sound beams. J. Audio Eng. Soc. 47(9), 726–731 (1999)
Gan, W.S., Tan, E.L., Kuo, S.M.: Audio projection. IEEE Signal Processing Magazine 28(1), 43–57 (2011)
Dobler, D., Haller, M., Stampfl, P.: ASR: Augmented sound reality. In: ACM SIGGRAPH 2002 Conference Abstracts and Applications, p. 148 (2002)
Nishimura, K., Kimura, K., Yamazaki, M., Suzuki, Y., Tanikawa, T., Hirose, M.: Public art at a baggage claim at haneda airport: Bird of luggage. Transactions of the Virtual Reality Society of Japan 15(3), 467–470 (2010)
Kimura, K., Hoshuyama, O., Narumi, T., Tanikawa, T., Hirose, M.: Sound-power visualization system for real-world interaction based on ultrasonic power transmission. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, ACE 2011, 60:1–60:8(2011)
Zerroug, A., Cassinelli, A., Ishikawa, M.: Invoked computing: Spatial audio and video ar invoked through miming. In: Proceedings of Virtual Reality International Conference, LAVAL VIRTUAL 2011, pp. 31–32 (2011)
Harrison, C., Benko, H., Wilson, A.D.: Omnitouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 441–450 (2011)
Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 273–282 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ueta, M., Hoshuyama, O., Narumi, T., Sakurai, S., Tanikawa, T., Hirose, M. (2012). Juke Cylinder: Sound Image Augmentation to Metamorphose Hands into a Musical Instrument. In: Nijholt, A., Romão, T., Reidsma, D. (eds) Advances in Computer Entertainment. ACE 2012. Lecture Notes in Computer Science, vol 7624. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34292-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-34292-9_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34291-2
Online ISBN: 978-3-642-34292-9
eBook Packages: Computer ScienceComputer Science (R0)