Abstract
The violin is one of the most beautiful but also one of the most difficult musical instruments for a beginner. This paper presents an on-going work about a new augmented reality system for training how to play violin. We propose to help the players by virtually guiding the movement of the bow and the correct position of their fingers for pressing the strings. Our system also recognizes the musical note played and the correctness of its pitch. The main benefit of our system is that it does not require any specific marker since our real-time solution is based on a depth camera.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Konczak, J., van der Velden, H., Jaeger, L.: Learning to play the violin: motor control by freezing, not freeing degrees of freedom by freezing. Journal of Motor Behavior 41(3), 243–252 (2009)
van der Linden, J., Schoonderwaldt, E., Bird, J., Johnson, R.: MusicJacket - Combining motion capture and vibrotactile feedback to teach violin bowing. IEEE Transactions on Instrumentation and Measurements, Special Issue on Haptic, Audio and Visual Environments for Games (2009)
Motokawa, Y., Saito, H.: Support system for guitar playing using augmented reality display. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 243–244 (2006)
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd International Workshop on Augmented Reality, pp. 85–94 (1999)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Zhang, Z.: Iterative point matching for registration of freeform curves and surfaces. International Journal of Computer Vision 13(2), 119–152 (1994)
Cheng, H.D., Jiang, X.H., Sun, Y., Wang, J.: Color image segmentation: advances and prospects. Pattern Recognition 34(12), 2259–2281 (2001)
Arun, K., Huang, T., Blostein, S.: Least-squares fitting of two 3-D point sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 5, 698–700 (1987)
Umeyama, S.: Least-squares estimation of transformation parameters between two points pattern. IEEE Transactions on Pattern Analysis and Machine Intelligence 13(4), 376–380 (1991)
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M.: Real-time human pose recognition in parts from single depth images. Communications of the ACM 56(1), 116–124 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shiino, H., de Sorbier, F., Saito, H. (2013). Towards an Augmented Reality System for Violin Learning Support. In: Jiang, X., Bellon, O.R.P., Goldgof, D., Oishi, T. (eds) Advances in Depth Image Analysis and Applications. WDIA 2012. Lecture Notes in Computer Science, vol 7854. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40303-3_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-40303-3_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-40302-6
Online ISBN: 978-3-642-40303-3
eBook Packages: Computer ScienceComputer Science (R0)