Abstract
In this paper we present a system that uses the Microsoft Kinect to provide beginner conducting students real time feedback about their performance. Using upper body joint coordinates we detect common mistakes such as swaying, rocking, excessive hinge movement, and mirroring. We compute instant velocities to determine tempo and classify articulation as legato or staccato. Our experiments show that the system performs perfectly when detecting erroneous movements, correctly classifies articulation type most of the time, and can correctly determine tempo by counting the number of beats per minute. The system was well received by conducting students and their instructor, as it allows them to practice by themselves, without an orchestra.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Behringer, R.: Conducting digitally stored music by computer vision tracking. In: First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS05), Florence, Italy (2005)
Wilson, A., Bobick, A.: Realtime online adaptive gesture recognition. In: International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece
Murphy, D., Andersen, T.H., Jensen, K.: Conducting audio files via computer vision. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 529–540. Springer, Heidelberg (2004)
Marrin, T., Paradiso, J.: The digital baton: a versatile performance instrument. In: International Computer Music Conference, Thessaloniki, Greece, pp. 313–316 (1997)
Nakra, T.M., Ivanov, Y., Smaragdis, P., Ault, C.: The ubs virtual maestro: an interactive conducting system. In: New Interfaces for Musical Expression (NIME), Pittsburgh, PA (2009)
Salgian, A., Pfirrmann, M., Nakra, T.M.: Follow the beat? Understanding conducting gestures from video. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Paragios, N., Tanveer, S.-M., Ju, T., Liu, Z., Coquillart, S., Cruz-Neira, C., Müller, T., Malzbender, T. (eds.) ISVC 2007, Part I. LNCS, vol. 4841, pp. 414–423. Springer, Heidelberg (2007)
Peng, L., Gerhard, D.: A wii-based gestural interface for computer-based conducting systems. In: New Interfaces for Musical Expression (NIME), Pittsburgh, PA (2009)
Ivanova, E., Wang, L., Fu, Y., Gadzala, J.: Maestro: a practice system to track, record, and observe for novice orchestral conductors. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems
Library, M.: Kinect for windows sdk. https://msdn.microsoft.com/en-us/library/hh855347.aspx. Accessed 20 August 2015
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Salgian, A., Hsu, L., Milkosky, N., Vickerman, D. (2015). Conductor Tutoring Using the Microsoft Kinect. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9475. Springer, Cham. https://doi.org/10.1007/978-3-319-27863-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-27863-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27862-9
Online ISBN: 978-3-319-27863-6
eBook Packages: Computer ScienceComputer Science (R0)