Abstract
Our goal is to achieve a musical ensemble among a robot and human musicians where the robot listens to the music with its own microphones. The main issues are (1) robust beat-tracking since the robot hears its own generated sounds in addition to the accompanied music, and (2) robust synchronizing its performance with the accompanied music even if humans’ musical performance fluctuates. This paper presents a music-ensemble Thereminist robot implemented on the humanoid HRP-2 with the following three functions: (1) self-generated Theremin sound suppression by semi-blind Independent Component Analysis, (2) beat tracking robust against tempo fluctuation in humans’ performance, and (3) feedforward control of Theremin pitch. Experimental results with a human drummer show the capability of this robot for the adaptation to the temporal fluctuation in his performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alford, A., et al.: A music playing robot. In: FSR 1999, pp. 29–31 (1999)
Petersen, K., Solis, J.: Development of a Aural Real-Time Rhythmical and Harmonic Tracking to Enable the Musical Interaction with the Waseda Flutist Robot. In: Proc. of IEEE/RSJ Int’l Conference on Intelligent Robots and Systems (IROS), pp. 2303–2308 (2009)
Weinberg, G., Driscoll, S.: Toward Robotic Musicianship. Computer Music Journal 30(4), 28–45 (2006)
Weinberg, G., Driscoll, S.: The interactive robotic percussionist: new developments in form, mechanics, perception and interaction design. In: Proc. of the ACM/IEEE Int’l Conf. on Human-robot interaction, pp. 97–104 (2007)
Glinsky, A.V.: The Theremin in the Emergence of Electronic Music. PhD thesis, New York University (1992)
Mizumoto, T., Takeda, R., Yoshii, K., Komatani, K., Ogata, T., Okuno, H.G.: A Robot Listens to Music and Counts Its Beats Aloud by Separating Music from Counting Voice. In: IROS, pp. 1538–1543 (2008)
Murata, K., Nakadai, K., Yoshii, K., Takeda, R., Torii, T., Okuno, H.G., Hasegawa, Y., Tsujino, H.: A Robot Uses Its Own Microphone to Synchronize Its Steps to Musical Beats While Scatting and Singing. In: IROS, pp. 2459–2464 (2008)
Takeda, R., Nakadai, K., Komatani, K., Ogata, T., Okuno, H.G.: Barge-in-able Robot Audition Based on ICA and Missing Feature Theory under Semi-Blind Situation. In: IROS, pp. 1718–1723 (2008)
Mizumoto, T., Tsujino, H., Takahashi, T., Ogata, T., Okuno, H.G.: Thereminist Robot: Development of a Robot Theremin Player with Feedforward and Feedback Arm Control based on a Theremin’s Pitch Model. In: IROS, pp. 2297–2302 (2009)
Kaneko, K., Kanehiro, F., Kajita, S., Hirukawa, H., Kawasaki, T., Hirata, M., Akachi, K., Isozumi, T.: Humanoid robot HRP-2. In: Proc. of IEEE Int’l Conference on Robotics and Automation (ICRA), vol. 2, pp. 1083–1090 (2004)
Goto, M., Hashiguchi, H., Nishimura, T., Oka, R.: RWC Music Database: Popular Music Database and Royalty-Free Music Database. IPSJ Sig. Notes 2001(103), 35–42 (2001)
Dannenberg, R., Raphael, C.: Music Score Alignment and Computer Accompaniment. Communications of the ACM 49(8), 38–43 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Otsuka, T. et al. (2010). Music-Ensemble Robot That Is Capable of Playing the Theremin While Listening to the Accompanied Music. In: García-Pedrajas, N., Herrera, F., Fyfe, C., Benítez, J.M., Ali, M. (eds) Trends in Applied Intelligent Systems. IEA/AIE 2010. Lecture Notes in Computer Science(), vol 6096. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13022-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-13022-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13021-2
Online ISBN: 978-3-642-13022-9
eBook Packages: Computer ScienceComputer Science (R0)