Abstract
Real time tracking of musical performances allows for implementation of virtual teachers of musical instruments, automatic accompanying of musicians or singers, and automatic adding of special effects in live presentations.
State of the art approaches make a local alignment of the score (the target audio) and a musical performance, such procedure induce cumulative error since it assumes the rendition to be well tracked up to the current time. We propose searching for the k-nearest neighbors of the current audio segment among all audio segments of the score then use some heuristics to decide the current tracked position of the performance inside the score.
We tested the method with 62 songs, some pop music but mostly classical. For each song we have two performances, we use one of them as the score and the other one as the music to be tracked with excellent results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Sethares, W.A., Morris, R.D., Sethares, J.C.: Beat tracking of musical performances using low level audio features. IEEE Transactions on Speech and Audio Processing (2) (March 2005)
Cano, P., Loscos, A., Bonada, J.: Score-performance matching using hmms. In: ICMC 1999, Audiovisual Institute, Pompeu Fabra University, Spain (1999)
Orio, N., Déchelle, F.: Score following using spectral analysis and hidden Markov models. In: Proceedings of the ICMC, pp. 151–154 (2001)
Orio, N., Lemouton, S., Schwarz, D.: Score following: state of the art and new developments. In: Proceedings of the, conference on New Interfaces for Musical Expression, National University of Singapore, p. 41 (2003)
Sakoe, H., Chiba, S.: Dynamic programming algortihm optimization for spoken word recognition. IEEE Transactions on Acoustics and Speech Signal Processing (ASSP), 43–49 (1978)
Dixon, S.: Live tracking of musical performances using on-line time warping. In: 8th International Conference on Digital Audio Effects (DAFx 2005), Austrian Research Institute for Artificial Intelligence, Vienna (September 2005)
Dixon, S., Widmer, G.: Match: A music alignment tool chest. In: 6th International Conference on Music Information Retrieval (ISMIR), Austrian Research Institute for Artificial Intelligence, Vienna (2005)
Rabiner, L., Juang, B.: An introduction to hidden markov models. IEEE ASSP Magazine 3(1), 4–16 (2003)
Bilmes, J.A.: A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models. Technical Report TR-97-021, Department of Electrical Engineering and Computer Science U.C. Berkeley (April 1998)
Rabiner, R.L.: A tutorial on hidden markov models and selected aplications in speech recognition. Proceedings of the IEEE 77(2), 257–286 (1989)
Camarena-Ibarrola, A., Chavez, E.: On musical performances identification, entropy and string matching. In: Gelbukh, A., Reyes-Garcia, C.A. (eds.) MICAI 2006. LNCS (LNAI), vol. MICAI, pp. 952–962. Springer, Heidelberg (2006)
Camarena-Ibarrola, A., Chavez, E., Tellez, E.S.: Robust radio broadcast monitoring using a multi-band spectral entropy signature. In: 14th Iberoamerican Congress on Pattern Recognition, pp. 587–594. Springer, Heidelberg (2009)
Figueroa, K., Chávez, E., Navarro, G.: The sisap metric indexing library, http://www.sisap.org/library/metricspaces.tar.gz
Burkhard, W.A., Keller, R.M.: Some approaches to best-match file searching. ACM Commun. 16(4), 230–236 (1973)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Camarena-Ibarrola, A., Chávez, E. (2010). Real Time Tracking of Musical Performances. In: Sidorov, G., Hernández Aguirre, A., Reyes García, C.A. (eds) Advances in Soft Computing. MICAI 2010. Lecture Notes in Computer Science(), vol 6438. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16773-7_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-16773-7_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16772-0
Online ISBN: 978-3-642-16773-7
eBook Packages: Computer ScienceComputer Science (R0)