Abstract
This study describes a method that automatically generates a piano reduction score from the audio recordings of popular music while considering the musical structure. The generated score comprises both right- and left-hand piano parts, which reflect the melodies, chords, and rhythms extracted from the original audio signals. Generating such a reduction score from an audio recording is challenging because automatic music transcription is still considered to be inefficient when the input contains sounds from various instruments. Reflecting the long-term correlation structure behind similar repetitive bars is also challenging; further, previous methods have independently generated each bar. Our approach addresses the aforementioned issues by integrating musical analysis, especially structural analysis, with music generation. Our method extracts rhythmic features as well as melodies and chords from the input audio recording and reflects them in the score. To consider the long-term correlation between bars, we use similarity matrices, created for several acoustical features, as constraints. We further conduct a multivariate regression analysis to determine the acoustical features that represent the most valuable constraints for generating a musical structure. We have generated piano scores using our method and have observed that we can produce scores that differently balance between the ability to achieve rhythmic characteristics and the ability to obtain musical structures.
Supported by JST ACCEL, Japan (grant no. JPMJAC1602).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Bokaro Kamikyoku Daishugo Best 30, Depuro MP, Japan (2016).
- 2.
Jokyu Piano Grade Bokaro Meikyoku Piano Solo Concert, Depuro MP, Japan (2015).
- 3.
Print Score, https://www.print-gakufu.com/.
- 4.
- 5.
Mosaic Roll (DECO*27), https://www.nicovideo.jp/watch/sm11398357.
- 6.
Ghost Rule (DECO*27), https://www.nicovideo.jp/watch/sm27965309.
- 7.
Irohauta (Ginsaku), https://piapro.jp/t/0D18/20100223020519.
- 8.
The generated results is available at https://youtu.be/Yx9c0LnEyyE.
References
Takamori, H., Sato, H., Nakatsuka, T., Morishima, S.: Automatic arranging musical score for piano using important musical elements. In: Proceedings of the 14th Sound and Music Computing Conference, Aalto, Finland, pp. 35–41 (2017)
Fujita, K., Oono, H., Inazumi, H.: A proposal for piano score generation that considers proficiency from multiple part. In: IPSJ SIG Technical reports, pp. 47–52 (2008)
Chiu, S., Shan, M., Huang, J.: Automatic system for the arrangement of piano reductions. In: Proceedings of the 11th IEEE International Symposium on Multimedia, pp. 459–464 (2009)
Owsinski, B.: The Mixing Engineer’s Handbook. Thomson Course Technology (1999)
Nakamura, E., Sagayama, S.: Automatic piano reduction from ensemble scores based on merged-output Hidden Markov model. In: Proceedings of the 41st International Computer Music Conference (ICMC), pp. 298–305 (2015)
Percival, G., Fukayama, S., Goto, M.: Song2Quartet: a system for generating string quartet cover songs from polyphonic audio of popular music. In: Proceedings of the International Symposium Music Information Retrieval, pp. 114–120 (2015)
Schmidt-Jones, C.: The Basic Elements of Music (2014). Lulu.com
Doll, C.: Rockin’ out: expressive modulation in verse-chorus form. J. Soc. Music Theory 17(3), 1–10 (2011)
Goto, M., Yoshii, K., Fujihara, H., Mauch, M., Nakano, T.: Songle: a web service for active music listening improved by user contributions. In: Proceedings of the International Symposium on Music Information Retrieval, pp. 311–316 (2011)
Böck, S., Florian, K., Markus, S.: Evaluating the online capabilities of onset detection methods. In: Proceedings of the International Symposium on Music Information Retrieval, pp. 49–54 (2012)
Jonathan, F.: Automatic audio segmentation using a measure of audio novelty. In: Proceedings of the 2000 IEEE International Conference on Multimedia and Expo, vol. 1, pp. 452–455 (2000)
Goto, M.: Development of the RWC music database. In: Proceedings of the 18th International Congress on Acoustics (ICA 2004), vol. 1, pp. 553–556 (2004)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Takamori, H., Nakatsuka, T., Fukayama, S., Goto, M., Morishima, S. (2019). Audio-Based Automatic Generation of a Piano Reduction Score by Considering the Musical Structure. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11296. Springer, Cham. https://doi.org/10.1007/978-3-030-05716-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-05716-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05715-2
Online ISBN: 978-3-030-05716-9
eBook Packages: Computer ScienceComputer Science (R0)