A Novel Approach Based on Fault Tolerance and Recursive Segmentation to Query by Humming

  • Xiaohong Yang
  • Qingcai Chen
  • Xiaolong Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6059)


With the explosive growth of digital music content-based music information retrieval especially query by humming/singing have been attracting more and more attention and are becoming popular research topics over the past decade. Although query by humming/singing can provide natural and intuitive way to search music, retrieval system still confronts many issues such as key modulation, tempo change, note insertion, deletion or substitution which are caused by users and query transcription respectively. In this paper, we propose a novel approach based on fault tolerance and recursive segmentation to solve above problems. Music melodies in database are represented with specified manner and indexed using inverted index method. Query melody is segmented into phrases recursively with musical dictionary firstly. Then improved edit distance, pitch deviation and overall bias are employed to measure the similarity between phrases and indexed entries. Experimental results reveal that proposed approach can achieve high recall for music retrieval.


Query by humming Melody partition Edit distance Fault tolerance Recursive segmentation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
    Heo, S.P., Suzuki, M., Ito, A., Makino, S.: An Effective Music Information Retrieval Method Using Three-Dimensional Continuous DP. IEEE Trans. on Multimedia 8(3), 633–639 (2006)CrossRefGoogle Scholar
  4. 4.
    Suyoto, I.S.H., Uitdenbogerd, A.L., Scholer, F.: Searching Musical Audio Using Symbolic Queries. IEEE Trans. on Audio, Speech and Language 16(2), 372–381 (2008)CrossRefGoogle Scholar
  5. 5.
    Pauws, S.: CubyHum: A Fully Operational Query by Humming System. In: Proceedings of International Society for Music Information Retrieval Conference, ISMIR (2002)Google Scholar
  6. 6.
    Unal, E., Narayanan, S., Chew, E., Georgiou, P.G., Dahlin, N.: A Dictionary Based Approach for Robust and Syllable-Independent Audio Input Transcript for Query by Humming Systems. In: Proceedings of International Conference of ACM Multimedia 2006, pp. 37–43 (2006)Google Scholar
  7. 7.
    Ryynanen, M., Klapuri, A.: Query by Humming of MIDI and Audio Using Locality Sensitive Hashing. In: Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pp. 2249–2252 (2008)Google Scholar
  8. 8.
    Mulder, T.D., Martens, J.P., Pauws, S., Vignoli, F., Lesaffre, M.: Factors Affecting Music Retrieval in Query-by-Melody. IEEE Trans. on Multimedia 8(4), 728–739 (2006)CrossRefGoogle Scholar
  9. 9.
    Unal, E., Chew, E., Georgiou, P.G., Narayanan, S.S.: Challenging Uncertainty in Query by Humming Systems: A Fingerprinting Approach. IEEE Trans. on Audio, Speech and Language 16(2), 359–371 (2008)CrossRefGoogle Scholar
  10. 10.
    Hsu, J.L., Liu, C.C., Chen, A.L.P.: Discovering Nontrivial Repeating Patterns in Music Data. IEEE Trans. on Multimedia 3(3), 311–325 (2001)CrossRefGoogle Scholar
  11. 11.
    Liu, N.-H., Wu, Y.-H., Chen, A.L.P.: An efficient approach to extracting approximate repeating patterns in music databases. In: Zhou, L.-z., Ooi, B.-C., Meng, X. (eds.) DASFAA 2005. LNCS, vol. 3453, pp. 240–252. Springer, Heidelberg (2005)Google Scholar
  12. 12.
    Essen Folk Song Database,
  13. 13.
    Rho, S., Han, B.J., Hwang, E., Kim, M.: MUSEMBLE: A Novel Music Retrieval System with Automatic Voice Query Transcription and Reformulation. The Journal of Systems and Software, 1065–1080 (2008)Google Scholar
  14. 14.
    Cheveigne, A.D., Kawahara, H.: YIN, A Fundamental Frequency Estimatior for Speech and Music. Journal of the Acoustical Society of America 111(4), 1917–1930 (2002)CrossRefGoogle Scholar
  15. 15.
    Kosugi, N., Sakurai, Y., Morimoto, M.: SoundCompass: A Practial Query-by-Humming System. In: Proceedings of ACM SIGMOD 2004 (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Xiaohong Yang
    • 1
  • Qingcai Chen
    • 1
  • Xiaolong Wang
    • 1
  1. 1.Department of Computer Science and Technology, Key Laboratory of Network Oriented Intelligent ComputationHarbin Institute of Technology Shenzhen Graduate SchoolShenzhenChina

Personalised recommendations