Multimedia Tools and Applications

, Volume 75, Issue 23, pp 15445–15459 | Cite as

Accelerating the formant synthesis of haegeum sounds using a general-purpose graphics processing unit

  • Myeongsu Kang
  • Shohidul Islam
  • Rashedul Islam
  • Jong-Myon Kim


Sound synthesis is recently indispensable with sophisticated audio effects for mimicking rich and natural sounds of the musical instruments, and thus sound synthesis acceleration has been an urgent issue. The formant synthesis is employed to produce the various single notes of the haegeum, a representative traditional Korean bowed string instrument. In this study, the formant synthesis process using multiple pairs of digital resonators and band-pass filters is accelerated with the power of a general-purpose graphics processing unit (GPGPU). This paper compares the performance of the proposed GPGPU-based parallel approach with the CPU-based sequential approach in order to validate the effectiveness of the proposed massively parallel method. Experimental results indicate that the proposed parallel approach achieves at least 79 times speedup over the CPU-based approach by exploiting the massive parallelism inherent in the formant sound synthesis algorithm.


Formant synthesis General-purpose graphics processing unit Haegeum Sound synthesis 



This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MEST) (No. NRF-2013R1A2A2A05004566).


  1. 1.
    Bakhoda A, Yuan GL, Fung WWL, Wong H, Aamodt TM (2009) Analyzing CUDA workloads using a detailed GPU simulator, In: Proceedings of IEEE International Conference on Performance Analysis of Systems and Software, Boston, pp. 163–174Google Scholar
  2. 2.
    Belloch JA, Gonzalez A, Martinez-Zaldivar FJ, Vidal AM (2011) Real-time massive convolution for audio applications on GPU. J Supercomput 58:449–457CrossRefGoogle Scholar
  3. 3.
    Choi J, Kang M, Kim Y, Kim CH, Kim JM (2013) Design space exploration in many-core processors for sound synthesis of plucked string instruments. J Parallel Distrib Comput 73(11):1506–1522CrossRefGoogle Scholar
  4. 4.
    Chowning JM (1977) The synthesis of complex audio spectra by means of frequency modulation. Comput Music J 1(2):46–54Google Scholar
  5. 5.
    Divya UJ, Kim HS, Lee J, Kim JI (2013) Fractal based method on hardware accelecration for natural environments. J Convers 4(3):6–12Google Scholar
  6. 6.
    Goodwin M (1996) Residual modeling in music analysis-synthesis. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, pp. 1005–1008Google Scholar
  7. 7.
    Hsu B, Sosnick-Perez M (2013) Real-time GPU audio. Commun ACM 56(6):54–62CrossRefGoogle Scholar
  8. 8.
    Janosy Z (1996) Physical modeling of plucked string instruments with application to real-time sound synthesis. Audio Eng Soc 44(5):331–353Google Scholar
  9. 9.
    Kang M, Hong Y (2011) Formant synthesis of haegeum: a sound analysis/synthesis system using cepstral envelope. In: Proceedings of 2010 International Conference on Information Science and Applications, Jeju Island, pp. 1–8Google Scholar
  10. 10.
    Klatt DH (1979) Software for a cascade/parallel formant synthesizer. J Acoust Soc Am 67:971–995CrossRefGoogle Scholar
  11. 11.
    Navalyal GU, Gavas RD (2014) A dynamic attention assessment and enhancement tool using computer graphics. Human-Centric Inf Sci 4:1–7CrossRefGoogle Scholar
  12. 12.
    Ng CK, Ee GK, Kamariah N, Fam JG (2013) Finger triggered virtual musical instruments. J Convers 4(1):39–46Google Scholar
  13. 13.
    Nvidia GeForce GTX 560 Specifications [Online], available at
  14. 14.
    Pakarinen J, Karjalainen M, Valimaki V, Bilbao S (2005) Energy behavior in time-varying fractional delay filters for physical modeling synthesis of musical instruments. In: Proceedings of IEEE International on Acoustics, Speech, and Signal Processing, pp. iii/1–iii/4Google Scholar
  15. 15.
    Ranjan R, Gan WS (2014) Fast and efficient real-time GPU based implementation of wave field synthesis, In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Florence, pp. 4–9Google Scholar
  16. 16.
    Savloja L, Valimaki, V, Smith III JO (2010) Real-time additive synthesis with one million sinusoids using a GPU, In: 128th AES Conventions, London, pp. 1Google Scholar
  17. 17.
    Serra X, Smith JO III (1990) Spectral modeling synthesis: a sound analysis/synthesis systerm based on a deterministric plus stochastic decomposition. Comput Music J 14(4):12–24CrossRefGoogle Scholar
  18. 18.
    Trebien F, Oliveira MM (2009) Realistic real-time sound re-synthesis and processing for interactive virtual worlds. Vis Comput 25:469–477CrossRefGoogle Scholar
  19. 19.
    Tsai PY, Wang TM, Su A (2010) GPU-based spectral model synthesis for real-time sound rendering, In: Proceedings of the 13th International Conference on Digital Audio Effects, Graz, pp. 1–5Google Scholar
  20. 20.
    Valimaki V (2005) Discrete-time synthesis of the sawtooth waveform with reduced aliasing. IEEE Signal Process Lett 12(3):214–217CrossRefGoogle Scholar
  21. 21.
    Verma TS, Meng THY (2000) Extending spectral modeling synthesis with transient modeling synthesis. Comput Music J 24(2):47–59CrossRefGoogle Scholar
  22. 22.
    Yeh DY, Abel JS, Smith JO III (2010) Automated physical modeling of nonlinear audio circuits for real-time audio effects—part I: theoretical development. IEEE Trans Audio Speech Lang Process 18(4):728–737CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  • Myeongsu Kang
    • 1
  • Shohidul Islam
    • 1
  • Rashedul Islam
    • 1
  • Jong-Myon Kim
    • 1
  1. 1.School of Electrical, Electronic, and Computer EngineeringUniversity of UlsanUlsanSouth Korea

Personalised recommendations