An Initial Study on Pitch Correction Guidance for String Instruments Using Haptic Feedback

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8618)


Learning to play a string instrument takes years of practice. Novice players even find it difficult to play correct pitches, and chromatic tuners that visualize the errors in the played pitches have long been used as an effective aid. However, chromatic tuners can detract users’ visual attention from more essential visual cues such as musical scores. As an alternative, we have been developing HapTune (Haptic Tuner), which conveys the pitch errors to the user using haptic feedback. In this paper, we present an initial design of HapTune that relies on spatiotemporal information coding using two vibrotactile actuators. We also verified that the vibrotactile stimuli provided by HapTune can be easily recognized by a user experiment.


Haptic Feedback Android Application Vibrotactile Stimulus Pitch Error Vibrotactile Feedback 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported in part by NRF through a Mid-Career Researcher Grant 2013R1AA2A2A01016907, a Pioneer program 2011-0027994 and a Global Ph.D. Fellowship 2011-0008614, and by NIPA through an ITRC 2013-H0301-13-3005.


  1. 1.
    Choi, S., Kuchenbecker, K.J.: Vibrotactile display: perception, technology and applications. Proc. of IEEE, 1–12 (2012). 0018–9219Google Scholar
  2. 2.
    Holland, S., Bouwer, A.J., Dalgelish, M., Hurtig, T.M.: Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit. In: Proceedings of the TEI 2010, pp. 21–28. ACM (2010).
  3. 3.
    Konczak, J., van de Geer, J.P., der Velden, H., Jaeger, L.: Learning to play the violin: motor control by freezing, not freeing degrees of freedom. J. Motor. Behav. 41(3), 243–252 (2009)CrossRefGoogle Scholar
  4. 4.
    Lee, I., Choi, S.: Effects of multi-modal guidance for the acquisition of sight reading skills: a case study with simple drum sequences. In: Proceedings of the WHC 2013, pp. 571–576 (2013)Google Scholar
  5. 5.
    van der Linden, J., Schoonderwaldt, E., Bird, J., Johnson, R.: Musicjacket - combining motion capture and vibrotactile feedback to teach violin bowing. IEEE Trans. Instrum. Meas. 60(1), 104–113 (2011)CrossRefGoogle Scholar
  6. 6.
    Lu, H., Zhang, B., Wang, Y., Leow, W.K.: idvt: an interactive digital violin tutoring system based on audio-visual fusion. In: Proceedings of the MM 2008, pp. 1005–1006. ACM (2008).
  7. 7.
    Ng, K.C., Weyde, T., Larkin, O., Neubarth, K., Koerselman, T., Ong, B.: 3D augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support. In: Proceedings of the ICMI 2007, pp. 339–345. ACM (2007).
  8. 8.
    Rubato Productions: Concert hands.
  9. 9.
    Yin, J., Wang, Y., Hsu, D.: Digital violin tutor: an integrated system for beginning violin learners. In: Proceedings of the MM 2005, pp. 976–985. ACM (2005)Google Scholar
  10. 10.
    Yoo, Y., Hwang, I., Choi, S.: Consonance perception of vibrotactile chords: a feasibility study. In: Cooper, E.W., Kryssanov, V.V., Ogawa, H., Brewster, S. (eds.) HAID 2011. LNCS, vol. 6851, pp. 42–51. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  11. 11.
    Yoo, Y., Hwang, I., Choi, S.: Consonance of vibrotactile chords. IEEE Trans. Haptics (2014) .

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.Pohang University of Science and Technology (POSTECH)PohangSouth Korea

Personalised recommendations