Skip to main content

The Effect of Frequency Shifting on Audio–Tactile Conversion for Enriching Musical Experience

  • Chapter
  • First Online:
Haptic Interaction

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 277))

Abstract

We have applied a frequency-shifting method, which was proposed previously in the literature for mixer manipulation, with the aim of generating vibration-based feedback to enrich the listener’s musical experience. Experimental results showed that the proposed method significantly increased the listener’s evaluation of sound consisting of high-frequency components, while a relatively poor evaluation was observed for sound containing low-frequency components.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Suzuki, Y., et al.: Selective effects of auditory stimuli on tactile roughness perception. Brain Res. 1242, 87–94 (2008)

    Article  Google Scholar 

  2. Yau, J.M., et al.: Separate mechanisms for audio-tactile pitch and loudness interactions. Front. Psychol. 1, 160 (2010)

    Article  Google Scholar 

  3. Yau, J.M., et al.: Temporal frequency channels are linked across audition and touch. Curr. Biol. 19, 561–566 (2009)

    Article  Google Scholar 

  4. Wilson, E.C., et al.: Integration of auditory and vibrotactile stimuli: effects of phase and stimulus-onset asynchrony. J. Acoust. Soc. Am. 126(4), 1960–1974 (2009)

    Article  Google Scholar 

  5. Wilson, E.C., Reed, C.M., Braida, L.D.: Integration of auditory and vibrotactile stimuli: effects of frequency. J. Acoust. Soc. Am. 127(5), 3044–3059 (2010)

    Article  Google Scholar 

  6. Wilson, E.C., et al.: Perceptual interactions in the loudness of combined auditory and vibrotactile stimuli. J. Acoust. Soc. Am. 127(5), 3038–3043 (2010)

    Article  Google Scholar 

  7. Kayser, C., et al.: Integration of touch and sound in auditory cortex. Neuron 48(2), 373–384 (2005)

    Article  Google Scholar 

  8. Altinsoy, E.M., et al.: Cross-modal frequency matching: sound and whole-body vibration. In: Proceeding of HAID2010. LNCS, vol. 6306, pp. 37–45. Springer, Berlin (2010)

    Google Scholar 

  9. Yoo, Y., et al.: Consonance perception of vibrotactile chords: a feasibility study. In: Proceedings of HAID2011. LNCS, vol. 6851, pp. 42–51. Springer, Berlin (2011)

    Google Scholar 

  10. Okazaki, R., et al.: Judged consonance of tactile and auditory frequencies. In: Proceedings of WHC2013, pp. 663–666 (2013)

    Google Scholar 

  11. Karam, M., et al.: Designing the model human cochlea: an ambient crossmodal audio-tactile display. IEEE Trans. Haptics 2(3), 160–169 (2009)

    Article  MathSciNet  Google Scholar 

  12. Karam, M., et al.: The emoti-chair: an interactive tactile music exhibit. In: Proceedings of CHI2010, pp. 3069–3074. ACM, New York City (2010)

    Google Scholar 

  13. Birnbaum, D.M., Wanderley, M.M.: A systematic approach to musical vibrotactile feedback. In: Proceedings of ICMC2007, pp. 397–404 (2007)

    Google Scholar 

  14. Lee, J., Choi, S.: Real-time perception-level translation from audio signals to vibrotactile effects. In: Proceedings of CHI2013, pp. 2567–2576. ACM, New York City (2013)

    Google Scholar 

  15. Lim, J.M., et al.: An audio-haptic feedback for enhancing user experience in mobile devices. In: Proceedings of ICCE2013, pp. 49–50 (2013)

    Google Scholar 

  16. Merchel, S., et al.: Tactile Identification of non-percussive music instruments. In: Proceedings of Forum Acusticum 2011, pp. 1257–1261 (2011)

    Google Scholar 

  17. Merchel, S., et al.: Touch the sound: audio-driven tactile feedback for audio mixing applications. J. Audio Eng. Soc. 60(1), 47–53 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ryuta Okazaki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Japan

About this chapter

Cite this chapter

Okazaki, R., Kuribayashi, H., Kajimoto, H. (2015). The Effect of Frequency Shifting on Audio–Tactile Conversion for Enriching Musical Experience. In: Kajimoto, H., Ando, H., Kyung, KU. (eds) Haptic Interaction. Lecture Notes in Electrical Engineering, vol 277. Springer, Tokyo. https://doi.org/10.1007/978-4-431-55690-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-4-431-55690-9_9

  • Published:

  • Publisher Name: Springer, Tokyo

  • Print ISBN: 978-4-431-55689-3

  • Online ISBN: 978-4-431-55690-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics