Analysis of Tactual Impression by Audio and Visual Stimulation for User Interface Design in Mixed Reality Environment

  • Mami Kagimoto
  • Asako Kimura
  • Fumihisa Shibata
  • Hideyuki Tamura
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5622)


In a mixed-reality (MR) environment, a touchable object can be made to change its appearance when a computer-generated image (MR visual stimulation) is superimposed onto it. In this research, we conduct experiments to study the effects of MR visual and audio stimuli on the tactual impression of the “roughness” of an object. We show that MR visual stimulation alters a subject’s tactual impression of the roughness of an object and that the addition of MR audio stimulation intensifies that effect.


Mixed Reality Tactual Impression Psychophysical Influence and Visual and Audio Stimulation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ohta, Y., Tamura, H. (eds.): Mixed Reality - Merging real and virtual worlds. Ohm-sha & Springer (1999)Google Scholar
  2. 2.
    MacIntyre, B., Livingston, M.A. (Special Session) Moving mixed reality into the real worlds. IEEE Computer Graphics and Applications 25(6), 22–56 (2005)CrossRefGoogle Scholar
  3. 3.
    Ohshima, T., Kuroki, T., Yamamoto, H., Tamura, H.: A mixed reality system with visual and tangible interaction capability: Application to evaluating automobile interior design. In: Proc. 2nd IEEE and ACM Int. Symp. on Mixed and Augmented Reality (ISMAR 2003), pp. 284–285 (2003)Google Scholar
  4. 4.
    Iesaki, A., Somada, A., Kimura, A., Shibata, F., Tamura, H.: Psychophysical influence on tactual impression by mixed-reality visual stimulation. In: Proc. IEEE Virtual Reality 2008, pp. 265–267 (2008)Google Scholar
  5. 5.
    Lederman, S.J., Abott, S.G.: Texture perception: Studies on intersensory organization using a discrepancy paradigm and visual versus textual psychophysics. J. Experimental Psychology: Human Perception and Performance 7, 902–915 (1981)Google Scholar
  6. 6.
    Biocca, F., Kim, J., Choi, Y.: Visual touch in virtual environments: An exploratory study of presence, ultimodal interfaces, and cross-modal sensory illusions. Presence 10(3), 247–265 (2001)CrossRefGoogle Scholar
  7. 7.
    Jousmäki, V., Hari, R.: Parchment-skin illusion: sound-biased touch. Current Biology 8, 190 (1998)CrossRefGoogle Scholar
  8. 8.
    Guest, S., Catmur, C., Lloyd, D., Spence, C.: Audiotactile interactions in roughness perception. Experimental Brain Research 146, 161–171 (2002)CrossRefGoogle Scholar
  9. 9.
    Constantinou, C.E., Omata, S., Murayama, Y.: Multisensory surgical support system incorporating, tactile, visual and auditory perception modalities. In: Proc. 4th Int. Conf. on Computer and Information Technology, pp. 870–874 (2004)Google Scholar
  10. 10.

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mami Kagimoto
    • 1
  • Asako Kimura
    • 2
  • Fumihisa Shibata
    • 1
  • Hideyuki Tamura
    • 1
  1. 1.Graduate School of Science and EngineeringRitsumeikan UniversityKusatsuJapan
  2. 2.PRESTO, Japan Science and Technology AgencySaitamaJapan

Personalised recommendations