Abstract
Multi-modal signal fusion is an important way to improve immersion and fidelity of virtual reality training systems. With the help of a robotic arm, haptic device, it is possible to supply haptic-visual-audio display for training dentist. Architecture is firstly proposed to integrate different signals in a training system. High efficient sound synthesis algorithm is proposed based on hybrid combination of parameter identification from recorded sound signal, then use signal synthesis method to form final sound signal. Mapping method among audio, haptic and visual signal is proposed based on parameter mapping under various interaction status. Experiment based on Phantom desktop proves the stability of the rendering algorithm and the improved fidelity after adding audio feedback to current haptic-visual dental training system
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Robert Riener, et al. Phantom-Based Multimodal Interactions for Medical Education and Training: The Munich Knee Joint Simulator. IEEE Trans. On Information Technology in Biomedicine, 2004, 8(2)
Daniel Wang, et al., Cutting on Triangle Mesh Local Model based haptic display for dental preparation surgery simulation, IEEE Transaction on Visual. and Computer Graphic, No. 6, 2005, p671–683
Hiroaki Yano, Hiromi Igawa, et al. Audio and Haptic Rendering Based on a Physical Model. Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Tele-operator Systems. (HAPTICS’04) p. 250–257
H.Baier M., Buss F., et al. Distributed PC-Based Haptic, Visual and Acoustic Telepresence System — Experiments in Virtual and Remote Environments, IEEE Virtual Reality Conference. 1999 (VR’99) p.118
K. Doel, D. Pai. The Sounds of Physical Shapes, Presence, 1998, 7(4): pp. 382–395
William L. Martens, Wieslaw Woszczyk, Vibration in the Display of Impact Events in Auditory and Haptic Virtual Environments. In: October 2–3.2002. Proc. IEEE. Workshop on Haptic Audio Visual Environments, Ottawa, Ontario. pp.47–57
Lonny L. Chu. User Performance and Haptic Design Issues for a Force-Feedback Sound Editing Interface. Proceedings of 2004 New Interfaces for Musical Expression. pp.112–119
R. Iglesias, S. Casado, et al., Computer Graphics Access for Blind People through a Haptic and Audio Virtual Environment. Revista Integracion, 2004, 29(3):pp48–60
http://www.dcs.gla.ac.uk/~mcgookdk/multivis/workshop.html Workshop on haptic and audio interaction design, University of Glasgow, 2006.
MSDN, Microsoft developer network manual, 2001, http://www.microsoft.com
GHOST® SDK Programmer’s Guide Version 4.0, SensAble Technologies, Inc. 2002, http://www.sensable.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Wang, D., Zhang, Y., Sun, Z. (2007). Multi-modal Virtual Reality Dental Training System with Integrated Haptic-Visual-Audio Display. In: Tarn, TJ., Chen, SB., Zhou, C. (eds) Robotic Welding, Intelligence and Automation. Lecture Notes in Control and Information Sciences, vol 362. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73374-4_54
Download citation
DOI: https://doi.org/10.1007/978-3-540-73374-4_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73373-7
Online ISBN: 978-3-540-73374-4
eBook Packages: EngineeringEngineering (R0)