Abstract
An experimental hardware and software platform aimed at enriching a graphic user interface (GUI) through the use of auditory and haptic information is described. MUIS (Multimodal User Interface System) allows for the design and creation of multimodal feedback interfaces, and includes a force-feedback device with three degrees of freedom: the Pantograph. Interface objects (windows, icons and pop-up menus) are represented in a physical structure that is well adapted to the real-time synthesis of coherent and redundant sounds and forces.
Key Words
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Blattner, M., Sumikawa, D & Greenberg, R. (1989) “Earcons and icons: their structure and common design principle”. Human-ComputerInteraction, 4(1), pp. 11–44, 1989.
Cadoz, C., Lizowski L. & Florens, J. L. (1990). “Modular Feedback Keyboard.” Computer Music Journal, 14, N2, p. 47–5. MIT Press, Cambridge Mass (1990).
Coutaz, J. & Caellen J. (1990). “PRC communication homme-machine: opération de recherche concertée interface homme-machine multimodale,” June 1990.
Dufresne, A., Martial, O. & Ramstein C. (1994) “Multimodal User Interface System for Blind and ”Visually Occupied“ Users: ergonomic evaluation of the haptic and auditive dimensions”, In submission.
Gaver, W. (1986). “Auditory icons: using sounds in computer interfaces”. Human-Computer Interaction, 2, pp. 167–177.
Gaver, W. (1993) “Synthesizing Auditory Icons.” Interchi ’83, pp. 228–235, April 24–29, 1993.
Hayward, V., Choksi J., Lanvin G. & Ramstein C. (1994). “Design and Multi-Objective Optimization of a Linkage for a Haptic Device.” Proc. of the 4th Workshop on Advances in Robot Kinematics, ARK ’ 94.July 1994. Ljubljana, Slovenia. Published by Kluver Academic.
Matther, M. (1994) “Force feedback button for the PANTOGRAPH.” CITI research report, March 1994.
Minski, M., Ouh-Young, M., Steele, O., & Brooks, F. P. J. (1990) “Feeling and Seeing: Issue in Force Display.” Computer Graphics 24 (2), April 1990, pp. 235–243.
Ramstein, C. & Hayward, V. (1994). “The Pantograph: A Large Workspace Haptic Device for Multimodal Interaction.” In proceedings of the CHI ’84 Conference, Interactive Experience, Boston, 1994.
Ramstein, C., Martial, O. & Dufresne A. (1994). “Évaluation ergonomique d’une interface à rétroaction bimodale conçue avec le MUTS ( Multimodal User Interface System).” CITI research report, July 1994.
Sherrington, C. S. (1920) “Integrative Action of the Nervous System.” New Haven: Yale University Press, 1920.
Welch, R. B & D. H. Warren (1987) “Intersensory Interactions.” In Handbook of Perception and Human Performance, Volume I, Section IV, 1987.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1995 IFIP International Federation for Information Processing
About this chapter
Cite this chapter
Ramstein, C. (1995). A Multimodal User Interface System with Force Feedback and Physical Models. In: Nordby, K., Helmersen, P., Gilmore, D.J., Arnesen, S.A. (eds) Human—Computer Interaction. IFIP Advances in Information and Communication Technology. Springer, Boston, MA. https://doi.org/10.1007/978-1-5041-2896-4_26
Download citation
DOI: https://doi.org/10.1007/978-1-5041-2896-4_26
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-5041-2898-8
Online ISBN: 978-1-5041-2896-4
eBook Packages: Springer Book Archive