Abstract
One of the new design goals in Human Computer Interaction is to extend the sensory-motor capabilities of computer systems to better match the natural communication means of human beings. This article proposes a dimension space that should help reasoning about current and future Multi-Sensori-Motor systems (MSM). To do so, we adopt a system centered perspective although we draw upon the “Interacting Cognitive Subsystems” psychological model. Our problem space is comprised of 6 dimensions. The first two dimensions deal with the notion of communication channel: the number and direction of the channels that a particular MSM system supports. The other four dimensions are used to characterize the degree of built-in cognitive sophistication of the system: levels of abstraction, context, fusion/fission, and granularity of concurrency. We illustrate the discussion with examples of multimedia and multimodal systems, both MSM systems but with distinct degrees of built-in cognitive sophistication.
Preview
Unable to display preview. Download preview PDF.
References
S. Balbo, J. Coutaz, D. Salber: Towards Automatic Evaluation of Multimodal User Interfaces; International Workshop on Intelligent User Interfaces, Orlando, USA, Jan., 1993.
P. Barnard, “Cognitive Resources and the Learning of Computer Dialogs”, in Interfacing Thought, Cognitive aspects of Human Computer Interaction, J.M. Carroll Ed., MIT Press Publ., pp. 112–158.
L. Bass, J. Coutaz: Developing Software for the User Interface; Addison Wesley, 1991.
E. Bier, S. Freeman, K. Pier, “MMM: The Multi-Device Multi-User Multi-Editor”, in CHI'92 Proceedings, 1992, pp. 645–646.
M.L. Bourguet, J. Caelen: Interfaces Homme-Machine Multimodales: gestion des événements et représentation des informations; ERGO-IA'92 Proceedings, pp. 124–134, 1992.
M.L. Bourguet: Conception et réalisation d'une interface de dialogue personnemachine multimodales; Thèse de docteur de lTNPG, mars 1992.
J. Conklin, “Hypertext, an Introduction and Survey”, IEEE Computer, 20(9), September, 1987, 17–41.
J. Coutaz, S. Balbo: Applications: A Dimension Space for User Interface Management Systems. In Proc. CHI'91, ACM Publ., May, 1991, pp. 27–32.
Multimedia and Multimodal User Interfaces: A Taxonomy for Software Engineering Research Issues, East-West HCI'92, St Petersburg, August, 1992., August, 1992.
D. Duke, M. Harrison: Abstract Models for Interaction Objects; ESPRIT BR 7040 Amodeus Project document, System Modelling/WP1, Nov. 1992.
S.S. Fels, “Building Adaptative Interfaces with Neural Networks: the Glove-Talk Pilot Study”, University of Toronto, Technical Report, CRG-TR-90-1, February, 1990.
J. Neal, C. Thielman, K. Bettinger, J. Byoun, “Multi-modal References in Human-Computer Dialogue”, Proceedings of AAAI-88, 1988, pp. 819–823.
L. Nigay, J. Coutaz: A design space for multimodal interfaces: concurrent processing and data fusion, Interchi'93, Amsterdam, May, 1993.
M. W. Salisbury, J. H. Hendrickson, T. L. Lammers, C. Fu, S. A. Moody, “Talk and Draw: Bundling Speech and Graphics”, IEEE Computer, 23(8), August, 1990, 59–65.
C. Schmandt, M. S. Ackerman, D. Hndus, “Augmenting a Window System with Speech Input”, IEEE Computer, 23(8), August, 1990, 50–58.
J. Wretö, J. Caelen, “ICP-DRAW, rapport final du projet ESPRIT MULTIWORKS no 2105.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1993 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Coutaz, J., Nigay, L., Salber, D. (1993). The MSM framework: A design space for Multi-Sensori-Motor systems. In: Bass, L.J., Gornostaev, J., Unger, C. (eds) Human-Computer Interaction. EWHCI 1993. Lecture Notes in Computer Science, vol 753. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-57433-6_52
Download citation
DOI: https://doi.org/10.1007/3-540-57433-6_52
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-57433-0
Online ISBN: 978-3-540-48152-2
eBook Packages: Springer Book Archive