Abstract
In the past few years, multimodal interaction is gaining importance in virtual environments. Although multimodality makes interaction with the environment more intuitive and natural for the user, the development cycle of such an environment is often a long and expensive process. In our overall field of research, we investigate how model-based design can help shorten this process by designing the application with the use of high-level diagrams. In this scope, we developed ‘NiMMiT’, a graphical notation especially suitable for expressing multimodal user interaction. We have already experienced the benefits of NiMMiT in several in-house applications, and are currently assessing the value of NiMMiT with respect to existing notations. In this paper we report on our comparison of NiMMiT against some well known data-driven modeling notations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
De Boeck, J., Raymaekers, C., Coninx, K.: Aspects of haptic feedback in a multi-modal interface for object modelling. Virtual Reality Journal 6, 257–270 (2003)
De Boeck, J., et al.: Multisensory interaction metaphors with haptics and proprioception in virtual environments. In: Proceedings of the third ACM Nordic Conference on Human-Computer Interaction (NordiCHI 2004), Tampere, FI (2004)
Pierce, J., Stearns, B., Pausch, R.: Voodoo dolls: seamless interaction at multiple scales in virtual environments. In: Proceedings of symposium on interactive 3D graphics, Atlanta, GA, USA (1999)
Harel, D.: Statecharts: A visual formalism for complex systems. Science of Computer Programming 8, 231–274 (1987)
Jensen, K.: An introduction to the theoretical aspects of coloured petri nets. In: de Bakker, J.W., de Roever, W.-P., Rozenberg, G. (eds.) REX 1993. LNCS, vol. 803, pp. 230–272. Springer, Heidelberg (1994)
Ambler, S.: Object Primer, The Agile Model-Driven Development with UML 2.0. Cambridge University Press, Cambridge (2004)
Figueroa, P., Green, M., Hoover, H.: InTml: A description language for VR applications. In: Proceedings of Web3D’02, Arizona, USA (2002)
Dragicevic, P., Fekete, J.D.: Support for input adaptability in the ICON toolkit. In: Proceedings of the 6th international conference on multimodal interfaces (ICMI04), State College, PA, USA, pp. 212–219 (2004)
Bastide, R., et al.: A Formal Description of Multimodal Interaction Techniques for Immersive Virtual Reality Applications. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 170–183. Springer, Heidelberg (2005)
Palanque, P., Bastide, R.: Petri net based design of user-driven interfaces using the interactive cooperative objects formalism. In: Interactive Systems: Design, Specification, and Verification, pp. 383–400. Springer, Heidelberg (1994)
Coninx, K., et al.: Integrating support for usability evaluation into high level interaction descriptions with NiMMiT. In: Doherty, G., Blandford, A. (eds.) DSVIS 2006. LNCS, vol. 4323, Springer, Heidelberg (2007)
Vanacken, D., et al.: NiMMiT: A notation for modeling multimodal interaction techniques. In: Proceedings of the International Conference on Computer Graphics Theory and Applications (GRAPP06), Setúbal, Portugal (2006)
Coutaz, J., et al.: Four easy pieces for assessing the usability of multimodal interaction: The CARE properties. In: Proceedings of INTERACT95, Lillehammer, pp. 115–120 (1995)
Green, T.: Cognitive dimensions of notations. In: People and Computers, pp. 443–460. Cambridge University Press, Cambridge (1989)
Green, T., Blackwell, A.: Cognitive dimensions of information artefacts: a tutorial (2005), http://www.ndirect.co.uk/~thomas.green/workstuff/papers/
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
De Boeck, J., Raymaekers, C., Coninx, K. (2007). Comparing NiMMiT and Data-Driven Notations for Describing Multimodal Interaction. In: Coninx, K., Luyten, K., Schneider, K.A. (eds) Task Models and Diagrams for Users Interface Design. TAMODIA 2006. Lecture Notes in Computer Science, vol 4385. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70816-2_16
Download citation
DOI: https://doi.org/10.1007/978-3-540-70816-2_16
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70815-5
Online ISBN: 978-3-540-70816-2
eBook Packages: Computer ScienceComputer Science (R0)