Abstract
Nowadays, designers of Virtual Reality (VR) applications are faced with the choice of a large number of different input and output devices leading to a growing number of interaction techniques. Usually VR interaction techniques are described informally, based on the actions users can perform within the VR environment. At implementation time, such informal descriptions (made at design time) yield to ambiguous interpretations by the developers. In addition, informal descriptions make it difficult to foresee the impact throughout the application of a modification of the interaction techniques. This paper discusses the advantages of using a formal description technique (called ICO) to model interaction techniques and dialogues for VR applications. This notation is presented via a case study featuring an immersive VR application. The case study is then used to show, through analysis of models, how the formal notation can help to ensure the usability, reliability and efficiency of virtual reality systems.
Chapter PDF
References
Bach, C., Scapin, D.: Adaptation of Ergonomic Criteria to Human-Virtual Environments Interactions. In: INTERACT 2003, pp. 880–883. IOS Press, Amsterdam (2003)
Bass, L., Pellegrino, R., Reed, S., Seacord, R., Sheppard, R., Szezur, M.R.: The Arch model: Seeheim revisited. In: User Interface Developer’s workshop version 1.0 (1991)
Bastide, R., Navarre, D., Palanque, P., Schyn, A., Dragicevic, P.: A Model-Based Approach for Real-Time Embedded Multimodal Systems in Military Aircrafts. In: Sixth International Conference on Multimodal Interfaces (ICMI 2004), Pennsylvania State University, USA, October 14-15 (2004)
Bastide, R., Navarre, D., Palanque, P.: A Model-Based Tool for Interactive Prototyping of Highly Interactive Applications. In: ACM SIGCHI 2002 (Extended Abstracts), pp. 516–517 (2002)
Bastide, R., Palanque, P., Le Duc, H., Muñoz, J.: Integrating Rendering Specification into a Formalism for the Design of Interactive Systems. In: 5th Eurographics Workshop on Design, Specification and Verification of Interactive Systems (DSV-IS 1998). Springer, Heidelberg (1998)
Bowman, D., Johnson, D.B., Hodges, L.F.: Testbed evaluation of virtual environments interaction techniques. In: ACM Symposium on Virtual Reality Software and Technology, pp. 26–33 (1999)
Bowman, D., Kruijff, E., Laviola Jr., J.J., Poupyrev, I.: An introduction to 3-D User Interface Design. Presence: Teleoperators and Virtual Environments 10(1), 96–108 (2001)
Buxton, W.: A three-state model of graphical input. In: 3rd IFIP International Conference on Human-Computer Interaction, INTERACT 1990, Cambridge, UK, August 27-31, pp. 449–456 (1990)
Campos, J.C., Harrison, M.D.: Formally verifying interactive systems: A review. In: Design, Specification and Verification of Interactive Systems 1997, pp. 109–124. Springer Computer Science, Heidelberg (1997)
Coutaz, J., Paterno, P., Faconti, G., Nigay, L.: A comparison of Approaches for Specifying Multimodal Interactive Systems. In: Proceedings of ERCIM, Nancy, France (1993)
Dubois, E., Gray, P.D., Nigay, L.: ASUR++: a Design Notation for Mobile Mixed Systems. IWC Journal, Special Issue on Mobile HCI 15(4), 497–520 (2003)
Genrich, H.J.: Predicte/Transiion Nets. In: Jensen, K., Rozenberg, G. (eds.) High-Level Petri: Theory and Applications, pp. 3–43. Springer, Heidelberg (1991)
Hinckley, K., Czerwinski, M., Sinclair, M.: Interaction and Modeling Techniques for Desktop Two-Handed Input (1998), http://research.microsoft.com/users/kenh/papers/two-hand.pdf
Latoschik, M.E.: Designing Transition Networks for Multimodal VR-Interactions Using a Markup Language. In: IEEE International Conference on Multimodal Interfaces (ICMI 2002) Proceedings (2002)
Märtin, C.: A method engineering framework for modeling and generating interactive applications. In: 3rd International Conference on Computer-Aided Design of User Interfaces, Belgium (1999)
Nedel, L.P., Freitas, C.M.D.S., Jacob, L.J., Pimenta, M.S.: Testing the Use of Egocentric Interactive Techniques in Immersive Virtual Environments. In: IFIP TC 13 Conference INTERACT 2003, on Human Computer Interaction, pp. 471–478. IOS Press, Zurich (2003)
Palanque, P., Schyn, A.: A Model-Based Approach for Engineering Multimodal Interactive Systems. In: IFIP TC 13 INTERACT 2003 conference. IOS Press, Amsterdam (2003)
Poupyrev, I., Weghorst, S., Billinghurst, M., Ichikawa, T.: Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques. In: Computer Graphics Forum, Eurographics 1998 issue, vol. 17(3), pp. 41–52 (1998)
Jacob, R., Deligiannidis, L., Morrison, S.: A software model and specification language for non-WIMP user interfaces. ACM ToCHI 6(1), 1–46 (1999)
Smith, S., Duke, D.: Virtual environments as hybrid systems. In: Eurographics UK 17th Annual Conference Proceedings, pp. 113–128 (1999)
Smith, S., Duke, D.: The Hybrid World of Virtual Environments. In: Computer Graphics Forum, vol. 18(3), The Eurographics Association and Blackwell Publishers (1999)
Smith, S., Duke, D.: Using CSP to specify interaction in virtual environment. Technical report YCS 321, University ok York – Department of Computer Science (1999)
Sutcliffe, A., Gault, B., de Bruijn, O.: Comparing Interaction in the Real World and CAVE virtual environments. In: 18th HCI 2004, Leeds Metropolitan University, UK, September 6-10 (2004)
Van Schooten, B.W., Donk, O.A., Zwiers, J.: Modelling Interaction in Virtual Environments using Process Algebra. In: Proceedings TWLT 15: Interactions in Virtual Worlds, May 19-21 (1999)
Willans, J., Harrison, M.: A toolset supported approach for designing and testing virtual environment interaction techniques. International Journal of Human-Computer Studies 55(2), 145–165 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 IFIP International Federation for Information Processing
About this paper
Cite this paper
Navarre, D. et al. (2005). A Formal Description of Multimodal Interaction Techniques for Immersive Virtual Reality Applications. In: Costabile, M.F., Paternò, F. (eds) Human-Computer Interaction - INTERACT 2005. INTERACT 2005. Lecture Notes in Computer Science, vol 3585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11555261_17
Download citation
DOI: https://doi.org/10.1007/11555261_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28943-2
Online ISBN: 978-3-540-31722-7
eBook Packages: Computer ScienceComputer Science (R0)