Skip to main content

Multimodal Interaction in a Collaborative Virtual Brainstorming Environment

  • Conference paper
Cooperative Design, Visualization, and Engineering (CDVE 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3190))

Abstract

In this paper we present our work in setting up a collaborative virtual environment (CVE) framework which is built to support collaborative creative meetings for geographically dispersed participants. Similar to real life, we rely on the use of quick drawings or sketches as a means of communication to convey new ideas, thoughts or other meta-data to other individuals. Furthermore, we concentrate on facilitating the (collaborative) interaction process through the use of four modalities. The first modality is direct manipulation, which is suit-able for direct interaction with the networked environment. Secondly, we look at interaction through gesturing symbols in order not to distract the user’s attention from the meeting. As a third modality we consider interaction through menu and widget manipulation. A fourth modality is established by a camera interface.We expect that the combination of the intuitive interface and the real-time visualisation of the virtual environment leads to a better understanding and realisation of one’s ideas in an early phase of the cooperation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Luo, Y., Sánchez, D., Bennasar, A., Fornés, J., Serra, J.C., Huéscar, J.M.: Visualization for cooperative architecture design systems. In: Proceedings of Sixth International Confer-ence on Information Visualisation (IV2002), pp. 497–501. IEEE Computer Society Press, Los Alamitos (2002)

    Chapter  Google Scholar 

  2. Rekimoto, J.: Pick-and-drop: A direct manipulation technique for multiple computer envi-ronments. In: Proceedings of the 10th annual ACM symposium on User interface software and technology, pp. 31–39. ACM Press, New York (1997)

    Chapter  Google Scholar 

  3. Sony: Sony Online Entertainment: everquest. World Wide Web (2004), http://www.everquest.com/

  4. Blizzard: Blizzard Entertainment: World of Warcraft. World Wide Web (2004), http://www.blizzard.com/wow/

  5. Rekimoto, J., Saitoh, M.: Augmented surfaces: A spatially continuous workspace for hy-brid computing environments. In: In Proceedings of Computer-Human Interaction (CHI1999), pp. 378–385 (1999)

    Google Scholar 

  6. Everitt, K.M., Klemmer, S.R., Lee, R., Landay, J.A.: Two worlds apart: Bridging the gap between physical and virtual media for distributed design collaboration. In: CHI Letters, Human Factors in Computing Systems (CHI2003), vol. 5, pp. 553–560 (2003)

    Google Scholar 

  7. Raymaekers, C., De Weyer, T., Coninx, K., Van Reeth, F., Flerackers, E.: ICOME: an Immersive Collaborative 3D Object Modelling Environment. In: Proceedings of Virtual Reality (VR1999), vol. 4, pp. 129–138 (1999)

    Google Scholar 

  8. Raymaekers, C., Coninx, K.: Menu interactions in a desktop haptic environment. In: Proceedings of Eurohaptics, pp. 49–53 (2001)

    Google Scholar 

  9. De Boeck, J., Raymaekers, C., Cuppens, E., De Weyer, T., Coninx, K.: Task-based ab-straction of haptic and multisensory applications. In: Proceedings of EuroHaptics (2004) (to be published)

    Google Scholar 

  10. 3Dconnexion. World Wide Web (2004), http://www.3dconnexion.com/

  11. Immersion. World Wide Web (2004), http://www.immersion.com/digitizer/

  12. SensAble. World Wide Web (2004), http://www.sensable.com/

  13. De Weyer, T., Coninx, K., Van Reeth, F.: Intuitive modeling and integration of imagina-tive 3D-scenes in the theatre. In: Richir, S., Richard, P., Taravel, B. (eds.) Proceedings of Virtual Reality International Conference (VRIC2001), pp. 167–173 (2001)

    Google Scholar 

  14. Sachs, E., Robert, A., Stoops, D.: 3-Draw: a tool for designing 3D shapes. IEEE Com-puter Graphics and Applications 11, 18–26 (1991)

    Article  Google Scholar 

  15. Zachmann: Distortion correction of magnetic fields for position tracking. In: Proceedings of Computer Graphics International (CGI 1997), pp. 213–220 (1997)

    Google Scholar 

  16. Kobayashi, M., Koike, H.: Enhanced desk, integrating paper documents and digital docu-ments. In: Proceedings of Asian Pacific Computer Human Interaction, pp. 57–62 (1998)

    Google Scholar 

  17. Oka, K., Sato, Y., Koike, H.: Real-time fingertip tracking and gesture recognition. IEEE Computer Graphics and Applications 22, 64–71 (2002)

    Article  Google Scholar 

  18. Vansichem, G., Wauters, E., Van Reeth, F.: Real-time modeled drawing and manipulation of stylized cartoon characters. In: Proceedings of the IASTED International Conference on Computer Graphics and Imaging, Honolulu, HI, USA, IASTED, pp. 44–49 (2001)

    Google Scholar 

  19. Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: A sketching interface for 3D freeform de-sign. In: Proceedings of SIGGRAPH, pp. 409–416. ACM, New York (1999)

    Google Scholar 

  20. Moran, T.P., van Melle, W.: Tivilo: Integrating structured domain objects into a free-form whiteboard environment. In: Proceedings of Computer-Human Interaction (CHI2000), vol. CHI 2000 Extended Abstracts, pp. 20–21. ACM, New York (2000)

    Google Scholar 

  21. Landay, J.A., Myers, B.A.: Interactive sketching for the early stages of user interface de-sign. In: Proceedings of Computer-Human Interaction (CHI1995), pp. 43–50. ACM, Vancouver (1995)

    Google Scholar 

  22. Bimber, O.: Rudiments for a 3D freehand sketch based human-computer interface for immersive virtual environments. In: Proceedings of Virtual Reality Software and Technology (VRST1999), pp. 182–183. ACM, New York (1999)

    Google Scholar 

  23. Green, M., Halliday, S.: A geometric modelling and animation system for virtual reality. Communications of the ACM 39, 46–53 (1996)

    Article  Google Scholar 

  24. Deering, M.: The holosketch VR sketching system. Communications of the ACM 39, 54–61 (1996)

    Article  Google Scholar 

  25. Kurtenbach, G., Fitzmaurice, G., Owens, R., Bauel, T.: The hotbox: Efficient access to a large number of menuitems. In: Proceedings of Computer-Human Interaction (CHI2000), pp. 231–237 (2000)

    Google Scholar 

  26. Anderson, T., Breckenridge, A., Davidson, G.: FBG: A graphical and haptic user interface for creating graphical, haptic user interfaces. In: Proceedings of the Fourth PHANToM Users Group Workshop, PUG 1999 (1999)

    Google Scholar 

  27. Insley, J., Sandin, D., DeFanti, T.: Using video to create avatars in virtual reality. In: Proceedings of SIGGRAPH, Los Angeles, CA, pp. 128–128 (1997)

    Google Scholar 

  28. Yura, S., Usaka, T., Sakamura, K.: Video avatar: Embedded video for collaborative virtual environment. In: Proceedings of the IEEE International Conference on Multimedia Com-puting and Systems, vol. 2, pp. 433–438 (1999)

    Google Scholar 

  29. Ogi, T., Yamada, T., Tamagawa, K., Hirose, M.: Video avatar communication in a net-worked virtual environment. In: Proceedings of INET2000 (2000)

    Google Scholar 

  30. Rajan, V., Subramanian, S., Johnson, A., Keenan, D., Sandin, D., DeFanti, T.: A realistic video avatar system for networked virtual environments. In: Proceedings of IPT 2002, Or-lando, FL (2002)

    Google Scholar 

  31. Quax, P., Jehaes, T., Jorissen, P., Lamotte, W.: A multi-user framework supporting video-based avatars. In: Proceedings of the 2nd workshop on Network and system support for games, pp. 137–147. ACM Press, New York (2003)

    Chapter  Google Scholar 

  32. Quax, P., Jehaes, T., Flerackers, C., Lamotte, W.: Scalable transmission of avatar video streams in virtual environments. In: Proceedings of the IEEE International Conference on Multimedia & Expo, ICME2004 (2004) (to be published)

    Google Scholar 

  33. Liesenborgs, J., Lamotte, W., Van Reeth, F.: Voice over IP with JVOIPLIB and JRTPLIB. In: 26th Annual IEEE Conference on Local Computer Networks (2001)

    Google Scholar 

  34. Skype.: World Wide Web (2004), http://www.skype.com/

  35. ANDROME NV.: World Wide Web (2004), http://www.androme.com/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Di Fiore, F., Vandoren, P., Van Reeth, F. (2004). Multimodal Interaction in a Collaborative Virtual Brainstorming Environment. In: Luo, Y. (eds) Cooperative Design, Visualization, and Engineering. CDVE 2004. Lecture Notes in Computer Science, vol 3190. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30103-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30103-5_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23149-3

  • Online ISBN: 978-3-540-30103-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics