Users Acting in Mixed Reality Interactive Storytelling

  • Marc Cavazza
  • Olivier Martin
  • Fred Charles
  • Steven J. Mead
  • Xavier Marichal
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2897)


Entertainment systems promise to be a significant application for Mixed Reality. Recently, a growing number of Mixed Reality applications have included interaction with synthetic characters and storytelling. However, AI-based Interactive Storytelling techniques have not yet been explored in the context of Mixed Reality. In this paper, we describe a first experiment in the adaptation of an Interactive Storytelling technique to a Mixed Reality system. After a description of the real time image processing techniques that support the creation of a hybrid environment, we introduce the storytelling technique and the specificities of user interaction in the Mixed Reality context. We illustrate these experiments by discussing examples obtained from the system.


Virtual World Gesture Recognition Mixed Reality Body Gesture Terminal Action 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barthes, R.: Introduction à l’Analyse Structurale des Récits (in French). Communications 8, 1–27 (1966)CrossRefGoogle Scholar
  2. 2.
    Cavazza, M., Charles, F., Mead, S.J.: Character-based Interactive Storytelling. IEEE Intelligent Systems, special issue on AI in Interactive Entertainment, 17–24 (2002)Google Scholar
  3. 3.
    Cavazza, M., Charles, F., Mead, S.J.: Under The Influence: Using Natural Language in Interactive Storytelling. In: 1st International Workshop on Entertainment Computing, IFIP Conference Proceedings, vol. 240, pp. 3–11. Kluwer, Dordrecht (2002)Google Scholar
  4. 4.
    Marichal, X., Umeda, T.: Real-Time Segmentation of Video Objects for Mixed- Reality Interactive Applications. In: Proceedings of the SPIE’s Visual Communications and Image Processing (VCIP 2003) International Conference, Lugano, Switzerland (2003)Google Scholar
  5. 5.
    Mead, S.J., Cavazza, M., Charles, F.: Influential Words: Natural Language in Interactive Storytelling. In: 10th International Conference on Human-Conputer Interaction, Crete, Greece, vol. 2, pp. 741–745 (2003)Google Scholar
  6. 6.
    Nandi, A., Marichal, X.: Senses of Spaces through Transfiction. In: Entertainment Computing: Technologies and Applications (Proceedings of the International Workshop on Entertainment Computing, IWEC 2002), pp. 439–446 (2002)Google Scholar
  7. 7.
    Nau, D., Cao, Y., Lotem, A., Muñoz-Avila, H.: SHOP: Simple hierarchical ordered planner. In: Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence, Stockholm, pp. 968–973. AAAI Press, Menlo Park (1999)Google Scholar
  8. 8.
    Salvador, E., Cavallaro, A., Ebrahimi, T.: Shadow identification and classification using invariant color models. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2001), Salt Lake City, USA (2001)Google Scholar
  9. 9.
    Special issue on Game engines in scientific research. Communications of the ACM 45(1) (January 2002)Google Scholar
  10. 10.
    Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiebaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the Holodeck: Integrating Graphics, Sound, Character and Story. In: Proceedings of the Autonomous Agents 2001 Conference (2001)Google Scholar
  11. 11.
    Michael Young, R., Riedl, M.: Towards an Architecture for Intelligent Control of Narrative in Interactive Virtual Worlds. In: Proceedings of the International Conference on Intelligent User Interfaces (January 2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Marc Cavazza
    • 1
  • Olivier Martin
    • 2
  • Fred Charles
    • 1
  • Steven J. Mead
    • 1
  • Xavier Marichal
    • 3
  1. 1.School of Computing and MathematicsUniversity of TeessideMiddlesbroughUnited Kingdom
  2. 2.Laboratoire de Télécommunications et TélédétectionUniversité catholique de LouvainLouvain-la-NeuveBelgium
  3. 3.AlterfaceLouvain-la-NeuveBelgium

Personalised recommendations