Abstract
Creating a mixed reality experience is a complicated endeavour. From our practice as a media lab in the artistic domain we found that engineering is “only” a first step in creating a mixed reality experience. Designing the appearance and directing the user experience are equally important for creating an engaging, immersive experience. We found that mixed reality artworks provide a very good test bed for studying these topics. This chapter details three steps required for authoring mixed reality experiences: engineering, designing and directing. We will describe a platform (VGE) for creating mixed reality environments that incorporates these steps. A case study (EI4) is presented in which this platform was used to not only engineer the system, but in which an artist was given the freedom to explore the artistic merits of mixed reality as an artistic medium, which involved areas such as the look and feel, multimodal experience and interaction, immersion as a subjective emotion and game play scenarios.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
References
Abawi DF, Dörner R, Haller M, Zauner J (2004) Efficient Mixed Reality Application Development. In Proc. 1st European Conference on Visual Media Production (CVMP).
Altena A, Debackere B (eds.) (2008) Sonic Acts XII: The Cinematic Experience. Sonic Acts Press/Paradiso, Amsterdam, The Netherlands.
Birn J (2000) Digital Lighting & Rendering (2nd ed.). New Riders Press, Berkely, CA.
Bourke P (1999) Calculating Stereo Pairs. Accessed 17 December 2008 http://local.wasp.uwa.edu.au/~pbourke/projection/stereorender/
Geiger C, Stöcklein J (2005) Mixed Reality Authoring Using the MIREA Approach. In Proc. International Conference on Humans and Computers (HC 2005), Volume 8.
Grasset R, Woods E, Billinghurst M (2008) Art and Mixed Reality: New Technology for Seamless Merging Between Virtual and Real. IMedia-Space Journal (Issue 1).
Kaltenbrunner M, Bencina R (2007) reacTIVision: A Computer-Vision Framework for Table-Based Tangible Interaction. In Proc. First International Conference on Tangible and Embedded Interaction (TEI07) Baton Rouge, Louisiana.
Klein G, Murray D (2007) Parallel Tracking and Mapping for Small AR Workspaces. In Proc. International Symposium on Mixed and Augmented Reality (ISMAR’07).
Looser J, Grasset R, Seichter H, Billinghurst M (2006) OSGART – A Pragmatic Approach to MR. In Proc. International Symposium on Mixed and Augmented Reality (ISMAR’06).
MacIntyre B (2002) Authoring 3D Mixed Reality Experiences: Managing the Relationship Between the Physical and Virtual Worlds. At ACM SIGGRAPH and Eurographics Campfire: Production Process of 3D Computer Graphics Applications – Structures, Roles and Tools.
MacIntyre B, Gandy M, Dow S, Bolter JD (2004) DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences. In Proc. Conference on User Interface Software and Technology (UIST’04).
Miyashita T, Meier P, Tachikawa T, Orlic S, Eble T, Scholz V, Gapel A, Gerl O, Arnaudov S, Lieberknecht S (2008) An Augmented Reality Museum Guide. In Proc. International Symposium on Mixed and Augmented Reality (ISMAR’08).
Navarro A (2008) Multisensor Data Fusion Applied to Augmented Reality, M.Sc. thesis, Man-Machine Interaction group of Delft University of Technology.
Rost RJ, Kessenich JM, Lichtenbelt B, Malan H, Weiblen M (2006) OpenGL Shading Language (2nd ed.). Addison-Wesley, Reading, MA.
Scherrer C, Pilet J, Fua P, Lepetit V (2008) The Haunted Book. In Proc. International Symposium on Mixed and Augmented Reality (ISMAR’08).
Steinman SB, Steinman BA, Garzia RP (2000) Foundations of Binocular Vision: A Clinical Perspective. McGraw-Hill Medical, New York.
Truong KP, Neerincx MA, van Leeuwen DA (2008) Measuring Spontaneous Vocal and Facial Emotion Expressions in Real World Environments. In Proc. 6th International Conference on Methods and Techniques in Behavioral Research, Maastricht, The Netherlands.
van Dartel M (2009) Truth in New Media Art Through Sensory-Motor Coordination. In Brejzek T, Greisenegger W (eds.) Monitoring scenography 2: Space and Truth. Zürich University of the Arts, Zürich, Switzerland.
van Dartel M, Misker JMV, Nigten A, van der Ster J (2007) Virtual Reality and Augmented Reality Art Explained in Terms of Sensory-Motor Coordination. In Luciani A, Cadoz C. (eds.) Proc. 4th International Conference on Enactive Interfaces, Grenoble, France.
Acknowledgments
This research is part of the MultimediaN Footnote 10 project, a Dutch research programme in which partners from science, business and art collaborate on researching multimodal interaction. Parts of the artistic research were supported by the Mondriaan Foundation in the scope of the “Better than Reality” project. We thank our colleagues in the V2_Lab, especially Artm Baguinski, Stock, Andres Navarro and Chiel Vaessen, for their collaboration and hard work on the VGE platform, Michel van Dartel and Anne Nigten gave us very useful feedback throughout the project. Furthermore, we extend our deepest gratitude to all artists who collaborated with us on this exciting topic over the past years: Marnix de Nijs, Jonas Hielscher and Boris Debackere; they provided invaluable insights.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London
About this chapter
Cite this chapter
Misker, J.M., van der Ster, J. (2010). Authoring Immersive Mixed Reality Experiences. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_14
Download citation
DOI: https://doi.org/10.1007/978-1-84882-733-2_14
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-732-5
Online ISBN: 978-1-84882-733-2
eBook Packages: Computer ScienceComputer Science (R0)