Tangible Mixed Reality On-Site: Interactive Augmented Visualisations from Architectural Working Models in Urban Design

  • Gerhard SchubertEmail author
  • David Schattel
  • Marcus Tönnis
  • Gudrun Klinker
  • Frank Petzold
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 527)


The consequences of architectural planning and design decisions made in the early design phases are hard to foresee. While professionals are used to reading plans and understanding architectural models, most laypeople are not familiar with their abstractions. This can lead to misinterpretations and misunderstandings between the different participants in the design process, especially in complex building situations, and decisions can be made or rejected that can have far-reaching consequences for the remainder of the project.

In this paper we describe the concept and prototypical implementation of a decision-support system for the early design and discussion stages of urban design projects that aims to address precisely this problem. The setup directly connects physical volumetric models and hand-drawn sketches with an interactive, mixed-reality visualization presented on a tablet or mobile phone, making it possible to see an interactive real-time view of an architectural design within the context of the actual site. In addition, the system is able to incorporate interactive simulations conducted on the model and presented in the AR-view.


Early design stages Urban design HCI Tangible interfaces Immersive environment Simulations 


  1. 1.
    Schubert, G., Artinger, E., Petzold, F., Klinker, G.: Bridging the gap - a (collaborative) design platform for early design stages. In: Zupančič-Strojan, T., Juvančič, M., Verovšek, Š., Jutraž, A. (eds.) Respecting fragile places. Proceedings of the 29th Conference on Education in Computer Aided Architectural Design in Europe, Ljubljana, Slovenia, 21–24 September 2011, eCAADe, Education and Research in Computer Aided Architectural Design in Europe; Faculty of Architecture, Brussels, Ljubljana, pp. 187–193 (2011)Google Scholar
  2. 2.
    Schubert, G., Artinger, E., Petzold, F., Klinker, G.: Tangible tools for architectural design: seamless integration into the architectural workflow. In: Taron, J.M. (ed.) Integration Through Computation. Proceedings of the ACADIA 2011. Association for Computer Aided Design in Architecture, Stoughton, WI, pp. 252–259 (2011)Google Scholar
  3. 3.
    Schubert, G.: Interaktionsformen für das digitale Entwerfen. Konzeption und Umsetzung einer rechnergestützten Entwurfsplattform für die städtebaulichen Phasen in der Architektur. Dissertation, Technische Universität München (2014)Google Scholar
  4. 4.
    Chi, H.-L., Kang, S.-C., Wang, X.: Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Autom. Constr. 33, 116–122 (2013)CrossRefGoogle Scholar
  5. 5.
    Underkoffler, J., Ishii, H.: Urp: a luminous-tangible workbench for urban planning and design. CHI 99, 386–393 (1999)Google Scholar
  6. 6.
    Dalsgaard, P., Halskov, K.: Tangible 3D tabletops: combining tangible tabletop interaction and 3D projection. In: Malmborg, L., Pederson, T. (eds.) NordiCHI 2012. Making Sense Through Design. Proceedings of the 7th Nordic Conference on Human-Computer Interaction, Copenhagen, Denmark, pp. 14–17 (2012)Google Scholar
  7. 7.
    Broll, W., Stoerring, M., Mottram, C.: The augmented round table - a new interface to urban planning and architectural design. In: Rauterberg et al. (ed.) Human-Computer Interaction - Interact’03, pp. 1103–1104 (2003)Google Scholar
  8. 8.
    Seichter, H., Schnabel, M.A.: Digital and tangible sensation: an augmented reality urban design studio. In: Lee, H.S., Choi, J.W. (eds.) CAADRIA 2004. Proceedings of the 9th International Conference on Computer-Aided Architectural Design Research in Asia, Yonsei University Press, Seoul, pp. 193–202 (2004)Google Scholar
  9. 9.
    Seichter, H.: Sketchand+ a collaborative augmented reality sketching application. In: Choutgrajank, A. (ed.) CAADRIA 2003. Proceedings of the 8th International Conference on Computer-Aided Architectural Design Research in Asia. CAADRIA, Bangkok, Thailand, pp. 18–20 October 2003, Master of Science Program in Computer-Aided Architectural Design, Faculty of Architecture, Rangsit University, Thailand, pp. 209–222 (2003)Google Scholar
  10. 10.
    Välkkynen, P., Siltanen, S., Väätänen, A., Oksman, V., Honkamaa, P., Ylikauppila, M.: Developing mixed reality tools to support citizen participation in urban planning. In: ExS 2.0: Exploring Urban Spaces in the Web 2.0 Era, Munich, Germany (2013)Google Scholar
  11. 11.
    Wagner, I., Basile, M., Ehrenstrasser, L., Maquil, V., Terrin, J.-J., Wagner, M.: Supporting community engagement in the city: urban planning in the MR-tent. In: Carroll, J.M. (ed.) C & T’09. Proceedings of the 4th International Conference on Communities and Technologies, University Park, Pennsylvania, USA, 25–27 June 2009, ACM Press, New York, pp. 185–194 (2009)Google Scholar
  12. 12.
    Sareika, M., Schmalstieg, D.: Urban sketcher: mixed reality on site for urban planning and architecture. In: ISMAR 2007, 6th IEEE and ACM International Symposium on Mixed and Augmented Reality. IEEE, Piscataway (2007)Google Scholar
  13. 13.
    Allen, M., Regenbrecht, H., Abbott, M.: Smart-phone augmented reality for public participation in urban planning. In: Paris, C., Colineau, N., Farrell, V., Farrell, G., Huang, W. (eds.) Proceedings of the 23rd Australian Computer-Human Interaction Conference (OzCHI 2011). Held at the Australian National University, Canberra in cooperation with the ACM SIGCHI, pp. 11–20, 28 Nov–2 Dec 2011Google Scholar
  14. 14.
    Wang, X., Truijens, M., Hou, L., Wang, Y., Zhou, Y.: Integrating augmented reality with building information modeling: onsite construction process controlling for liquefied natural gas industry. Autom. Constr. 40, 96–105 (2014)CrossRefGoogle Scholar
  15. 15.
    Kwon, O.-S., Park, C.-S., Lim, C.-R.: A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality. Autom. Constr. 46, 74–81 (2014)CrossRefGoogle Scholar
  16. 16.
    Zollmann, S., Hoppe, C., Kluckner, S., Poglitsch, C., Bischof, H., Reitmayr, G.: Augmented reality for construction site monitoring and documentation. Proc. IEEE 102, 137–154 (2014)CrossRefGoogle Scholar
  17. 17.
    Sørensen, S.S.: Augmented reality for improved communication of construction and maintenance plans in nuclear power plants. In: Yoshikawa, H., Zhang, Z. (eds.) Progress of Nuclear Safety for Symbiosis and Sustainability. Advanced Digital Instrumentation, Control and Information Systems for Nuclear Power Plants, pp. 269–274. Springer, Japan (2014)CrossRefGoogle Scholar
  18. 18.
    Schattel, D.: On-site mobile augmented reality by means of network managed architectural design content. Master’s Thesis, Technische Universität München (2014)Google Scholar
  19. 19.
    Schubert, G., Riedel, S., Petzold, F.: Seamfully connected: real working models as tangible interfaces for architectural design. In: Zhang, J., Sun, C. (eds.) CAAD Futures 2013. CCIS, vol. 369, pp. 210–221. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  20. 20.
    Schubert, G., Artinger, E., Yanev, V., Petzold, F., Klinker, G.: 3D virtuality sketching: interactive 3D-sketching based on real models in a virtual scen. In: Cabrinha, M., Johnson, J.K., Steinfeld, K. (eds.) Proceedings of the 32nd Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA), Synthetic Digital Technologies. Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA), San Francisco, 18–21 Oktober, pp. 409–418. The Printing House Inc., WI, ACADIA, San Francisco (2012)Google Scholar
  21. 21.
    Yanev, V.: 3D virtuality sketching: a freehand sketch tool for conceptual urban design in architecture. Master’s Thesis, Technische Universität München (2012)Google Scholar
  22. 22.
    Goldschwendt, T.: The collaborative design platform protocol - design and implementation of a protocol for networked virtual environments and cave peer development. Bachelor’s Thesis, Ludwig-Maximilians-Universität München (2013)Google Scholar
  23. 23.
    Metaio GmbH: Metaio |SDK overview. (2015). Accessed 2 Feb 2015
  24. 24.
    OpenSG. (2015). Accessed 2 Feb 2015

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  • Gerhard Schubert
    • 1
    Email author
  • David Schattel
    • 1
  • Marcus Tönnis
    • 1
  • Gudrun Klinker
    • 1
  • Frank Petzold
    • 1
  1. 1.Technische Universität MünchenMunichGermany

Personalised recommendations