Towards Ambient Augmented Reality with Tangible Interfaces

  • Mark Billinghurst
  • Raphaël Grasset
  • Hartmut Seichter
  • Andreas Dünser
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5612)


Ambient Interface research has the goal of embedding technology that disappears into the user’s surroundings. In many ways Augmented Reality (AR) technology is complimentary to this in that AR interfaces seamlessly enhances the real environment with virtual information overlay. The two merge together in context aware Ambient AR applications, which allow users to easily perceive and interact with Ambient Interfaces by using AR overlay of the real world. In this paper we describe how Tangible Interaction techniques can be used for Ambient AR applications. We will present a conceptual framework for Ambient Tangible AR Interface, a new generation of software and hardware tools for development and methods for evaluating Ambient Tangible AR Interfaces.


Augmented Reality Ambient Interfaces Tangible Interfaces 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Weiser, M.: The computer for the 21st century. Scientific American 265, 94–104 (1999)CrossRefGoogle Scholar
  2. 2.
    Norman, D.A.: The invisible computer. MIT Press, Cambridge (1998)Google Scholar
  3. 3.
    Dourish, P.: Embodied Interaction: Exploring the Foundations of a New Approach (1999)Google Scholar
  4. 4.
    Aarts, E., Harwig, R., Schuurmans, M.: Ambient intelligence, The invisible future: the seamless integration of technology into everyday life. McGraw-Hill, Inc., New York (2001)Google Scholar
  5. 5.
    Azuma, R.T.: A Survey of Augmented Reality. Presence - Teleoperators and Virtual Environments 6, 355–385 (1997)CrossRefGoogle Scholar
  6. 6.
    Rauhala, M., Gunnarsson, A.-S., Henrysson, A.: A Novel Interface to Sensor Networks using Handheld Augmented Reality. In: MobileHCI 2006, pp. 145–148. ACM, Helsinki (2006)Google Scholar
  7. 7.
    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: CHI 1997, pp. 234–241. ACM, New York (1997)Google Scholar
  8. 8.
    Shneiderman, B.: The future of interactive systems and the emergence of direct manipulation. Behaviour and Information Technology 1, 237–256 (1982)CrossRefGoogle Scholar
  9. 9.
    Hutchins, E.L., Hollan, J.D., Norman, D.A.: Direct manipulation interfaces. Hum.-Comput. Interact. 1, 311–338 (1985)CrossRefGoogle Scholar
  10. 10.
    Frazer, J.H., Frazer, J.M., Frazer, P.A.: Intelligent physical three-dimensional modeling systems. In: Computer Graphics Conference, vol. 80, pp. 359–370 (1980)Google Scholar
  11. 11.
    Gorbet, M.G., Orth, M., Ishii, H.: Triangles: tangible interface for manipulation and exploration of digital information topography. In: CHI 1998, pp. 49–56. ACM, New York (1998)Google Scholar
  12. 12.
    Kato, H., Billinghurst, M., Poupyrev, I., Tetsutani, N., Tachibana, K.: Tangible Augmented Reality for Human Computer Interaction. Nicograph, Nagoya, Japan (2001)Google Scholar
  13. 13.
    MacIntyre, B., Gandy, M., Dow, S., Bolter, J.D.: DART: a toolkit for rapid design exploration of augmented reality experiences. In: Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, Santa Fe (2004)Google Scholar
  14. 14.
    Owen, C., Tang, A., Xiao, F.: ImageTclAR: A Blended Script and Compiled Code Development Systems for Augmented Reality (2003)Google Scholar
  15. 15.
    Ledermann, F., Schmalstieg, D.: APRIL: A High-level Framework for Creating Augmented Reality Presentations. In: Proceedings of the IEEE Virtual Reality 2005 (VR 2005), pp. 187–194 (2005)Google Scholar
  16. 16.
    Seichter, H., Looser, J., Billinghurst, M.: ComposAR: An Intuitive Tool for Authoring AR Applications. In: Saito, M.A.L., Oliver, B. (eds.) International Symposium of Mixed and Augmented Reality (ISMAR 2008), pp. 177–178. IEEE, Cambridge (2008)Google Scholar
  17. 17.
    Hampshire, A., Seichter, H., Grasset, R., Billinghurst, M.: Augmented Reality Authoring: Generic Context from Programmer to Designer. In: Australasian Computer-Human Interaction Conference, OZCHI 2006 (2006)Google Scholar
  18. 18.
  19. 19.
    Greenberg, S., Fitchett, C.: Phidgets: easy development of physical interfaces through physical widgets. In: UIST 2001: Proceedings of the 14th annual ACM symposium on User interface software and technology, pp. 209–218. ACM, New York (2001)Google Scholar
  20. 20.
    Lee, J.C., Avrahami, D., Hudson, S.E., Forlizzi, J., Dietz, P.H., Leigh, D.: The calder toolkit: wired and wireless components for rapidly prototyping interactive devices. In: DIS 2004: Proceedings of the 5th conference on Designing interactive systems, pp. 167–175. ACM, New York (2004)CrossRefGoogle Scholar
  21. 21.
    Ballagas, R., Ringel, M., Stone, M., Borchers, J.: iStuff: a physical user interface toolkit for ubiquitous computing environments. In: CHI 2003: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 537–544. ACM, New York (2003)Google Scholar
  22. 22.
    Klemmer, S.R., Li, J., Lin, J., Landay, J.A.: Papier-Mache: toolkit support for tangible input. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 399–406. ACM, New York (2004)CrossRefGoogle Scholar
  23. 23.
    Greenhalgh, C.I.S., Taylor, I.: ECT: A Toolkit to Support Rapid Construction of Ubicomp Environments. In: Ubicomp 2004 (2004) Google Scholar
  24. 24.
    Hong, D., Looser, J., Seichter, H., Billinghurst, M., Woo, W.: A Sensor-based Interaction for Ubiquitous Virtual Reality Systems. In: ISUVR 2008, Korea, pp. 75–78 (2008)Google Scholar
  25. 25.
    Dünser, A., Grasset, R., Billinghurst, M.: A Survey of Evaluation Techniques Used in Augmented Reality Studies. Technical Report TR-2008-02. HIT Lab NZ (2008)Google Scholar
  26. 26.
    Dünser, A., Grasset, R., Seichter, H., Billinghurst, M.: Applying HCI principles to AR systems design. In: MRUI 2007: 2nd International Workshop at the IEEE Virtual Reality 2007 Conference, Charlotte, North Carolina, USA (2007)Google Scholar
  27. 27.
    Swan, J.E., Gabbard, J.L.: Survey of User-Based Experimentation in Augmented Reality. In: 1st International Conference on Virtual Reality, Las Vegas, Nevada (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mark Billinghurst
    • 1
  • Raphaël Grasset
    • 1
  • Hartmut Seichter
    • 1
  • Andreas Dünser
    • 1
  1. 1.The Human Interface Technology New Zealand (HIT Lab NZ)University of CanterburyChristchurchNew Zealand

Personalised recommendations