Handheld Augmented Reality Interaction Technique

  • Shahan Ahmad Chowdhury
  • Haslina Arshad
  • Behrang Parhizkar
  • Waqas Khalid Obeidy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8237)


Handheld devices are popular device for an Augmented Reality application. It has a basic hardware requirement for AR system. However it must be overcome some technical obstacle to realize its true power. One of the problems is interaction in handheld AR environment. Touch screen interaction is one of the common interaction methods in handheld AR but it is not easy to interact in touch screen with virtual object in handheld AR scene. Current research shows that Freeze Interaction technique shows its usefulness in handheld touch screen AR interaction. However it has a drawback such as, when users freeze their view it freezes the whole scene. When virtual object are updating continuously the real world-view is not being updated and remains as still picture. It can be a problem when users need to deal with current up-to date real world scene. To overcome current problem of Freeze Interaction technique we have implemented new freeze technique ‘Freeze-Object’ for more precise interaction. This paper presents a short review of handheld AR interaction technique and our proposed work.


handheld augmented reality interaction technique touch screen interface 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vallino, J.R.: Interactive Augmented Reality. Degree Doctor of Philosophy. University of Rochester, New York (1998)Google Scholar
  2. 2.
    Uematsu, Y., Saito, H.: Vision-Based Augmented Reality Applications. Computer Vision I-Tech, Vienna, Austria (2008)Google Scholar
  3. 3.
    Wagner, D., Schmalstieg, D.: Projects in VR Making Augmented Reality Practical on Mobile Phones, Part 1. IEEE Computer Graphics and Application 29(3), 12–15 (2009)CrossRefGoogle Scholar
  4. 4.
    Henrysson, A., Marshally, J., Billinghurst, M.: Experiments in 3D Interaction for Mobile Phone AR. In: Proceedings of the 5th International Conference on Computer Graphics and Interactive Techniques in Australia and Southeast Asia (GRAPHITE 2007), pp. 187–194 (2007)Google Scholar
  5. 5.
    Arth, C., Schmalstieg, D.: Challenges of Large-Scale Augmented Reality on Smartphones. In: ISMAR 2011 Workshop: Enabling Large-Scale Outdoor Mixed Reality and Augmented Reality, Basel, Switzerland (October 26, 2011)Google Scholar
  6. 6.
    Schmalstieg, D.: Trends in Mobile Augmented Reality. In: IEEE Virtual Reality 2012 Tutorial, pp. 1–3 (2012)Google Scholar
  7. 7.
    Koceski, S., Koceska, N.: Interaction Between Players of Mobile Phone Game with Augmented Reality (AR) Interface. In: International Conference on User Science and Engineering (I-User 2011), pp. 245–250 (2011)Google Scholar
  8. 8.
    Gervautz, M., Schmalstieg, D.: Anywhere Interfaces Using Handheld Augmented Reality. Computer 45(7), 26–31 (2012)CrossRefGoogle Scholar
  9. 9.
    Liu, T.-Y., Tan, T.-H., Chu, Y.-L.: QR Code and Augmented Reality-Supported Mobile English Learning System. In: Jiang, X., Ma, M.Y., Chen, C.W. (eds.) WMMP 2008. LNCS, vol. 5960, pp. 37–52. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  10. 10.
    de Sa, M., Churchill, E.F.: Mobile Augmented Reality: Exploring Design and Prototyping Techniques. In: MobileHCI 2012, pp. 221–230 (2012)Google Scholar
  11. 11.
    Lee, G.A., Yang, U., Dongsik, K.J., Kim, K.H., Kim, J.H., Choi, J.S.: Freeze-Set-Go Interaction Method for Handheld Mobile Augmented Reality Environments. In: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology (VRST 2009), pp. 143–146 (2009)Google Scholar
  12. 12.
    Lee, G.A., Billinghurst, M.: A User Study on the Snap-To-Feature Interaction Method. In: IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland (October 26, 2011)Google Scholar
  13. 13.
    Lee, G.A., Billinghurst, M.: Assistive Techniques for Precise Touch Interaction in Handheld Augmented Reality Environments. In: VRCAI 2012, Singapore, pp. 279–286 (2012)Google Scholar
  14. 14.
    Geiger, C., Kleinjohann, B., Reimann, C., Stichling, D.: Mobile AR4ALL. In: Proceedings of the Second IEEE and ACM International Symposium on Augmented Reality, ISAR 2001, New York (2001)Google Scholar
  15. 15.
    Ingram, D., Newman, J.: Augmented Reality in a Widearea Sentient Environment. In: Proceedings of the 2nd IEEE and ACM International Symposium on Augmented Reality (ISAR 2001), New York (2001)Google Scholar
  16. 16.
    Henrysson, A., Billinghurst, M., Ollila, M.: Face to Face Collaborative AR on Mobile Phones. In: Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR 2005), Vienna, Austria, October 5-8 (2005)Google Scholar
  17. 17.
    Wagner, D., Schmalstieg, D.: First Steps Towards Handheld Augmented Reality. In: Proceedings of the 7th IEEE International Symposium on Wearable Computers (ISWC 2003), p. 127 (2003)Google Scholar
  18. 18.
    Billinghurst, M., Kato, H., Myojin, S.: Advanced Interaction Techniques for Augmented Reality Applications. In: Shumaker, R. (ed.) VMR 2009. LNCS, vol. 5622, pp. 13–22. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  19. 19.
    Kurkovsky, S., Koshy, R., Novak, V., Szul, P.: Current Issues in Handheld Augmented Reality. In: Communications and Information Technology (ICCIT 2012), pp. 68–72 (2012)Google Scholar
  20. 20.
    Poupyrev, I., Tan, D., Billinghurst, M., Kato, H., Regenbrech, H., Tetsutani, N.: Tiles: A Mixed Reality Authoring Interface. In: Proc. 7th Conf. Human-Computer Interaction (INTERACT 2001), pp. 334–341 (2001)Google Scholar
  21. 21.
    Billinghurst, M., Henrysson, A.: Research Directions in Handheld AR. The International Journal of Virtual Reality 5(2), 51–58 (2006)Google Scholar
  22. 22.
    Van Olst, R.: 3D Manipulations in Handheld Augmented Reality Applications. Master Thesis. Graduate School of Natural Sciences Department of Information and Computing Sciences. Utrecht University (2012)Google Scholar
  23. 23.
    Choi, J., Park, H., Park, J., Park, J.I.: Bare-Hand-Based Augmented Reality Interface on Mobile Phone. In: IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings, Basel, Switzerland, October 26-29 (2011)Google Scholar
  24. 24.
    Hürst, W., van Wezel, C.: Multimodal Interaction Concepts for Mobile Augmented Reality Applications. In: Lee, K.-T., Tsai, W.-H., Liao, H.-Y.M., Chen, T., Hsieh, J.-W., Tseng, C.-C. (eds.) MMM 2011, Part II. LNCS, vol. 6524, pp. 157–167. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  25. 25.
    Mendenhall, S., Ha, V., Xu, Y., Tillery, P., Cohen, J., Sharp, J., Macintyre, B.: Nerdherder: Designing for Physical Actions in an Augmented Reality Puzzle Game. In: FDG 2012, Raleigh, NC, USA, May 29-June 1 (2012)Google Scholar
  26. 26.
    Yee, K.P.: Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2003, pp 1–8 (2003) Google Scholar
  27. 27.
    Dang, N.T., Tavanti, M., Rankin, I., Cooper, M.: A Comparison of Different Input Devices for a 3d Environment. In: Proceedings of the 14th European Conference on Cognitive Ergonomics, ECCE 2007, pp. 153–160 (2007)Google Scholar
  28. 28.
    Bai, H., Lee, G.: Interaction Methods for Mobile Augmented Reality. In: Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction (CHINZ 2012), p. 101 (2012)Google Scholar
  29. 29.
    Abawi, D.F., Dörner, R., Haller, M., Zauner, J.: Efficient Mixed Reality Application Development. In: Proc. CVMP 2004 (European Conf. on Visual Media Production), London, UK, March 15-16, pp. 289–294 (2004)Google Scholar
  30. 30.
    Güven, S., Feiner, S., Oda, O.: Mobile Augmented Reality Interaction Techniques for Authoring Situated Media on-Site. In: Proceedings of Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 235–236. IEEE (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Shahan Ahmad Chowdhury
    • 1
  • Haslina Arshad
    • 1
  • Behrang Parhizkar
    • 2
  • Waqas Khalid Obeidy
    • 1
  1. 1.Faculty of Information Science and TechnologyUniversity Kebangsaan MalaysiaBangiMalaysia
  2. 2.School of Computer ScienceThe University of NottinghamMalaysia

Personalised recommendations