Advances in Mobile Augmented Reality from User Experience Perspective: A Review of Studies

  • Shafaq IrshadEmail author
  • Dayang Rohaya Awang Rambli
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10645)


Augmented Reality (AR) is maturing with the evolution in fields of computer and interactive graphics. Rapid advancements and growth of the mobile industry have allowed AR experiences to be delivered on mobile devices as well. When camera fitted mobile devices point towards a digital object to deliver AR experiences it creates design challenges due to Unique interaction style and Information presentation on Mobile Augmented Reality (MAR) applications. In order to overcome these design challenges, one needs to understand the User Experience (UX) of MAR. This paper reviews the advances in mobile augmented reality from UX perspective. This study aims to present a comprehensive and detailed review and will help in guiding the developers of MAR to focus on areas that need improvement.


Augmented reality Mobile augmented reality User studies User experience Interaction Human computer interaction 


  1. 1.
    Alben, L.: Defining the criteria for effective interaction design. Interactions 3(3), 11–15 (1996)CrossRefGoogle Scholar
  2. 2.
    Arol, K.P.: Mobile augmented reality supporting marketing, using mobile augmented reality based marketing applications to promote products or services to end customers. Ph.D. thesis, Lahti University of Applied Sciences (2014)Google Scholar
  3. 3.
    Azuma, R.T., et al.: A survey of augmented reality. Presence 6(4), 355–385 (1997)CrossRefGoogle Scholar
  4. 4.
    Barfield, W.: Fundamentals of Wearable Computers and Augmented Reality. CRC Press, Boca Raton (2015)CrossRefGoogle Scholar
  5. 5.
    Buccini, M., Padovani, S.: Typology of the experiences. In: Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces, DPPI 2007, pp. 495–504. ACM, New York (2007)Google Scholar
  6. 6.
    Carmigniani, J., Furht, B.: Augmented reality: an overview. In: Furht, B. (ed.) Handbook of Augmented Reality, pp. 3–46. Springer, New York (2011). doi: 10.1007/978-1-4614-0064-6_1 CrossRefGoogle Scholar
  7. 7.
    Craig Foster, C.W.: Augmented Reality for Mobile Devices. Technical report, August 2015Google Scholar
  8. 8.
    Dempski, K.L.: Arbitrary object tracking augmented reality applications, 23 May 2006. US Patent 7,050,078Google Scholar
  9. 9.
    De Sá, M., Churchill, E.: Mobile augmented reality: exploring design and prototyping techniques. In: Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2012, pp. 221–230. ACM, New York (2012)Google Scholar
  10. 10.
    Desmet, P.M.A., Hekkert, P.: Framework of product experience. Int. J. Des. 1(1), 57–66 (2007)Google Scholar
  11. 11.
    Dhir, A., Al-kahtani, M.: A case study on user experience (UX) evaluation of mobile augmented reality prototypes. J. UCS 19(8), 1175–1196 (2013)Google Scholar
  12. 12.
    Dunser, A., Grasset, R., Seichter, H., Billinghurst, M.: Applying HCI principles to AR systems design (2007)Google Scholar
  13. 13.
    Gabbard, J., Hix, D.: Researching usability design and evaluation guidelines for augmented reality (AR) systems. Laboratory for Scientific Visual Analysis, Virginia Tech, USA (2001)Google Scholar
  14. 14.
    Hassenzahl, M.: The thing and I: understanding the relationship between user and product. In: Blythe, M., Overbeeke, K., Monk, A., Wright, P. (eds.) Funology, Human-Computer Interaction Series, vol. 3, pp. 31–42. Springer, Dordrecht (2005). doi: 10.1007/1-4020-2967-5_4 Google Scholar
  15. 15.
    Henrysson, A.: Bringing augmented reality to mobile phones (2007)Google Scholar
  16. 16.
    Hollerer, T., Feiner, S.: Mobile augmented reality. In: Telegeoinformatics: Location-Based Computing and Services. Taylor and Francis Books Ltd., London, UK 21 (2004)Google Scholar
  17. 17.
    Hollerer, T., Feiner, S., Hallaway, D., Bell, B., Lanzagorta, M., Brown, D., Julier, S., Baillot, Y., Rosenblum, L.: User interface management techniques for collaborative mobile augmented reality. Comput. Graph. 25(5), 799–810 (2001)CrossRefGoogle Scholar
  18. 18.
    Hollerer, T., Feiner, S., Terauchi, T., Rashid, G., Hallaway, D.: Exploring mars: developing indoor and outdoor user interfaces to a mobile augmented reality system. Comput. Graph. 23(6), 779–785 (1999)CrossRefGoogle Scholar
  19. 19.
    Irshad, S., Awang, D.R.B.: User perception on mobile augmented reality as a marketing tool. In: 2016 3rd International Conference on Computer and Information Sciences (ICCOINS), pp. 109–113, August 2016Google Scholar
  20. 20.
    Irshad, S., Rambli, D.R.A.: Preliminary user experience framework for designing mobile augmented reality technologies. In: 2015 4th International Conference on Interactive Digital Media (ICIDM), pp. 1–4, December 2015Google Scholar
  21. 21.
    Irshad, S., Rambli, D.R.B.A.: User experience of mobile augmented reality: a review of studies. In: 2014 3rd International Conference on User Science and Engineering (i-USEr), pp. 125–130, September 2014Google Scholar
  22. 22.
    Irshad, S., Awang Rambli, D.R.: Multi-layered mobile augmented reality framework for positive user experience. In: Proceedings of the 2nd International Conference in HCI and UX Indonesia 2016, CHIuXiD 2016, pp. 21–26. ACM, New York (2016).
  23. 23.
    Irshad, S., Rambli, D.R.A.: User experience evaluation of mobile AR services. In: Proceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia, MoMM 2014, pp. 119–126. ACM, New York (2014).
  24. 24.
    Irshad, S., Rambli, D.R.A.: User experience satisfaction of mobile-based AR advertising applications. In: Badioze Zaman, H., Robinson, P., Smeaton, A.F., Shih, T.K., Velastin, S., Jaafar, A., Mohamad Ali, N. (eds.) IVIC 2015. LNCS, vol. 9429, pp. 432–442. Springer, Cham (2015). doi: 10.1007/978-3-319-25939-0_38 CrossRefGoogle Scholar
  25. 25.
    Irshad, S., Rambli, D.R.A.: Design implications for quality user eXperience in mobile augmented reality applications. In: Sulaiman, H.A., Othman, M.A., Othman, M.F.I., Rahim, Y.A., Pee, N.C. (eds.) Advanced Computer and Communication Engineering Technology. LNEE, vol. 362, pp. 1283–1294. Springer, Cham (2016). doi: 10.1007/978-3-319-24584-3_110 CrossRefGoogle Scholar
  26. 26.
    Ergonomics of human system interaction - part 210: Human-centered design for interactive systems. Standard, International Organization for Standardization, Technical report International (2010)Google Scholar
  27. 27.
    Jaasko, V., Mattelmaki, T.: Observing and probing. In: Proceedings of the 2003 International Conference on Designing Pleasurable Products and Interfaces, pp. 126–131. ACM (2003)Google Scholar
  28. 28.
    Joslin, P.: Augmented reality based user interface for mobile applications and services. Ph.D. thesis, P.O. Box 3000, FIN-90014 University of Oulu, Finland (2005)Google Scholar
  29. 29.
    Kamilakis, M., Gavalas, D., Zaroliagis, C.: Mobile user experience in augmented reality vs. maps interfaces: a case study in public transportation. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9768, pp. 388–396. Springer, Cham (2016). doi: 10.1007/978-3-319-40621-3_27 Google Scholar
  30. 30.
    Karapanos, E.: User experience over time. In: Karapanos, E. (ed.) Modeling Users’ Experiences with Interactive Systems, pp. 57–83. Springer, Heidelberg (2013). doi: 10.1007/978-3-642-31000-3_4 CrossRefGoogle Scholar
  31. 31.
    Kaye, J.J., Buie, E., Hoonhout, J., Höök, K., Roto, V., Jenson, S., Wright, P.: Designing for user experience: academia & industry. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2011, pp. 219–222. ACM, New York (2011).
  32. 32.
    Keating, G., Guest, D., Konertz, A., Padovani, N., Villa, A.: Designing the AR experience: tools and tips for mobile augmented reality UX design. In: Marcus, A. (ed.) DUXU 2011. LNCS, vol. 6770, pp. 135–141. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-21708-1_16 CrossRefGoogle Scholar
  33. 33.
    Kilby, J., Gray, K., Elliott, K., Waycott, J., Sanchez, F.M., Dave, B.: Designing a mobile augmented reality tool for the locative visualization of biomedical knowledge. Stud. Health Technol. Inf. 192, 652–656 (2012)Google Scholar
  34. 34.
    Kim, M.J.: A framework for context immersion in mobile augmented reality. Autom. Constr. 33, 79–85 (2013)CrossRefGoogle Scholar
  35. 35.
    Kourouthanassis, P.E., Boletsis, C., Lekakos, G.: Demystifying the design of mobile augmented reality applications. Multimedia Tools Appl. 74(3), 1045–1066 (2015)CrossRefGoogle Scholar
  36. 36.
    Kuniavsky, M.: Observing the User Experience: A Practitioner’s Guide to user Research. Morgan Kaufmann, Burlington (2003)Google Scholar
  37. 37.
    Kuutti, K.: Where are the Ionians of user experience research? In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, NordiCHI 2010, pp. 715–718. ACM, New York (2010).
  38. 38.
    Lee, J.Y., Seo, D.W., Rhee, G.: Visualization and interaction of pervasive services using context-aware augmented reality. Expert Syst. Appl. 35(4), 1873–1882 (2008)CrossRefGoogle Scholar
  39. 39.
    Li, H., Zhu, W.: mPano: cloud-based mobile panorama view from single picture. In: SPIE Optical Engineering + Applications, p. 88560D. International Society for Optics and Photonics (2013)Google Scholar
  40. 40.
    Liu, C., Huot, S., Diehl, J., Mackay, W., Beaudouin-Lafon, M.: Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2973–2976. ACM (2012)Google Scholar
  41. 41.
    Mirnig, A.G., Meschtscherjakov, A., Wurhofer, D., Meneweger, T., Tscheligi, M.: A formal analysis of the ISO 9241–210 definition of user experience. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA 2015, pp. 437–450. ACM, New York (2015).
  42. 42.
    Müller, L., Aslan, I., Krüßen, L.: GuideMe: a mobile augmented reality system to display user manuals for home appliances. In: Reidsma, D., Katayose, H., Nijholt, A. (eds.) ACE 2013. LNCS, vol. 8253, pp. 152–167. Springer, Cham (2013). doi: 10.1007/978-3-319-03161-3_11 CrossRefGoogle Scholar
  43. 43.
    Olsson, T.: Layers of user expectations of future technologies: an early framework. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 1957–1962. ACM (2014)Google Scholar
  44. 44.
    Olsson, T., Ihamäki, P., Lagerstam, E., Ventä-Olkkonen, L., Väänänen-Vainio-Mattila, K.: User expectations for mobile mixed reality services: an initial user study. In: European Conference on Cognitive Ergonomics: Designing Beyond the Product Understanding Activity and User Experience in Ubiquitous Environments, p. 19. VTT Technical Research Centre of Finland (2009)Google Scholar
  45. 45.
    Olsson, T., Karkkainen, T., Lagerstam, E., Venta-Olkkonen, L.: User evaluation of mobile augmented reality scenarios. J. Ambient Intell. Smart Environ. 4(1), 29–47 (2012)Google Scholar
  46. 46.
    Olsson, T., Lagerstam, E., Karkkainen, T., Vaananen-Vainio-Mattila, K.: Expected user experience of mobile augmented reality services: a user study in the context of shopping centers. Pers. Ubiquit. Comput. 17(2), 287–304 (2013)CrossRefGoogle Scholar
  47. 47.
    Olsson, T., Salo, M.: Online user survey on current mobile augmented reality applications. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 75–84. IEEE (2011)Google Scholar
  48. 48.
    Olsson, T., Salo, M.: Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2779–2788. ACM (2012)Google Scholar
  49. 49.
    Perritaz, D., Salzmann, C., Gillet, D.: Quality of experience for adaptation in augmented reality. In: IEEE International Conference on Systems, Man and Cybernetics, SMC 2009, pp. 888–893. IEEE (2009)Google Scholar
  50. 50.
    Rambli, D.R.A., Irshad, S.: UX design evaluation of mobile augmented reality marketing products and services for Asia pacific region. In: Proceedings of the Asia Pacific HCI and UX Design Symposium, APCHIUX 2015, pp. 42–45. ACM, New York (2015).
  51. 51.
    Reitmayr, G., Drummond, T.W.: Going out: robust model-based tracking for outdoor augmented reality. In: IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 109–118. IEEE (2006)Google Scholar
  52. 52.
    Roto, V., Law, E., Vermeeren, A., Hoonhout, J.: User experience white paper. Bringing clarity to the concept of user experience (2011)Google Scholar
  53. 53.
    de Sa, M., Churchill, E.F., Isbister, K.: Mobile augmented reality: design issues and opportunities. In: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI 2011, pp. 749–752. ACM, New York (2011)Google Scholar
  54. 54.
    Schmalstieg, D., Langlotz, T., Billinghurst, M.: Augmented reality 2.0. In: Brunnett, G., Coquillart, S., Welch, G. (eds.) Virtual Realities. Springer, Vienna (2011). doi: 10.1007/978-3-211-99178-7_2 Google Scholar
  55. 55.
    Siltanen, S., Oksman, V., Ainasoja, M.: User-centered design of augmented reality interior design service. Int. J. Arts Sci. 6(1), 547 (2013)Google Scholar
  56. 56.
    Squire, K.D., Jan, M.: Mad city mystery: developing scientific argumentation skills with a place-based augmented reality game on handheld computers. J. Sci. Educ. Technol. 16(1), 5–29 (2007)CrossRefGoogle Scholar
  57. 57.
    TechNavio: Mobile augmented reality market for marketing and advertising in APAC 2015–2019.
  58. 58.
    Verbelen, T., Simoens, P., De Turck, F., Dhoedt, B.: Adaptive deployment and configuration for mobile augmented reality in the cloudlet. J. Netw. Comput. Appl. 41, 206–216 (2014)CrossRefGoogle Scholar
  59. 59.
    Yang, X., Cheng, K.T.: LDB: an ultra-fast feature for scalable augmented reality on mobile devices. In: 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 49–57. IEEE (2012)Google Scholar
  60. 60.
    Zhou, F., Duh, H.B.L., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 193–202. IEEE Computer Society (2008)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Computer and Information SciencesUniversiti Teknologi PETRONASBandar Seri IskandarMalaysia

Personalised recommendations