Skip to main content
SpringerLink
Log in

Mobile Augmented Reality: A Design Perspective

  • Chapter
  • First Online:
Human Factors in Augmented Reality Environments

Abstract

As mobile devices are enhanced with more sensors, powerful embedded cameras, and increased processing power and features, new user experiences become possible. A good example is the recent emergence of mobile augmented reality (MAR) applications that are designed for personal use while people are on-the-go. However, the majority of the existing literature and research on MAR focuses on technical considerations and on the development of new services and features. Only recently, since the advent of augmented reality services and applications for mainstream mobile users, have researchers and practitioners become more fully engaged with how to design and evaluate the effectiveness, usefulness and usability of AR experiences for mobile devices. In this chapter we offer a review of relevant research papers, and tease out challenges for existing formative and summative design methods in the development of MAR services and applications. We describe our own design approach which focuses on the creation of low-, medium- and high-fidelity prototypes for end-user evaluation and for the design of MAR. We offer a cost–benefit analysis of the various levels of prototype fidelity and offer readers insights into when to use which kind of prototype.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.layar.com/.

  2. 2.

    http://www.yelp.com.

  3. 3.

    http://www.yelp.com.

  4. 4.

    http://www.layar.com/.

  5. 5.

    http://www.google.com/mobile/navigation/.

  6. 6.

    http://www.xbox.com/en-US/kinect.

References

  1. Marco de Sá, Judd Antin, David Shamma, and Elizabeth F. Churchill. 2011. Mobile augmented reality: video prototyping. In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems (CHI EA ‘11). ACM, New York, NY, USA, 1897–1902.

    Google Scholar 

  2. Matt Jones and Gary Marsden. 2006. Mobile Interaction Design. John Wiley & Sons.

    Google Scholar 

  3. Scott Weiss. 2002. Handheld Usability. John Wiley & Sons, Inc., New York, NY, USA.

    Google Scholar 

  4. Stephen Brewster. 2002. Overcoming the Lack of Screen Space on Mobile Computers. Personal Ubiquitous Computing . 6, 3, pp. 188–205.

    Article  Google Scholar 

  5. Johannes Karlsson, Shafiq ur Rehman, and Haibo Li. 2010. Augmented reality to enhance visitors experience in a digital zoo. In Proceedings of MUM ‘10. ACM, 4 pages.

    Google Scholar 

  6. Peter Barrie, Andreas Komninos, and Oleksii Mandrychenko. 2009. A pervasive gesture-driven augmented reality prototype using wireless sensor body area networks. In Proceedings of the 6th International Conference on Mobile Technology, Application \&\#38; Systems (Mobility ‘09). ACM, New York, NY, USA, Article 61, 4 pages.

    Google Scholar 

  7. Susanna Nilsson and Bjorn Johansson. 2007. Fun and usable: augmented reality instructions in a hospital setting. In Proceedings OZCHI’07, ACM, pp. 123–30.

    Google Scholar 

  8. Wayne Piekarski, et al. 2004. Designing Backpacks for High Fidelity Mobile Outdoor Augmented Reality. In Proceedings of ISMAR ‘04. IEEE, Washington, USA, pp. 280–281.

    Google Scholar 

  9. Andreas Dunser, Mark Billinghurst, James Wen, Ville Lehtinen, Antti Nurminen (2011) Handheld AR for Outdoor Navigation, Proceedings of 1st Workshop on Mobile AR, MobileHCI’11, Stockholm, Sweden, 2011.

    Google Scholar 

  10. Torben Schinke, Niels Henze, and Susanne Boll. 2010. Visualization of off-screen objects in mobile augmented reality. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI ‘10). ACM, New York, NY, USA, pp. 313–316.

    Google Scholar 

  11. Holden, W. Augmented Reality on the Mobile to Generate $732 million by 2014(2009) Juniper Research, http://juniperresearch.com/viewpressrelease.php?pr=166

  12. Patricia P. Wang, Tao Wang, Dayong Ding, Yimin Zhang, Wenyuan Bi, and Yingze Bao. 2009. Mirror world navigation for mobile users based on augmented reality. In Proceedings of the 17th ACM international conference on Multimedia (MM ‘09). ACM, New York, NY, USA, pp. 1025–1026.

    Google Scholar 

  13. Yan Xu, Mirjana Spasojevic, Jiang Gao, and Matthias Jacob. 2008. Designing a vision-based mobile interface for in-store shopping. In Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges (NordiCHI ‘08). ACM, New York, NY, USA, pp. 393–402.

    Google Scholar 

  14. Gun A. Lee, Ungyeon Yang, Yongwan Kim, Dongsik Jo, Ki-Hong Kim, Jae Ha Kim, and Jin Sung Choi. 2009. Freeze-Set-Go interaction method for handheld mobile augmented reality environments. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology (VRST ‘09), Steven N. Spencer (Ed.). ACM, New York, NY, USA, pp. 143–146.

    Google Scholar 

  15. Yoshio Ishiguro and Jun Rekimoto. 2011. Peripheral vision annotation: noninterference information presentation method for mobile augmented reality. In Proceedings of the 2nd Augmented Human International Conference (AH ‘11). ACM, New York, NY, USA, Article 8, 5 pages.

    Google Scholar 

  16. Ann Morrison, Alessandro Mulloni, Saija Lemmelä, Antti Oulasvirta, Giulio Jacucci, Peter Peltonen, Dieter Schmalstieg, and Holger Regenbrecht. 2011. Mobile Augmented Reality: Collaborative use of mobile augmented reality with paper maps. Comput. Graph. 35, 4 (August 2011), pp. 789–799.

    Google Scholar 

  17. Reitmayr, G., Schmalstieg, D., (2003), Location based Applications for Mobile Augmented Reality, In Proceedings. of the Fourth Australasian User Interface Conference (AUIC2003), Adelaide, Australia. Conferences in Research and Practice in Information Technology, Vol. 18, 2003.

    Google Scholar 

  18. Marco de Sá and Luís Carriço. 2008. Lessons from early stages design of mobile applications. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services (MobileHCI ‘08). ACM, New York, NY, USA, pp. 127–136.

    Google Scholar 

  19. Selim Balcisoy et al. 2000. A framework for rapid evaluation of prototypes with augmented reality. In Proceedings. of VRST ‘00. ACM, pp. 61–66.

    Google Scholar 

  20. Areti Damala, Pierre Cubaud, Anne Bationo, Pascal Houlier, and Isabelle Marchal. 2008. Bridging the gap between the digital and the physical: design and evaluation of a mobile augmented reality guide for the museum visit. In Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts (DIMEA ‘08). ACM, New York, NY, USA, pp. 120–127.

    Google Scholar 

  21. Benjamin Avery, Bruce H. Thomas, Wayne Piekarski (2008) User Evaluation of See-Through Vision for Mobile Outdoor Augmented Reality. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality 2008 15–18 September, Cambridge, UK, pp. 69–72.

    Google Scholar 

  22. Yilun You, Tat Jun Chin, Joo Hwee Lim, Jean-Pierre Chevallet, Céline Coutrix, and Laurence Nigay. 2008. Deploying and evaluating a mixed reality mobile treasure hunt: Snap2Play. In Proceedings of the 10th international conference on Human computer interaction with mobile devices and services (MobileHCI ‘08). ACM, New York, NY, USA, pp. 335–338.

    Google Scholar 

  23. Tim Gleue and Patrick D\&\#228;hne. 2001. Design and implementation of a mobile device for outdoor augmented reality in the archeoguide project. In Proceedings of the 2001 conference on Virtual reality, archeology, and cultural heritage (VAST ‘01). ACM, New York, NY, USA, 161–168.

    Google Scholar 

  24. Eduardo E. Veas and Ernst Kruijff. 2010. Handheld devices for mobile augmented reality. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia (MUM ‘10). ACM, New York, NY, USA, Article 3, 10 pages.

    Google Scholar 

  25. Olsson T., Ihamaki, P., Lagerstam, E., Venta-Olkkonen, L., Vaananen-Vainio-Mattila, K. (2009) n: Norros, L. et al. (eds.). ECCE 2009 - European Conference on Cognitive Ergonomics. Designing beyond the Product - Understanding Activity and User Experience in Ubiquitous Environments, 30.9.-2.10.2009, Helsinki, Finland. VTT Symposium 258 pp. 177–184.

    Google Scholar 

  26. Morrison, A., Oulasvirta, A., Peltonen, P., Lemmela, S., Jacucci, G., Reitmayr, G., Näsänen, J., and Juustila, A. (2009). Like bees around the hive: a comparative study of a mobile augmented reality map. In Proceedings of the 27th international conference on Human factors in computing systems (CHI ‘09). ACM, New York, NY, USA, pp. 1889–1898.

    Google Scholar 

  27. Florian Heller, Jan Borchers. (2011) Corona: Audio Augmented Reality in Historic Sites, Proceedings of 1st Workshop on Mobile AR, MobileHCI’11, Stockholm, Sweden, 2011.

    Google Scholar 

  28. Yan Xu and Blair MacIntyre, (2011) Theory-driven Design for Social Play with Mobile AR Games, Proceedings of 1st Workshop on Mobile AR, MobileHCI’11, 2011.

    Google Scholar 

  29. Laurence Nigay, P. Salembier, T. Marchand, Philippe Renevier, and Laurence Pasqualetti. 2002. Mobile and Collaborative Augmented Reality: A Scenario Based Design Approach. In Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction (Mobile HCI ‘02), Fabio Paterno; (Ed.). Springer-Verlag, London, UK, pp. 241–255.

    Google Scholar 

  30. Jaewon Ha, Kyusung Cho, and H. S. Yang. 2010. Scalable recognition and tracking for mobile augmented reality. In Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry (VRCAI ‘10). ACM, New York, NY, USA, pp. 155–160.

    Google Scholar 

  31. Selim Balcisoy, Marcelo Kallmann, Pascal Fua, and Daniel Thalmann. 2000. A framework for rapid evaluation of prototypes with augmented reality. In Proceedings of the ACM symposium on Virtual reality software and technology (VRST ‘00). ACM, New York, NY, USA, pp. 61–66.

    Google Scholar 

  32. Joe L. Gabbard and J. E. Swan II. 2008. Usability Engineering for Augmented Reality: Employing User-Based Studies to Inform Design. IEEE Transactions on Visualization and Computer Graphics 14, 3 (May 2008), pp. 513–525.

    Google Scholar 

  33. Christian Jacquemin, Wai Kit Chan, and Mathieu Courgeon. Bateau ivre: an artistic markerless outdoor mobile augmented reality installation on a riverboat. In Proceedings of the international conference on Multimedia (MM ‘10). ACM, New York, NY, USA, pp. 1353–1362.

    Google Scholar 

  34. Hugh Beyer and Karen Holtzblatt. 1999. Contextual design. interactions 6, 1 (January 1999), pp. 32–42.

    Google Scholar 

  35. Mary Beth Rosson and John M. Carroll. 2001. Usability Engineering: Scenario-Based Development of Human-Computer Interaction. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.

    Google Scholar 

  36. Anders Henrysson and Mark Ollila. 2004. UMAR: Ubiquitous Mobile Augmented Reality. In Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia (MUM ‘04). ACM, New York, NY, USA, pp. 41–45.

    Google Scholar 

  37. Robert Albrecht, Tapio Lokki, and Lauri Savioja. 2011. A mobile augmented reality audio system with binaural microphones. In Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications (IwS ‘11). ACM, New York, NY, USA, pp. 7–11.

    Google Scholar 

  38. Humphreys, L. (2007). Mobile social networks and social practice: A case study of Dodgeball. Journal of Computer-Mediated Communication, 13(1), article 17.

    Google Scholar 

  39. Johannes Karlsson, Shafiq ur Réhman, and Haibo Li. 2010. Augmented reality to enhance visitors experience in a digital zoo. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia (MUM ‘10). ACM, New York, NY, USA, Article 7, 4 pages.

    Google Scholar 

  40. Johannes Schöning, Michael Rohs, Sven Kratz, Markus Löchtefeld, and Antonio Krüger. 2009. Map torchlight: a mobile augmented reality camera projector unit. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI EA ‘09). ACM, New York, NY, USA, pp. 3841–3846.

    Google Scholar 

  41. Barrie, P., Komninos, A., Mandrychenko, O., (2009) A Pervasive Gesture-Driven Augmented Reality Prototype using Wireless Sensor Body Area Networks, In Proceedings of Mobility 2009, September 2–4, Nice, France, ACM Press.

    Google Scholar 

  42. Christian Monrad Nielsen, Michael Overgaard, Michael Bach Pedersen, Jan Stage, and Sigge Stenild. 2006. It’s worth the hassle!: the added value of evaluating the usability of mobile systems in the field. In Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles (NordiCHI ‘06), Anders M\&\#248;rch, Konrad Morgan, Tone Bratteteig, Gautam Ghosh, and Dag Svanaes (Eds.). ACM, New York, NY, USA, pp. 272–280.

    Google Scholar 

  43. Y. Rogers et al., “Why it’s worth the hassle: The value of in-situ studies when designing ­ubicomp,” in Ubicomp 2007, Innsbruck, Austria: ACM, September 2007.

    Google Scholar 

  44. Michael McCurdy et al. 2006. Breaking the fidelity barrier. In Proceedings CHI ‘06,ACM, pp. 1233–1242.

    Google Scholar 

  45. Sami Hulkko, et al. 2004. Mobile probes. In Proceedings of NordiCHI ‘04. ACM, NY, USA, pp. 43–51.

    Google Scholar 

  46. S. O’Brien and F. Mueller. 2006. Holding hands over a distance: technology probes in an ­intimate, mobile context. In Proceedings. OZCHI ‘06. ACM, USA, pp. 293–296.

    Google Scholar 

  47. Nielsen, J. Guerrilla HCI: Using Discount Usability Engineering to Penetrate the Intimidation Barrier. Cost-Justify in Usability. Academic Press Professional, 1994.

    Google Scholar 

  48. Lars Erik Holmquist. 2005. Prototyping: generating ideas or cargo cult designs?. interactions 12, 2 (March 2005), pp. 48–54.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Yahoo! Research, Santa Clara, CA, USA

    Marco de Sá & Elizabeth F. Churchill

Authors
  1. Marco de Sá
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Elizabeth F. Churchill
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marco de Sá .

Editor information

Editors and Affiliations

  1. CSIRO ICT Centre, Pembroke Road, Marsfield, 1710, New South Wales, Australia

    Weidong Huang

  2. CSIRO ICT Centre, Pembroke Road, Marsfield, 1710, New South Wales, Australia

    Leila Alem

  3. Mail Code 5580, Washington, 20375, District of Columbia, USA

    Mark A. Livingston

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

de Sá, M., Churchill, E.F. (2013). Mobile Augmented Reality: A Design Perspective. In: Huang, W., Alem, L., Livingston, M. (eds) Human Factors in Augmented Reality Environments. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-4205-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-4205-9_6

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-4204-2

  • Online ISBN: 978-1-4614-4205-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation