Skip to main content

The Development of Mobile Augmented Reality

  • Chapter

Abstract

The goal of this chapter is to provide a high-level overview of fifteen years of augmented reality research that was sponsored by the U.S. Office of Naval Research (ONR). The research was conducted at Columbia University and the U.S. Naval Research Laboratory (NRL) between 1991 and 2005 and supported in the later years by a number of university and industrial research laboratories. It laid the groundwork for the development of many commercial mobile augmented reality (AR) applications that are currently available for smartphones. Furthermore, it has helped shape a number of ongoing research activities in mobile AR.

oCurrent affiliation; research performed at the Naval Research Laboratory.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Bell, B., Feiner, S., & Höllerer, T. (2001). View management for virtual and augmented reality. In ACM symposium on user interface software and technology (pp. 101–110).

    Google Scholar 

  • Bell, B., Feiner, S., & Höllerer, T. (2002). Information at a glance. IEEE Computer Graphics & Applications, 22(4), 6–9.

    Article  Google Scholar 

  • Benko, H., & Feiner, S. (2007). Balloon selection: A multi-finger technique for accurate low-fatigue 3D selections. In IEEE symposium on 3D user interfaces (pp. 79–86).

    Google Scholar 

  • Feiner, S., & Shamash, A. (1991). Hybrid user interfaces: Breding virtually bigger interfaces for physically smaller computers. In ACM symposium on user interface software and technology (pp. 9–17).

    Google Scholar 

  • Feiner, S., & Seligmann, D. (1992). Cutaways and ghosting: Satisfying visibility constraints in dynamic 3D illustrations. The Visual Computer, 8(5–6), 292–302.

    Article  Google Scholar 

  • Feiner, S., MacIntyre, B., & Seligmann, D. (1992). Annotating the real work with knowledge-based graphics on a see-through head-mounted display. In Graphics interface ’92 (pp. 78–85).

    Google Scholar 

  • Feiner, S., MacIntyre, B., & Seligmann, D. (1993). Knowledge-based augmented reality. Communications of the ACM, 36(7), 52–62.

    Article  Google Scholar 

  • Feiner, S., MacIntyre, B., Höllerer, T., & Webster, T. (1997). A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In International symposium on wearable computers (pp. 74–81).

    Google Scholar 

  • Feiner, S., Bell, B., Gagas, E., Güven, S., Hallaway, D., Höllerer, T., Lok, S., Tinna, N., Yamamoto, R., Julier, S., Baillot, Y., Brown, D., Lanzagorta, M., Butz, A., Foxlin, E., Harrington, M., Naimark, L., & Wormell, D. (2001). Mobile augmented reality systems. In 28th international conference on computer graphics and interactive techniques (SIGGRAPH 2001). Conference abstracts and applications (p. 129).

    Google Scholar 

  • Gabbard, J. L., Swan II, J. E., Hix, D., Lanzagorta, M., MA, Livingston, Brown, D., & Julier, S. J. (2002). Usability engineering: domain analysis activities for augmented reality systems. In SPIE: Vol. 4660. Stereoscopic displays and virtual reality systems IX (pp. 445–457).

    Google Scholar 

  • Gabbard, J. L., Swan II, J. E., Hix, D., Si-Jung, K., & Fitch, G. (2007). Active text drawing styles for outdoor augmented reality: A user-based study and design implications. In IEEE virtual reality (pp. 35–42).

    Google Scholar 

  • Güven, S., & Feiner, S. (2004). A hypermedia authoring tool for augmented and virtual reality. The New Review of Hypermedia and Multimedia 9, 89–116.

    Article  Google Scholar 

  • Henderson, S., & Feiner, S. (2010). Opportunistic tangible user interfaces for augmented reality. IEEE Transactions on Visualization and Computer Graphics, 16(1), 4–16.

    Article  Google Scholar 

  • Henderson, S., & Feiner, S. (2011). Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Transactions on Visualization and Computer Graphics, 17(10), 1355–1368.

    Article  Google Scholar 

  • Hix, D., Gabbard, J. L., Swan II, J. E., Livingston, M. A., Höllerer, T., Julier, S. J., Baillot, Y., & Brown, D. (2004). A cost-effective usability evaluation progression for novel interactive systems. In Hawaii international conference on system sciences (HICSS-37).

    Google Scholar 

  • Höllerer, T., Feiner, S., & Pavlik, J. (1999). Situated documentaries: embedding multimedia presentations in the real world. In International symposium on wearable computers (pp. 79–86).

    Google Scholar 

  • Höllerer, T., Feiner, S., Hallaway, D., Bell, B., Lanzagorta, M., Brown, D., Julier, S., Baillot, Y., & Rosenblum, L. (2001). User interface management techniques for collaborative mobile augmented reality. Computers and Graphics, 25(5), 799–810.

    Article  Google Scholar 

  • Ioannidis, J., Duchamp, D., & Maguire, G. Q. Jr (1991). IP-based protocols for mobile internetworking. In ACM SIGCOMM (pp. 235–245).

    Google Scholar 

  • Jones, J. A., Swan II, J. E., Singh, G., Kolstad, E., & Ellis, S. R. (2008). The effects of virtual reality, augmented reality, and motion parallax on egocentric depth perception. In Symposium on applied perception in graphics and visualization (pp. 9–14).

    Chapter  Google Scholar 

  • Julier, S., Feiner, S., & Rosenblum, L. (1999). Augmented reality as an example of a demanding human-centered system. In First EC/NSF advanced research workshop.

    Google Scholar 

  • Julier, S., Lanzagorta, M., Baillot, Y., Rosenblum, L., Feiner, S., Höllerer, T., & Sestito, S. (2000a). Information filtering for mobile augmented reality. In IEEE international symposium on augmented reality (pp. 3–11).

    Google Scholar 

  • Julier, S., Baillot, Y., Lanzagorta, M., Brown, D., & Rosenblum, L. (2000b). BARS: Battlefield augmented reality system. In NATO symposium on information processing techniques for military systems (pp. 9–11).

    Google Scholar 

  • Julier, S., Baillot, Y., Lanzagorta, M., Rosenblum, L. J., & Brown, D. (2001). Urban terrain modelling for augmented reality applications. In 3D synthetic environment reconstruction (Chap. 6, pp. 119–136). Dordrecht: Kluwer Academic Press.

    Google Scholar 

  • Livingston, M. A., Rosenblum, L. J., Julier, S. J., Brown, D. G., Baillot, Y., Swan II, J. E., Gabbard, J. L., & Hix, D. (2002). An augmented reality system for military operations in urban terrain. In Interservice/industry training, simulation, and education conference (p. 89).

    Google Scholar 

  • Livingston, M. A., Swan II, J. E., Gabbard, J. L., Höllerer, T. H., Hix, D., Julier, S. J., Baillot, Y., & Brown, D. G. (2003). Resolving multiple occluded layers in augmented reality. In 2nd international symposium on mixed and augmented reality (pp. 56–65).

    Chapter  Google Scholar 

  • Livingston, M. A., Zanbaka, C., Swan II, J. E., & Smallman, S. (2005). Objective measures for the effectiveness of augmented reality. In Proceedings of IEEE virtual reality (poster session), Bonn, Germany (pp. 287–288).

    Chapter  Google Scholar 

  • Livingston, M. A., Lederer, A., Ellis, S. R., White, S. M., & Feiner, S. K. (2006). Vertical vergence calibration for augmented reality displays. In IEEE virtual reality (Poster Session).

    Google Scholar 

  • Livingston, M. A., Ai, Z., Swan II, J. E., & Smallman, H. S. (2009). Indoor vs. outdoor depth perception for mobile augmented reality. In IEEE virtual reality (pp. 55–61).

    Google Scholar 

  • Livingston, M. A., Karsch, K., Ai, Z., & Gibson, G. O. (2011). User interface design for military AR applications. Virtual Reality, 15, 175–184.

    Article  Google Scholar 

  • Loomis, J. M., Klatzky, R. L., Golledge, R. G., Cicinelli, J. G., Pellegrino, J. W., & Fry, P. A. (1993). Nonvisual navigation by blind and sighted: Assessment of path integration ability. Journal of Experimental Psychology, General, 122(1), 73–91.

    Article  Google Scholar 

  • MacIntyre, B. M., & Feiner, S. (1996). Future multimedia user interfaces. Multimedia Systems, 4(5), 250–268.

    Article  Google Scholar 

  • MacIntyre, B., Coelho, E. M., & Julier, S. J. (2002). Estimating and adapting to registration errors in augmented reality systems. In IEEE virtual reality (pp. 73–80).

    Google Scholar 

  • Rosenblum, L., Durbin, J., Doyle, R., & Tate, D. (1997). Situational awareness using the VR responsive workbench. IEEE Computer Graphics and Applications, 17(4), 12–13.

    Google Scholar 

  • Rosenberg, R., Lanzagorta, M., Kuo, E., King, R., & Rosenblum, L. (2000). Immersive scientific visualization. In NRL review (pp. 137–139).

    Google Scholar 

  • Seligmann, D., & Feiner, S. (1989). Specifying composite illustrations with communicative goals. In ACM symposium on user interface software and technology (pp. 1–9).

    Google Scholar 

  • Seligmann, D., & Feiner, S. (1991). Automated generation of intent-based 3D illustrations. Computer Graphics, 25(4), 123–132.

    Article  Google Scholar 

  • Singh, G., Swan II, J. E., Jones, J. A., & Ellis, S. R. (2010). Depth judgment measures and occluding surfaces in near-field augmented reality. In Symposium on applied perception in graphics and visualization (pp. 149–156).

    Google Scholar 

  • Sukan, M., & Feiner, S. (2010). SnapAR: Storing snapshots for quick viewpoint switching in hand-held augmented reality. In IEEE international symposium on mixed and augmented reality (pp. 273–274).

    Chapter  Google Scholar 

  • Swan II, J. E., Livingston, M. A., Smallman, H. S., Brown, D. G., Baillot, Y., Gabbard, J. L., & Hix, D. (2006). A perceptual matching technique for depth judgments in optical, see-through augmented reality. In IEEE virtual reality (pp. 19–26).

    Google Scholar 

  • Swan II, J. E., Jones, J. A., Kolstad, E., Livingston, M. A., & Smallman, H. S. (2007). Egocentric depth judgments in optical, see-through augmented reality. IEEE Transactions on Visualization and Computer Graphics, 13(3), 429–442.

    Article  Google Scholar 

  • Watsen, K., & Zyda, M. (1998). Bamboo—a portable system for dynamically extensible, networked, real-time, virtual environments. In Virtual reality annual international symposium (pp. 252–259).

    Google Scholar 

  • White, S., & Feiner, S. (2009). SiteLens: Situated visualization techniques for urban site visits. In ACM SIGCHI conference on-human factors in computing systems (pp. 1117–1120).

    Google Scholar 

Download references

Acknowledgements

The authors wish to thank Yohan Baillot, Reinhold Behringer, Blaine Bell, Dennis Brown, Aaron Bryden, Enylton Coelho, Elliot Cooper-Balis, Deborah Hix, Joseph Gabbard, Brian Goldiez, Tobias Höllerer, Bryan Hurley, Marco Lanzagorta, Dennis Lin, Blair MacIntyre, Douglas Maxwell, Ulrich Neumann, Gregory Schmidt, Erik Tomlin, Ross Whitaker, Suya You, and Catherine Zanbaka. We appreciate the support we had over this extended time period from ONR. In particular, we thank Andre van Tilborg, Wen Masters, Paul Quinn, and Ralph Wachter. We also thank Randy Shumaker and John McLean for their support for the NRL portion of the research. Opinions expressed in this article are those of the authors and do not represent official positions of the Naval Research Laboratory, the National Science Foundation, or any other institution.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lawrence J. Rosenblum .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag London Limited (outside the USA)

About this chapter

Cite this chapter

Rosenblum, L.J., Feiner, S.K., Julier, S.J., Swan, J.E., Livingston, M.A. (2012). The Development of Mobile Augmented Reality. In: Dill, J., Earnshaw, R., Kasik, D., Vince, J., Wong, P. (eds) Expanding the Frontiers of Visual Analytics and Visualization. Springer, London. https://doi.org/10.1007/978-1-4471-2804-5_24

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2804-5_24

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2803-8

  • Online ISBN: 978-1-4471-2804-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics