Skip to main content

Visualization Techniques for Augmented Reality

  • Chapter
  • First Online:
Handbook of Augmented Reality

Abstract

Visualizations in real world environments benefit from the visual interaction between real and virtual imagery. However, compared to traditional visualizations, a number of problems have to be solved in order to achieve effective visualizations within Augmented Reality (AR). This chapter provides an overview of techniques to handle the main obstacles in AR visualizations. It discusses spatial integration of virtual objects within real world environments, techniques to rearrange objects within mixed environments, and visualizations which adapt to its environmental context.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gregory D. Abowd, Christopher G. Atkeson, Jason Hong, Sue Long, Rob Kooper, and Mike Pinkerton. Cyberguide: a mobile context-aware tour guide. Wireless Networks, 3:421–433, 1997.

    Article  Google Scholar 

  2. Ben Avery, Christian Sandor, and Bruce H. Thomas. Improving spatial perception for augmented reality x-ray vision. In Proceedings of the IEEE Conference on Virtual Reality, pages 79–82, 2009.

    Google Scholar 

  3. Ronald Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355–385, 1997.

    Google Scholar 

  4. Benjamin B. Bederson, Ben Shneiderman, and Martin Wattenberg. Ordered and quantum treemaps: Making effective use of 2d space to display hierarchies. ACM Transactions on Graphics, 21:833–854, 2002.

    Article  Google Scholar 

  5. Blaine Bell, Steven Feiner, and Tobias Höllerer. View management for virtual and augmented reality. In Proceedings of the ACM symposium on User interface software and technology, pages 101–110, 2001.

    Google Scholar 

  6. Marcelo Bertalmio, Guillermo Sapiro, Vincent Caselles, and Coloma Ballester. Image inpainting. In Proceedings of ACM SIGGRAPH, pages 417–424, 2000.

    Google Scholar 

  7. David E. Breen, Ross T. Whitaker, Eric Rose, and Mihran Tuceryan. Interactive occlusion and automatic object placement for augmented reality. Computer Graphics Forum, 15(3):11–22, 1996.

    Article  Google Scholar 

  8. Volkert Buchmann, Trond Nilsen, and Mark Billinghurst. Interaction with partially transparent hands and objects. In Proceedings of the Australian User Interface Conference, pages 17–2, 2005.

    Google Scholar 

  9. John F. Canny. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6):679–698, 1986.

    Article  Google Scholar 

  10. M. Sheelagh T. Carpendale, David J. Cowperthwaite, and F. David Fracchia. Extending distortion viewing from 2D to 3D. IEEE Computer Graphics and Applications, 17(4):42–51, 1997.

    Google Scholar 

  11. Ed H. Chi. A taxonomy of visualization techniques using the data state reference model. In Proceedings of the IEEE Symposium on Information Vizualization, pages 69–75, 2000.

    Google Scholar 

  12. Ben Close, John Donoghue, John Squires, Phillip De Bondi, Michael Morris, Wayne Piekarski, Bruce Thomas, Bruce Thomas, and Unisa Edu Au. ARQuake: An outdoor/indoor Augmented Reality first person application. In Proceedings of the IEEE International Symposium on Wearable Computers, pages 139–146, 2000.

    Google Scholar 

  13. Enylton Machado Coelho, Blair MacIntyre, and Simon J. Julier. Osgar: A scene graph with uncertain transformations. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 6–15, 2004.

    Google Scholar 

  14. Franklin C. Crow. Shaded computer graphics in the entertainment industry. Computer, 11(3):11–22, 1978.

    Article  Google Scholar 

  15. Stephen DiVerdi and Tobias Hollerer. Image-space correction of ar registration errors using graphics hardware. In Proceedings of the IEEE conference on Virtual Reality, pages 241–244, 2006.

    Google Scholar 

  16. Niklas Elmqvist and Philippas Tsigas. A taxonomy of 3d occlusion management for visualization. IEEE Transactions on Visualization and Computer Graphics, 14:1095–1109, 2008.

    Article  Google Scholar 

  17. Jan Fischer, Dirk Bartz, and W. Straßer. Enhanced Visual Realism by Incorporating Camera Image Effects. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 205–208, 2006.

    Google Scholar 

  18. Anton Fuhrmann, Helwig Löffelmann, Dieter Schmalstieg, and Michael Gervautz. Collaborative visualization in augmented reality. IEEE Computer Graphics and Applications, 18:54–59, 1998.

    Article  Google Scholar 

  19. Joseph Gabbard, Edward Swan, II, and Deborah Hix. The effects of text drawing styles, background textures, and natural lighting on text legibility in outdoor augmented reality. Presence, 15:16–32, 2006.

    Google Scholar 

  20. Joseph L. Gabbard, J. Edward Swan, II, Deborah Hix, Robert S. Schulman, John Lucas, and Divya Gupta. An empirical user-based study of text drawing styles and outdoor background textures for augmented reality. In Proceedings of the IEEE Conference on Virtual Reality, pages 11–18, 2005.

    Google Scholar 

  21. Eugen Bruce Goldstein. Sensation and Perception. Brooks/Cole, Pacific Grove, CA, 2001.

    Google Scholar 

  22. Amy A. Gooch and Bruce Gooch. Non-Photorealistic Rendering. AK Peters, Ltd., 2001.

    Google Scholar 

  23. Michael Haller, Stephan Drab, and Werner Hartmann. A real-time shadow approach for an augmented reality application using shadow volumes. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pages 56–65, 2003.

    Google Scholar 

  24. Knut Hartmann, Timo Götzelmann, Kamran Ali, and Thomas Strothotte. Metrics for functional and aesthetic label layouts. In Proceedings of International Symposium on Smart Graphics, pages 115–126, 2005.

    Google Scholar 

  25. Jeffrey Heer and Maneesh Agrawala. Software design patterns for information visualization. IEEE Transactions on Visualization and Computer Graphics, 12:853–860, 2006.

    Article  Google Scholar 

  26. Richard L. Holloway. Registration error analysis for augmented reality. Presence, 6(4):413–432, 1997.

    Google Scholar 

  27. Denis Kalkofen, Erick Mendez, and Dieter Schmalstieg. Interactive focus and context visualization for augmented reality. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 191–200, 2007.

    Google Scholar 

  28. Denis Kalkofen, Erick Mendez, and Dieter Schmalstieg. Comprehensible visualization for augmented reality. IEEE Transactions on Visualization and Computer Graphics, 15(2):193–204, 2009.

    Article  Google Scholar 

  29. Denis Kalkofen, Markus Tatzgern, and Dieter Schmalstieg. Explosion diagrams in augmented reality. In Proceedings of the IEEE Conference on Virtual Reality, pages 71–78, 2009.

    Google Scholar 

  30. Georg Klein and Tom Drummond. Sensor fusion and occlusion refinement for tablet-based AR. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 38–47, 2004.

    Google Scholar 

  31. Georg Klein and David W. Murray. Simulating low-cost cameras for augmented reality compositing. IEEE Transactions on Visualization and Computer Graphics, 16:369–380, 2010.

    Article  Google Scholar 

  32. Shoshichi Kobayashi and Katsumi Nomizu. Foundations of Differential Geometry. Wiley-Interscience, 1996.

    Google Scholar 

  33. Alex Leykin and Mihran Tuceryan. Determining text readability over textured backgrounds in augmented reality systems. In Proceedings of the ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry, pages 436–439, 2004.

    Google Scholar 

  34. Haibin Ling and David W. Jacobs. Shape classification using the inner-distance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29:286–299, 2007.

    Article  Google Scholar 

  35. Bunyo Okumura, Masayuki Kanbara, and Naokazu Yokoya. Augmented reality based on estimation of defocusing and motion blurring from captured images. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 219–225, 2006.

    Google Scholar 

  36. Xiaofeng Ren and Jitendra Malik. Learning a Classification Model for Segmentation. In Proceedings of the IEEE International Conference on Computer Vision, pages 10–17, 2003.

    Google Scholar 

  37. Cindy M. Robertson, Blair MacIntyre, and Bruce N. Walker. An evaluation of graphical context as a means for ameliorating the effects of registration error. IEEE Transactions on Visualization and Computer Graphics, 15(2):179–192, 2009.

    Article  Google Scholar 

  38. Christian Sandor, Andrew Cunningham, Arindam Dey, and Ville-Veikko Mattila. An augmented reality x-ray system based on visual saliency. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 27–36, 2010.

    Google Scholar 

  39. Christian Sandor, Andrew Cunningham, Ulrich Eck, Donald Urquhart, Graeme Jarvis, Arindam Dey, Sebastien Barbier, Michael Marner, and Sang Rhee. Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality. In Proceedings of the IEEE Conference on Virtual Reality, pages 47–50, 2010.

    Google Scholar 

  40. Kohei Tanaka, Y. Kishino, M. Miyamae, T. Terada, and S. Nishio. An information layout method for an optical see-through head mounted display focusing on the viewability. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 139–142, 2008.

    Google Scholar 

  41. Anne M. Treisman and Garry Gelade. A feature-integration theory of attention. Cognitive psychology, 12(1):97–136, 1980.

    Article  Google Scholar 

  42. Scott Vallance and P. Paul Calder. Context in 3D planar navigation. Australian Computer Science Communications, 23(5):93–99, 2001.

    Google Scholar 

  43. John Viega, M. Conway, G. Williams, and R. Pausch. 3d magic lenses. In Proceedings of the ACM symposium on User interface software and technology, pages 51–58, 1996.

    Google Scholar 

  44. Dirk Walther. Interactions of visual attention and object recognition : computational modeling, algorithms, and psychophysics. PhD thesis, California Institute of Technology, 2006.

    Google Scholar 

  45. Sean White and Steven Feiner. Sitelens: situated visualization techniques for urban site visits. In Proceedings of the international conference on human factors in computing systems, pages 1117–1120, 2009.

    Google Scholar 

  46. Sean White, Steven Feiner, and Jason Kopylec. Virtual vouchers: Prototyping a mobile augmented reality user interface for botanical species identification. In Proceedings of the 3D User Interfaces, pages 119–126, 2006.

    Google Scholar 

  47. Jason Wither and Tobias Höllerer. Pictorial depth cues for outdoor augmented reality. In Proceedings of the IEEE International Symposium on Wearable Computers, pages 92–99, 2005.

    Google Scholar 

  48. Shumin Zhai, William Buxton, and Paul Milgram. The partial-occlusion effect: utilizing semi-transparency in 3d human-computer interaction. ACM Transactions on Computer-Human Interaction, 3:254–284, 1996.

    Article  Google Scholar 

  49. Stefanie Zollmann, Denis Kalkofen, Erick Mendez, and Gerhard Reitmayr. Image-based ghostings for single layer occlusions in augmented reality. In Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality, pages 19–26, 2010.

    Google Scholar 

Download references

Acknowledgments

For valuable discussions on the topics presented in this chapter we would like thank Markus Tatzgern, Stefanie Zollmann, Steve Feiner, Peter Belhumeur, David Jacobs, John Kress, Sarah Williams, Petia Morozov, Andrew Cunningham and Arindam Dey. This research was in part funded by Nokia Research Center, a grant from the Boston Society of Architects, NSF Grant IIS-03-25867, and a gift from Microsoft.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Denis Kalkofen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Kalkofen, D., Sandor, C., White, S., Schmalstieg, D. (2011). Visualization Techniques for Augmented Reality. In: Furht, B. (eds) Handbook of Augmented Reality. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0064-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-0064-6_3

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-0063-9

  • Online ISBN: 978-1-4614-0064-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics