Skip to main content
SpringerLink
Log in

Interacting with 3D Graphic Objects in an Image-Based Environment

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing — PCM 2001 (PCM 2001)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2195))

Included in the following conference series:

  • 796 Accesses

Abstract

This paper presents a novel hybrid rendering system, which allows users to interact with 3D graphic objects in an image-based environment. To represent a complex environment, we use a collection of images captured by a longitudinally aligned camera array, which rotates along a circle. The captured images are indexed and compressed for efficient rendering of the environment. Moreover, users can interactively deploy 3D graphic objects and move around in a constrained 3D cylindrical space in the image-based environment. Unlike traditional virtual reality systems that must take into account all the geometrical objects in the scene, the present 3D graphic rendering engine needs only to deal with a small number of foreground 3D graphic objects in the image-based environment, therefore significantly reducing the 3D graphic processing time. Experiments demonstrate that this system can be used as a new virtual and augmented reality platform for games, virtual tours, virtual real estate, and many other applications.

This work was done while these authors were interns at Microsoft Research, China.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. http://www.3dcafe.com/

  2. S. E. Chen and L. Williams, View Interpolation for Image Synthesis, Computer Graphics Proceedings, Annual Conference Series, pages 279–288, Proc. SIGGRAPH 1993 (California), August 1993.

    Google Scholar 

  3. S. E. Chen, QuickTime VR-An Image-based Approach to Virtual Environment Navigation, Computer Graphics Proceedings, Annual Conference Series, pages 29–38, Proc. SIGGRAPH 1995 (Los Angeles), August 1995.

    Google Scholar 

  4. C.-S. Chen, Y.-P. Hung, S.-W. Shih, C.-C. Hsieh, C.-Y. Tang, C.-G. Yu and Y.-C. Cheng. Integrating 3D graphic objects into real images for augmented reality. In Proceedings of the ACM symposium on Virtual reality software and technology, 1998, pages 1–8.

    Google Scholar 

  5. Cheng-Chin Chiang, Alex Huang, Tsing-Shin Wang, Matthew Huang, Yunn-Yen Chen, Jun-Wei Hsieh, Ju-Wei Chen and Tse Cheng, PanoVR SDK — a software development kit for integrating photo-realistic panoramic images and 3-D graphical objects into virtual worlds, Proceedings of the ACM symposium on Virtual reality software and technology, September 15-17, 1997, Lausanne Switzerland, pages 147–154.

    Google Scholar 

  6. Paul Debevec, Rendering Synthetic Objects Into Real Scenes: Bridging Traditional and Image-Based Graphics With Global Illumination and High Dynamic Range Photography, SIGGRAPH 1998.

    Google Scholar 

  7. A. Gersho, R. M. Gray, Vector Quantization and signal compression, Kluwer Academic Publishers, 1992.

    Google Scholar 

  8. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, The Lumigraph, Computer Graphics Proceedings, Annual Conference Series, pages 43–54, Proc. SIGGRAPH 1996 (New Orleans), August 1996.

    Google Scholar 

  9. M. Levoy and P. Hanrahan, Light Field Rendering, Computer Graphics Proceedings, Annual Conference Series, pages 31–42, Proc. SIGGRAPH 1996 (New Orleans), August 1996.

    Google Scholar 

  10. Jiang Li, Kun Zhou, Yong Wang and Heung-Yeung Shum, A Novel Image-Based Rendering System with A Longitudinally Aligned Camera Array, Eurographics 2000 Short Presentations, pp.107–114, Interlaken, Switzerland, 21-25 August, 2000.

    Google Scholar 

  11. A. Lippman, Movie Maps: An Application of the Optical Videodisc to Computer Graphics, Computer Graphics (Proc. SIGGRAPH 1980), pp. 32–43, 1980.

    Google Scholar 

  12. L. McMillan and G. Bishop. Plenoptic Modeling: An Image-based Rendering System, Computer Graphics Proceedings, Annual Conference Series, pages 39–46, Proc. SIGGRAPH 1995, August, 1995.

    Google Scholar 

  13. G. Miller, E. Hoffert, S. E. Chen, E. Patterson, D. Blackketter, S. Rubin, S. A. Applin, D. Yim, J. Hanan, The Virtual Museum: Interactive 3D Navigation of A Multimedia Database, The Journal of Visualization and Computer Animation (3): 183–197, 1992.

    Article  Google Scholar 

  14. D. G. Riply, DVI-A Digital Multimedia Technology, Communications of the ACM, 32(7): 811–822, 1989.

    Article  Google Scholar 

  15. H. Y. Shum and L. W. He, Rendering with Concentric Mosaics, Computer Graphics Proceedings, Annual Conference Series, pages 299–306, Proc. SIGGRAPH 1999 (Los Angeles), August 1999.

    Google Scholar 

  16. Y. Yu and J. Malik, Recovering Photometric Properties of Architectural Scenes from Photographs, ACM Computer Graphics, Proc. of SIGGRAPH 1996, pp.207–218, 1998.

    Google Scholar 

  17. Y. Yu, P. Debevec, J. Malik and T. Hawkins, Inverse Global Illumination: Recovering Reflectance Models of Real Scenes from Photographs, ACM Computer Graphics, Proc. of SIGGRAPH 1999, pp.215–224, 1999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electric Engineering, Tsinghua University, Beijing, 100084, China

    Yong Wang

  2. Microsoft Research, China, 3F Sigma Building, 49 Zhichun Road, Beijing, 100080, China

    Jiang Li & Heung-Yeung Shum

  3. State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, 310027, China

    Kun Zhou

Authors
  1. Yong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jiang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kun Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Heung-Yeung Shum
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Microsoft Research China, 5/F Beijing Sigma Center 49 Zhichung Road, Haidian District, Beijing, 100080, China

    Heung-Yeung Shum

  2. Institute of Information Science, Academia Sinica, Taiwan

    Mark Liao

  3. Department of Electrical Engineering, Columbia University, New York, NY, 10027, USA

    Shih-Fu Chang

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wang, Y., Li, J., Zhou, K., Shum, HY. (2001). Interacting with 3D Graphic Objects in an Image-Based Environment. In: Shum, HY., Liao, M., Chang, SF. (eds) Advances in Multimedia Information Processing — PCM 2001. PCM 2001. Lecture Notes in Computer Science, vol 2195. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45453-5_30

Download citation

  • DOI: https://doi.org/10.1007/3-540-45453-5_30

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42680-6

  • Online ISBN: 978-3-540-45453-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation