Abstract
Recently a new display type has emerged that is able to display 50,000 views offering a full parallax autostereoscopic view of static scenes. With the advancement in the manufacturing technology, multi-view displays come with more and more views of dynamic content, closing the gap to this high quality full parallax display.
The established method of content generation for synthetic stereo images is to render both views. To ensure a high quality these images are often ray traced. With the increasing number of views, rendering of all views is not feasible for multi-view displays.
Therefore methods are required that can render the large amount of different views required by those displays efficiently. In the following a complete solution is presented that describes how all views for a full parallax display can be rendered from a small set of input images and their associated depth images with an image-based rendering algorithm.
An acceleration of the rendering of two orders of magnitude is achieved by different parallelization techniques and the use of efficient data structures.
Moreover, the problem of finding the best-next-view for an image-based rendering algorithm is addressed and a solution is presented that ranks possible viewpoints based on their suitability for an image-based rendering algorithm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yang, R., Huang, X., Li, S., Jaynes, C.: Toward the Light Field Display: Autostereoscopic Rendering via a Cluster of Projectors. IEEE Transactions on Visualization and Computer Graphics 14, 84–96 (2008)
Baker, H., Li, Z.: Camera and projector arrays for immersive 3D video. In: Proceedings of the 2nd International Conference on Immersive Telecommunications, IMMERSCOM 2009, pp. 1–23. Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, Brussels (2009)
Jung, D., Koch, R.: Efficient Depth-Compensated Interpolation for Full Parallax Displays. In: 5th International Symposium 3D Data Processing, Visualization and Transmission (3DPVT) (2010)
Jung, D., Koch, R.: A Best-Next-View-Selection Algorithm for Multi-View Rendering. In: 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT) (accepted 2011)
Adelson, E.H., Bergen, J.R.: The Plenoptic Function and the Elements of Early Vision. In: Computational Models of Visual Processing, pp. 3–20. MIT Press, Cambridge (1991)
McMillan, L.: Plenoptic Modeling: An Image-Based Rendering System. In: Proceedings of SIGGRAPH 1995, pp. 39–46. ACM, New York (1995)
Ashdown, I.: Near-Field Photometry: A New Approach. Journal of the Illuminating Engineering Society 22, 163–180 (1993)
Levoy, M., Hanrahan, P.: Light Field Rendering. In: Proceedings of SIGGRAPH 1996, pp. 31–42. ACM, New York (1996)
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. In: Proceedings of SIGGRAPH 1996, pp. 43–54. ACM, New York (1996)
Szeliski, R.: Rapid octree construction from image sequences. In: CVGIP, vol. 58, pp. 23–32 (1993)
Lischinski, D., Rappoport, A.: Image-Based Rendering for Non-Diffuse Synthetic Scenes. In: Rendering Techniques 1998: Proceedings of the Eurographics Workshop in Vienna, pp. 301–314 (1998)
Koch, R., Evers-Senne, J.F.: View Synthesis and Rendering Methods. In: Schreer, O., Kauff, P., Sikora, T.E. (eds.) 3D Video Communication - Algorithms, Concepts and Real-time Systems in Human-Centered Communication, pp. 151–174. Wiley, Chichester (2005)
Halle, Kropp: Fast Computer Graphics Rendering for Full Parallax Spatial Displays. In: Proc. SPIE, vol. 3011, pp. 105–112 (1997)
Dietrich, A., Schmittler, J., Slusallek, P.: World-Space Sample Caching for Efficient Ray Tracing of Highly Complex Scenes. Technical Report TR-2006-01, Computer Graphics Group, Saarland University (2006)
Dietrich, A., Slusallek, P.: Adaptive Spatial Sample Caching. In: Proceedings of the IEEE/EG Symposium on Interactive Ray Tracing 2007, pp. 141–147 (2007)
Teller, S.: Toward Urban Model Acquisition from Geo-Located Images. In: Proceedings of the 6th Pacific Conference on Computer Graphics and Applications, PG 1998, p. 45. IEEE Computer Society, Washington, DC, USA (1998)
Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., Fulk, D.: The digital Michelangelo project: 3D scanning of large statues. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2000, pp. 131–144. ACM Press, Addison-Wesley Publishing Co. (2000)
Tarabanis, K., Allen, P., Tsai, R.: A survey of sensor planning in computer vision. IEEE Transactions on Robotics and Automation 11, 86–104 (1995)
Werner, T., Hlavac, V., Leonardis, A., Pajdla, T.: Selection of Reference Views for Image-Based Representation. In: International Conference on Pattern Recognition, vol. 1, pp. 73–77 (1996)
Massios, N., Fisher, R.: A Best Next View Selection Algorithm Incorporating a Quality Criterion. In: BMV 1998 (1998)
Wong, L., Dumont, C., Abidi, M.: Next best view system in a 3D object modeling task. In: IEEE International Symposium Computational Intelligence in Robotics and Automation, CIRA 1999, pp. 306–311 (1999)
Fleishman, S., Cohen-Or, D., Lischinski, D.: Automatic Camera Placement for Image-Based Modeling. In: Proceedings of the 7th Pacific Conference on Computer Graphics and Applications, PG 1999, pp. 12–20. IEEE Computer Society, Washington, DC, USA (1999)
Byers, Z., Dixon, M., Goodier, K., Grimm, C., Smart, W.: An autonomous robot photographer. In: Proceedings. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003), vol. 3, pp. 2636–2641 (2003)
Scott, W.R., Roth, G., Rivest, J.F.: View planning for automated three-dimensional object reconstruction and inspection. ACM Comput. Surv. 35, 64–96 (2003)
Finkel, R.A., Bentley, J.L.: Quad trees: a data structure for retrieval on composite keys. Acta Informatica 4, 1–9 (1974), doi:10.1007/BF00288933
Wald, I., Slusallek, P., Benthin, C., Wagner, M.: Interactive rendering with coherent ray tracing. Computer Graphics Forum 20, 153–165 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Jung, D., Koch, R. (2011). Efficient Rendering of Light Field Images. In: Cremers, D., Magnor, M., Oswald, M.R., Zelnik-Manor, L. (eds) Video Processing and Computational Video. Lecture Notes in Computer Science, vol 7082. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24870-2_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-24870-2_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24869-6
Online ISBN: 978-3-642-24870-2
eBook Packages: Computer ScienceComputer Science (R0)