The Wavelet Stream: Interactive Multi Resolution Light Field Rendering

  • Ingmar Peter
  • Wolfgang Straßer
Part of the Eurographics book series (EUROGRAPH)


One of the most general image based object representations is the Light Field. Unfortunately, a large amount of data is required to reconstruct high quality views from a Light Field. In this paper, we present the wavelet stream which employs non-standard four-dimensional wavelet decomposition for Light Field compression. It allows for progressive transmission, storage, and rendering of compressed Light Field data. Our results show that 0.8% of the original coefficients or 0.3 bits per pixel, respectively are sufficient to obtain visually pleasing new views. Additionally, the wavelet stream allows for an adaptive multi-resolution representation of the Light Field data. Furthermore, a silhouette-encoding scheme helps to reduce the number of coefficients required. Our data structure allows to store arbitrary vector-valued data like RGB- or YUV-data. The Light Field data stored in the wavelet stream can be decompressed in real time for interactive rendering. For this, the reconstruction algorithm uses supplementary caching schemes.


Wavelet Coefficient Wavelet Decomposition Subdivision Scheme Progressive Transmission Wavelet Compression 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E. H. Adelson and J. R. Bergen. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, 1991.Google Scholar
  2. 2.
    Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. The lumigraph. In SIGGRAPH 96 Conference Proceedings, pages 43–54. August 1996.Google Scholar
  3. 3.
    Xianfeng Gu, Steven J. Gortler, and Michael F. Cohen. Polyhedral geometry and the twoplane parameterization. In Eurographics Rendering Workshop 1997, pages 1–12, June 1997. Springer Wien.Google Scholar
  4. 4.
    Insung Ihm, Rae Kyoung Lee, and Sanghoon Park. Rendering of Spherical Light Fields. In 5th Pacific Conference on Computer Graphics and Applications, pages 59–68, 1997.Google Scholar
  5. 5.
    Ming-Hoe Kiu, Xiao-Song Du, Robert J. Moorhead, David C. Banks, and Raghu Machiraju. Two Dimensional Sequence Compression Using MPEG. In SPIE Vol. 3309, SPIF/IS&T Electronic Imaging’ 97, San Jose, CA, January 1998.Google Scholar
  6. 6.
    Paul Lalonde and Alain Fournier. Interactive rendering of wavelet projected light fields. In Graphics Interface, pages 170–114, June 1999.Google Scholar
  7. 7.
    Marc Levoy and Pat Hanrahan. Light field rendering. In SIGGRAPH 96 Conference Proceedings, pages 31–42. August 1996.Google Scholar
  8. 8.
    M. Magnor, A. Endmann, and B. Girod. Progressive compression and rendering of light fields. In VMV 2000, pages 199–204, Saarbrücken, Germany.Google Scholar
  9. 9.
    Marcus Magnor and Bernd Girod. Data Compression in Image-Based Rendering. IEEE Transactions on Circuits and Systems for Video Technology, April 2000.Google Scholar
  10. 10.
    Gavin Miller, Steve Rubin, and Dulce Ponceleon. Lazy decompression of surface light fields for precomputer global illumination. In Rendering Techniques’ 98, pages 281–292. 1998 Springer Wien.Google Scholar
  11. 11.
    Ingmar Peter and Wolfgang Straßer. The wavelet stream: Progressive transmission of compressed light field data. In IEEE Visualization 1999 Late Breaking Hot Topics, pages 69–72. IEEE Computer Society, October 1999.Google Scholar
  12. 12.
    Amir Said and William A. Pearlman. A new fast and efficient image codec based on set partitioning in hierarchical trees. IEEE Transactions on Circuits and Systems for Video Technology, 6:243–250, June 1996.CrossRefGoogle Scholar
  13. 13.
    Hartrnut Schirmacher, Wolfgang Heidrich, and Hans-Peter Seidel. High-quality interactive lumigraph rendering through warping. In Graphics Interface, pages 87–94, May 2000.Google Scholar
  14. 14.
    J. M. Shapiro. Embedded image coding using zerotrees of wavelet coefficients. IEEE Transactions on Acoustics, Speech and Signal Processing, 41(12):3445–3462, 1993.MATHCrossRefGoogle Scholar
  15. 15.
    The Stanford Light Fields Archive. Scholar
  16. 16.
    Peter-Pike Sloan and Charles Hansen. Parallel Lumigraph Reconstruction. In Proc. of PVG 99, San Francisco, October 1999.Google Scholar
  17. 17.
    Eric J. Stollnitz, Tony D. DeRose, and David H. Salesin. Wavelets for Computer Graphics: Theory and Applications. Morgan Kaufmann, San Francisco, 1996.Google Scholar
  18. 18.
    T.-T. Wong, P.-A. Heng, S.-H. Or, and W-Y. Ng. Illumination of image-based objects. The Journal of Visualization and Computer Animation, 9(3), 1998.Google Scholar

Copyright information

© Springer-Verlag Wien 2001

Authors and Affiliations

  • Ingmar Peter
    • 1
  • Wolfgang Straßer
    • 1
  1. 1.WSI/GRISUniversity of TübingenGermany

Personalised recommendations