Advertisement

Head-Tracked Light Field Movies: A New Multimedia Data Type

  • Gavin S. P. Miller
  • Steven M. Rubin
  • Philip M. Hubbard
  • Jenny Dana
  • John Woodfill
Part of the Eurographics book series (EUROGRAPH)

Abstract

This paper presents a new multimedia data type based on time-varying light fields. Such a light field movie may be precomputed using computer graphics, or photographically captured from real objects as they change over time. Such movies allow a user to experience motion parallax in response to head motion in addition to motion cues within the scene as well as stereo vision cues. Important elements to make such media practical include light field movie capture devices, effective compression schemes with real-time playback, and accurate head tracking. This paper addresses these areas and presents results from the current system as well as directions for future work.

Keywords

Compression Ratio Vector Quantization Light Field Motion Parallax Index Pair 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Gersho, A., Gray, R.M.: Vector Quantization and Signal Compression. Kluwer Academic Publishers, Dordrecht (1992)MATHCrossRefGoogle Scholar
  2. 2.
    Deering, M.F: High Resolution Virtual Reality. Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York (1992) 195–202Google Scholar
  3. 3.
    Cutler, L.D., Frolich, B., Hanrahan, P.: Two-Handed Direct Manipulation on the Responsive Workbench. 1997 Symposium on Interactive 3D Graphics, ACM (1997) 107–114Google Scholar
  4. 4.
    Levoy, M., Hanrahan, P.: Light Field Rendering. Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York (1996) 31–42Google Scholar
  5. 5.
    Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York (1996) 43–54Google Scholar
  6. 6.
    Chen, S.E.: QuickTime VR–An Image-Based Approach to Virtual Environment Navigation. Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York (1995) 29–38.Google Scholar
  7. 7.
    Lucente, M., St-Hilaire, P., Benton, S.A., Arias, D.L., Watlington, J.A.: New Approaches to Holographic Video. SPIE Proceedings #1732, Holographics International (1992) 377–386Google Scholar
  8. 8.
    Kajiki, Y., Yoshikawa, H., Honda, T.: Three-dimensional Display with Focused Light Array. SPIE Proceedings #2652, Practical Holography X (1996), 106–116Google Scholar
  9. 9.
    Shiwa, S., Tersutani, N., Akiyama, K., Ichinose, S.,. Komatsu, T.: Development of Direct-View 3D Display for Video-phones Using 15 inch LCD and Lenticular Sheet, IEICE Trans. Inf. and Syst. Vol E77-D, No. 9, Sept. 1994.Google Scholar
  10. 10.
    Regan, M., Miller, G.S.P., Rubin, S.M., Kogelnik, C.: A Real-Time Low-Latency Hardware Light-Field Renderer. To appear Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York (1999)Google Scholar
  11. 11.
    Halle, M.: Holographic Stereograms as Discrete Imaging Systems. SPIE Proceedings #2176, Practical Holography VIII (1994) 73–84Google Scholar
  12. 12.
    Morimoto. C., Koons, D., Amir, A., Flickner, M.: Pupil Detection and Tracking Using Multiple Light Sources. IBM Research Report, 1998, available from the WWW site: http://domino.watson.ibm.com/library/cyberdig.nsf/Home.Google Scholar
  13. 13.
    Bradski, G.R.: Computer Vision Face Tracking for Use in a Perceptual User Interface. Intel Technology Journal, Q2 1998, http://developer.intel.com/technology/itj/g21998.Google Scholar
  14. 14.
    Birchfield, S., Elliptical Head Tracking Using Intensity Gradients and Color Histograms. Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1998) 232–237Google Scholar
  15. 15.
    Darrell, T., Gordon, G., Harville, M., Woodfill, J.: Integrated Person Tracking Using Stereo, Color, and Pattern Detection. Proceedings IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1998) 601–609Google Scholar
  16. 16.
    Woodfill, J., Von Herzen, B.: Real-Time Stereo Vision on the PARTS Reconfigurable Computer. Proceedings IEEE Symposium on Field-Programmable Custom Computing Machines (1997) 242–250Google Scholar
  17. 17.

Copyright information

© Springer-Verlag/Wien 2000

Authors and Affiliations

  • Gavin S. P. Miller
    • 1
  • Steven M. Rubin
    • 1
  • Philip M. Hubbard
    • 1
  • Jenny Dana
    • 1
  • John Woodfill
    • 1
  1. 1.Interval Research CorporationPalo AltoUSA

Personalised recommendations