Skip to main content
SpringerLink
Log in

Free-Viewpoint Television

  • Chapter
  • First Online:
Image and Geometry Processing for 3-D Cinematography

Part of the book series: Geometry and Computing ((GC,volume 5))

Abstract

Free-viewpoint TV (FTV) is an ultimate 3DTV that enables users to view a 3D world by freely changing their viewpoints as if they were there. FTV will bring an epochal change in the history of television since this function has not yet been achieved by conventional TV technology. FTV will greatly contribute to the development of industry, society, life and culture because FTV has an infinite number of viewpoints and hence it has very high sensing and representation capabilities. Tanimoto Lab of Nagoya University proposed the concept of FTV and constructed the world’s first real-time system including the complete chain of operation from image capture to display. We also realized FTV on a single PC and FTV with free listening-point audio. FTV is a ray-based system rather than a pixel-based system. We are creating ray-based image engineering through the development of FTV. MPEG regards FTV as the most challenging 3D media and has been conducting the international standardization activities of FTV. The first phase of FTV was MVC (Multi-view Video Coding) and the second phase of FTV is 3DV (3D Video). MVC was completed in March 2009. 3DV is a standard that targets serving a variety of 3D displays.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Tanimoto, M.: Free viewpoint television. J. Three Dimensional Images 15(3), 17–22 (2001) (in Japanese)

    Google Scholar 

  2. Tanimoto, M.: Free viewpoint television – FTV. In: Picture Coding Symposium 2004, Special Session 5, December 2004

    Google Scholar 

  3. Tanimoto, M.: FTV (free viewpoint television) creating ray-based image engineering. In: Proc. of ICIP2005, pp. II-25–II-28, September 2005

    Google Scholar 

  4. Tanimoto, M.: Overview of free viewpoint television. Signal Proces. Image Commun. 21(6), 454–461 (2006)

    Article  Google Scholar 

  5. Tanimoto, M.: Free viewpoint television. In: OSA Topical Meeting on Digital Holography and Three-Dimensional Imaging, DWD2, June 2007 (Invited Paper)

    Google Scholar 

  6. Tanimoto, M.: FTV (free viewpoint TV) and creation of ray-based image engineering. ECTI Trans. Electr. Eng., Electron. Commun. 6(1), 3–14 (2008) (Invited Paper)

    Google Scholar 

  7. Tanimoto, M.: FTV (free viewpoint TV) and ray-space technology. IBC2008, The Cutting Edge, Part Two, September 2008

    Google Scholar 

  8. Fujii, T.: A basic study on integrated 3-D visual communication. Ph.D dissertation in engineering, The University of Tokyo (1994) (in Japanese)

    Google Scholar 

  9. Fujii, T., Kimoto, T., Tanimoto, M.: Ray space coding for 3D visual communication. In: Picture Coding Symposium 1996, pp. 447–451, March 1996

    Google Scholar 

  10. Tanimoto, M., Nakanishi, A., Fujii, T., Kimoto, T.: The hierarchical ray-space for scalable 3-D image coding. In: Picture Coding Symposium 2001, pp. 81–84, April 2001

    Google Scholar 

  11. Fujii, T., Tanimoto, M.: Free-viewpoint television based on the ray-space representation. In: Proc. SPIE ITCom 2002, pp. 175–189, August 2002

    Article  Google Scholar 

  12. Sekitoh, M., Toyota, K., Fujii, T., Kimoto, T., Tanimoto, M.: Virtual bird’s-eye view system based on real image. EVA 2000 Gifu, 8, pp. 8-1–8-7, October 2000

    Google Scholar 

  13. Sekitoh, M., Fujii, T., Kimoto, T., Tanimoto, M.: Bird’s eye view system for ITS. In: IEEE, Intelligent Vehicle Symposium, pp. 119–123, May 2001

    Google Scholar 

  14. Tehrani, M.P., Niwa, K., Fukushima, N., Hirano, Y., Fujii, T., Tanimoto, M., Takeda, K., Mase, K., Ishikawa, A., Sakazawa, S., Koike, A.: 3DAV integrated system featuring arbitrary listening-point and viewpoint generation. In: Proc. of IEEE Multimedia Signal Processing, MMSP 2008, PID-213, pp. 855–860 (October 2008). (Best paper award)

    Google Scholar 

  15. Introduction to multi-view video coding. ISO/IEC JTC 1/SC 29/WG11, N7328, July 2005. http://www.chiariglione.org/mpeg/technologies/mp-mv/index.htm

  16. Introduction to 3D video. ISO/IEC JTC1/SC29/WG11 N9784, May 2008. http://www.chiariglione.org/mpeg/technologies/mp3d/index.htm

  17. Levoy, M., Hanrahan, P.: Light field rendering. In: Proc. SIGGRAPH (ACM Trans. Graphics), pp. 31–42, August 1996

    Google Scholar 

  18. Shum, H.Y., He, L.W.: Rendering with concentric mosaics. In: Proc. SIGGRAPH (ACM Trans. Graphics), pp. 299–306, August 1999

    Google Scholar 

  19. Na Bangchang, P., Fujii, T., Tanimoto, M.: Experimental system of free viewpoint television. In: Proc. IST/SPIE Symposium on Electronic Imaging, vol. 5006–66, pp. 554–563, Jan. 2003

    Google Scholar 

  20. Na Bangchang, P., Tehrani, M.P., Fujii, T., Tanimoto, M.: Realtime system of free viewpoint television. J. Inst. Image Inform. Televis. Eng. (ITE) 59(8), 63–701 (2005)

    Google Scholar 

  21. Fujii, T., Mori, K., Takeda, K., Mase, K., Tanimoto, M., Suenaga, Y.: Multipoint measuring system for video and sound: 100-camera and microphone system. In: IEEE 2006 International Conference on Multimedia & Expo (ICME), pp. 437–440, July 2006

    Google Scholar 

  22. Matsumoto, K., Yendo, T., Fujii, T., Tanimoto, M.: Multiple-image rectification for FTV. In: Proc. of 3D Image Conference 2006, P-19, pp. 171–174, July 2006

    Google Scholar 

  23. Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: A novel rectification method for two-dimensional camera array by parallelizing locus of feature points. In: Proc. of IWAIT2008, B5-1, January 2008

    Google Scholar 

  24. Yamamoto, K., Yendo, T., Fujii, T., Tanimoto, M.: Colour correction for multiple-camera system by using correspondences. J. Inst. Image Inform. Televis. Eng. 61(2), 213–222 (2007)

    Article  Google Scholar 

  25. He, Y., Ostermann, J., Tanimoto, M., Smolic, A.: Introduction to the special section on multiview video coding. IEEE Trans. Circ. Syst. Video Tech. 17(11), 1433–1435 (2007)

    Article  Google Scholar 

  26. Yamamoto, K., Kitahara, M., Yendo, T., Fujii, T., Tanimoto, M., Shimizu, S., Kamikura, K., Yashima, Y.: Multiview video coding using view interpolation and color correction. IEEE Trans. Circ. Syst. Video Tech. 17(11), 1436–1449 (2007)

    Article  Google Scholar 

  27. Nakanishi, A., Fujii, T., Kimoto, T., Tanimoto, M.: Ray-space data interpolation by adaptive filtering using locus of corresponding points on epipolar plane image. J. Inst. Image Inform. Televis. Eng. (ITE) 56(8), 1321–1327 (2002)

    Google Scholar 

  28. Droese, M., Fujii, T., Tanimoto, M.: Ray-space interpolation based on filtering in disparity domain. In: Proc. 3D Conference 2004, pp. 213–216, Tokyo, Japan, June 2004

    Google Scholar 

  29. Droese, M., Fujii, T., Tanimoto, M.: Ray-Space Interpolation Constraining Smooth Disparities Based On Loopy Belief Propagation. In: Proc. of IWSSIP 2004, pp. 247–250, Poznan, Poland, Sept. 2004

    Google Scholar 

  30. Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: Real-time arbitrary view interpolation and rendering system using ray-space. In: Proc. SPIE Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 250–261, Nov. 2005

    Google Scholar 

  31. Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: An effective partial interpolation method for ray-space. In: Proc. of 3D Image Conference 2006, pp. 85–88, July 2006

    Google Scholar 

  32. Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: Free viewpoint image generation using multi-pass dynamic programming. In: Proc. SPIE Stereoscopic Displays and Virtual Reality Systems XIV, vol. 6490, pp. 460–470, Feb. 2007

    Google Scholar 

  33. Sugawara, M., Kanazawa, M., Mitani, K., Shimamoto, H., Yamashita, T., Okano, F.: Ultrahigh-definition video system with 4000 scanning lines. SMPTE Mot. Imag. J. 112, 339–346 (2003)

    Google Scholar 

  34. Fujii, T., Tanimoto, M.: Real-time ray-space acquisition system. SPIE Electron. Imaging 5291, 179–187 (2004)

    Google Scholar 

  35. Manoh, K., Yendo, T., Fujii, T., Tanimoto, M.: Ray-space acquisition system of all-around convergent views using a rotation mirror. In: Proc. of SPIE, vol. 6778, pp. 67780C-1–8, September 2007

    Google Scholar 

  36. Fujii, T., Yendo, T., Tanimoto, M.: Ray-space transmission system with real-time acquisition and display. In: Proc. of IEEE Lasers and Electro-optics Society Annual Meeting 2007, pp. 78–79, October 2007

    Article  Google Scholar 

  37. Endo, T., Kajiki, Y., Honda, T., Sato, M.: Cylindrical 3-D video display observable from all directions. In: Proc. of Pacific Graphics 2000, pp. 300–306, October 2000

    Google Scholar 

  38. Takano, R., Yendo, T., Fujii, T., Tanimoto, M.: Scene separation in ray-space. In: Proc. of IMPS2005, pp. 31–32, November 2005

    Google Scholar 

  39. Takano, R., Yendo, T., Fujii, T., Tanimoto, M.: Scene separation and synthesis processing in ray-space. In: Proc. of IWAIT2007, P6–23, pp. 878–883, January 2007

    Google Scholar 

  40. Chimura, N., Yendo, T., Fujii, T., Tanimoto, M.: New visual arts by processing ray-space. In: Proc. of Electronic Imaging & the Visual Arts (EVA) 2007 Florence, pp. 170–175, March 2007

    Google Scholar 

  41. Chimura, N., Yendo, T., Fujii, T., Tanimoto, M.: Image generation with special effects by deforming ray-space. In: Proc. of NICOGRAPH, S1–4, November 2007

    Google Scholar 

  42. Tanimoto, M., Fujii, T.: FTV—free viewpoint television. ISO/IEC JTC1/SC29/WG11 M8595, July 2002

    Google Scholar 

  43. Tanimoto, M., Fujii, T., Kimata, H., Sakazawa, S.: Proposal on requirements for FTV. ISO/IEC JTC1/SC29/WG11, M14417, April 2007

    Google Scholar 

  44. Applications and requirements on FTV. ISO/IEC JTC1/SC29/WG11, N9466, October 2007

    Google Scholar 

  45. AHG on FTV (free viewpoint television). ISO/IEC JTC1/SC29/WG11 N8947, April 2007

    Google Scholar 

  46. Tanimoto, M., Fujii, T., Suzuki, K.: Experiment of view synthesis using multi-view depth. ISO/IEC JTC1/SC29/WG11, M14889, October 2007

    Google Scholar 

  47. Mori, Y., Fukushima, N., Yendo, T., Fujii, T., Tanimoto, M.: View generation with 3D warping using depth information for FTV. Signal Process. Image Commun. 24(1–2) 65–72 (2009)

    Article  Google Scholar 

  48. Applications and requirements on 3D video coding. ISO/IEC JTC 1/SC 29/WG11, N11061, October 2009

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Engineering, Nagoya University Furo-cho, Chikusa-ku, Nagoya, 464-8603, Japan

    Masayuki Tanimoto

Authors
  1. Masayuki Tanimoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Masayuki Tanimoto .

Editor information

Editors and Affiliations

  1. LEAR Team, INRIA, avenue de l'Europe, Montbonnot, 38330, France

    RĂ©mi Ronfard

  2. Div. Engineering, Brown University, Providence, 02912, USA

    Gabriel Taubin

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Tanimoto, M. (2010). Free-Viewpoint Television. In: Ronfard, R., Taubin, G. (eds) Image and Geometry Processing for 3-D Cinematography. Geometry and Computing, vol 5. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12392-4_3

Download citation

Publish with us

Policies and ethics

Search

Navigation