Advertisement

3-D Video Processing for 3-D TV

  • Kwanghoon Sohn
  • Hansung Kim
  • Yongtae Kim

Abstract

One of the most desirable ways of realizing high quality information and telecommunication services has been called “The Sensation of Reality,” which can be achieved by visual communication based on 3-D (Three-dimensional) images. These kinds of 3-D imaging systems have revealed potential applications in the fields of education, entertainment, medical surgery, video conferencing, etc. Especially, three-dimensional television (3-D TV) is believed to be the next generation of TV technology. Figure 13.1 shows how TV’s display technologies have evolved , and Fig. 13.2 details the evolution of TV broadcasting as forecasted by the ETRI (Electronics and Telecommunications Research Institute). It is clear that 3-D TV broadcasting will be the next development in this field, and realistic broadcasting will soon follow.

Keywords

Depth Information Virtual Object Enhancement Layer Disparity Estimation Occlude Region 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. [1]
    M. Accame, F. Natale and D. Giusto, “Hierarchical block matching for disparity estimation in stereo sequences,” Proc. IEEE Int. Conf. Image Processing, vol. 2, pp. 374–377, 1995.CrossRefGoogle Scholar
  2. [2]
    R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier and B. MacIntyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, vol. 25, no. 6, pp. 24–35, 2001.Google Scholar
  3. [3]
    S. Battiato, “3-D stereoscopic image pairs by depth-map generation,” Proc. 3-DPVT, pp. 124–131, 2004.Google Scholar
  4. [4]
    C. V. Berkel and D. W. Parker, “Multiview 3-D-LCD,” Proc. SPIE 2653, pp. 32–39, 1996.ADSCrossRefGoogle Scholar
  5. [5]
    CCIR 1–1/11 SP1c–1/11, “Constitution of a system of stereoscopic television,” 1958–1986.Google Scholar
  6. [6]
    CCIR Rep. 312–4 “Constitution of a system of stereoscopic television,” 1963–1966–1970–1978–1982.Google Scholar
  7. [7]
    S. Diplaris, “Generation of stereoscopic image sequences using structure and rigid motion estimation by extended kalman filters,” IEEE International Conference on Multimedia and Expo, pp. 233–236, 2002.Google Scholar
  8. [8]
    U. Dhond and J. Aggarwal, “Structure from stereo: a review,” IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 1489–1510, 1989.MathSciNetCrossRefGoogle Scholar
  9. [9]
    C.H. Esteban and F. Schmitt, “Multi-stereo 3-D object reconstruction,” Proc. 3-DPVT, pp. 159–167, 2002.Google Scholar
  10. [10]
    O. Faugeras, Three-dimensional computer vision: a geometric viewpoint, The MIT Press, London, 2001.Google Scholar
  11. [11]
    B. J. Garcia, “Approaches to stereoscopic video based on spatio-temporal interpolation,” SPIE, vol. 2653, pp. 85–95, 1990.CrossRefGoogle Scholar
  12. [12]
    R. Gvili, A. Kaplan, E. Ofek and G. Yahav, “Depth key,” Proc. SPIE Electronic Imaging, 2003.Google Scholar
  13. [13]
    B. Horn, Robot vision. Cambridge Mass., MIT Press, 1986.Google Scholar
  14. [14]
    N. Hur and C. Ahn, “Experimental service of 3-DTV broadcasting relay in Korea,” Proc. SPIE 4864, pp. 1–13, 2002.ADSCrossRefGoogle Scholar
  15. [15]
    E. M. Izquierdo, “Stereo matching for enhanced telepresence in three dimensional videocommunications,” IEEE Trans. on Circuit and Systems, vol. 7, no. 4, pp. 629–643, Aug. 1997.Google Scholar
  16. [16]
    E. M. Izquierdo and S. Kruse, “Image analysis for 3-D modeling, rendering, and virtual view generation,” Computer Vision and Image Understanding, vol. 71, no. 2, pp. 231–253, 1998.CrossRefGoogle Scholar
  17. [17]
    T. Kanade and P. J. Narayanan, “Historical perspectives on 4D virtualized reality,” Proc. CVPR, p. 165, 2006.Google Scholar
  18. [18]
    T. Kanade, A. Yoshida, K. Oda, H. Kano and M. Tanaka, “A stereo machine for video-rate dense depth mapping and its new applications,” Proc. CVPR ' 96, pp. 196–202, 1996.Google Scholar
  19. [19]
    T. Kanade, P. W. Rander, and P. J. Narayanan, “Virtualized reality: constructing virtual worlds from real scenes,” IEEE Multimedia, vol. 4, no. 1, pp. 34–47, 1997.CrossRefGoogle Scholar
  20. [20]
    S. Kim, M. Kim, J. Lim, S. Son, and K. Sohn, “Forward disparity estimation and intermediate view reconstruction of 3-D images using irregular triangle meshes,” Proc. Conf. 3-D Image, pp. 51–54, July 2000.Google Scholar
  21. [21]
    M. Kim and S. Park, “Object-based stereoscopic conversion of MPEG4 encoded data,” PCM, pp. 491–498, 2004.Google Scholar
  22. [22]
    H. Kim and K. Sohn, “3-D reconstruction from stereo images for interaction between real and virtual objects,” Signal Processing: Image Communication, vol. 20, no. 1, pp. 61–75, Jan. 2005.zbMATHCrossRefGoogle Scholar
  23. [23]
    D. Kim, D. Min and K. Sohn, “A stereoscopic video generation method using stereoscopic display characterization and motion analysis,” IEEE Trans. on Broadcasting, vol. 54, no. 2, pp. 188–197, June 2008.Google Scholar
  24. [24]
    H. Kim, I. Kitahara, K. Kogure and K. Sohn, “A real-time 3-D modeling system using multiple stereo cameras for free-viewpoint video generation,” Proc. ICIAR, LNCS, vol. 4142, pp. 237–249, Sep. 2006.Google Scholar
  25. [25]
    M. Kim and K. Sohn, “Edge-preserving directional regularization technique for disparity estimation of stereoscopic images,” IEEE Trans. on Consumer Electronics, vol. 45, no. 3, pp. 804–811, Aug. 1999.CrossRefGoogle Scholar
  26. [26]
    J. Lim, K. Ngan, W. Yang and K. Sohn, “A multiview sequence CODEC with view scalability,” Signal Processing: Image Communication vol. 19, no. 3, pp. 239–256, Jan. 2004.CrossRefGoogle Scholar
  27. [27]
    T. Matsuyama, X. Wu, T. Takai and T. Wada, “Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video,” IEEE Trans. CSVT, vol. 14, no. 3, pp. 357–369, 2004.Google Scholar
  28. [28]
    W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan, “Image-based visual hulls,” Proc. ACM SIGGRAPH, pp. 369–374, 2000.Google Scholar
  29. [29]
    H. Murata and Y. Mori, “A real-time 2-D to 3-D image conversion technique using computed image depth,” SID, IGEST, pp. 919–922, 1998.Google Scholar
  30. [30]
    J. S. McVeigh, Efficient compression of arbitrary multi-view video signals, Ph.D. Thesis, Carnegie Mellon Univ., June 1996.Google Scholar
  31. [31]
    Y. Ohta and H. Tamura, Mixed reality, Springer-Verlag, New York Inc., 1999.CrossRefGoogle Scholar
  32. [32]
    T. Okino and H. Murata, “New television with 2-D/3-D image conversion technologies,” SPIE, vol. 2653, pp. 96–103, 1996.ADSCrossRefGoogle Scholar
  33. [33]
    L. Onural, T. Sikora and A. Smolic, “An overview of a new European consortium integrated three-dimensional television-capture, transmission and display (3-DTV),” European Workshop on the Integration of Knowledge, Semantics and Digital Media Technology (EWIMT) Proc., 2004.Google Scholar
  34. [34]
    R. Puri and B. Haskell, “Stereoscopic video compression using temporal scalability,” Proc. SPIE Visual Communication and Image Processing, vol. 2501, pp. 745–756, May 1995.ADSGoogle Scholar
  35. [35]
    A. Rauol, “State of the art of autostereoscopic displays,” RACE DISTIMA deliverable 45/THO/WP4.2/DS/R/57/01, Dec. 1995.Google Scholar
  36. [36]
    A. Redert, M. Op de Beeck, C. Fehn, W. IJsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I. Sexton and P. Surman. “ATTEST – Advanced Three-Dimensional Television System Technologies,” Proc. of 1st International Symposium on 3-D Data Processing, Visualization and Transmission, pp. 313–319, Padova, Italy, June 2002.Google Scholar
  37. [37]
    J. Ross and J. H. Hogben, “The Pulfrich effect and short-term memory in stereopsis,” Vision Research, vol. 15, pp. 1289–1290, 1975.CrossRefGoogle Scholar
  38. [38]
    L. G. Shapiro and G. C. Stockman, Computer vision,  Chap. 12, New Jersey, Prentice Hall, 2001.Google Scholar
  39. [39]
    E. Trucco and A. Verri. Introductory techniques for 3-D computer vision, New Jersey, Prentice Hall, 1998.Google Scholar
  40. [40]
    ISO/IEC JTC1/SC29/WG11, Report on Status of 3-DAV Exploration, Doc. W5416, Awaji, Japan, Dec. 2002.Google Scholar
  41. [41]
    ISO/IEC JTC1/SC29/WG11, Report on 3-D AV Exploration, Doc. W5878, Trondheim, Norway, July 2003.Google Scholar
  42. [42]
    ISO/IEC JTC1/SC29/WG11, Call for Comments on 3-D AV, Doc. W6051, Gold Coast, Australia, Oct. 2003.Google Scholar
  43. [43]
    ISO/IEC JTC1/SC29/WG11, Call for Evidence on Multi-View Video Coding, Doc. W6720, Palma, Spain, Oct. 2004.Google Scholar
  44. [44]
    ISO/IEC JTC1/SC29/WG11, Subjective test results for the CfP on Multi-view Video Coding, Doc. W7779, Bangkok, Thailand, Jan. 2006.Google Scholar
  45. [45]
    ISO/IEC JTC1/SC29/WG11, Description of Core Experiments in MVC, Doc. W7798, Bangkok, Thiland, Jan. 2006.Google Scholar
  46. [46]
    R. Wang and Y. Wang, “Multiview video sequence analysis, compression, and virtual viewpoint synthesis,” IEEE Trans. on Circuits and System for Video Technology, vol. 10, no. 3, pp. 397–410, Apr. 2000.CrossRefGoogle Scholar
  47. [47]
    G. Wei, “Intensity- and gradient-based stereo matching using hierarchical Gaussian basis functions,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1143–1160, Nov. 1998.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.School of Electrical and Electronic Engineering, Yonsei UniversitySeoulRepublic of Korea
  2. 2.Knowledge Science Lab, ATRKyotoJapan

Personalised recommendations