Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Visual Computing

ISVC 2014: Advances in Visual Computing pp 97–106Cite as

Real-Time Depth-Image-Based Rendering for 3DTV Using OpenCL

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8887))

Abstract

This paper proposes a real-time (performance of at least 30 fps for full-HD video) Depth-Image-based Rendering (DIBR) approach for stereoscopic 3DTV using OpenCL. Many stereoscopic 3DTV, multi-view, and Free-view-point TV (FTV) technologies have been based on DIBR, aiming at saving bandwidth, and to allow for user adaptation in the client-side. Unlike related work, this paper uses OpenCL for all the DIBR steps, including the re-projection in the virtual views (which is commonly performed using OpenGL, even when implemented in GPGPUs). The use of OpenCL-only can, in some cases, outperform the OpenGL z-testing performance. Two execution models have been implemented (per-line parallel, and per-pixel parallel) and tested against standard video-plus-depth test sequences to show the approach performance.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Dufaux, F., Pesquet-Popescu, B., Cagnazzo, M. (eds.): Emerging technologies for 3D video: creation, coding, transmission, and rendering. John Wiley & Sons Inc., Chichester (2013)

    Google Scholar 

  2. Müller, K., Merkle, P., Wiegand, T.: 3-D Video Representation Using Depth Maps. Proc. IEEE 99, 643–656 (2011)

    Article  Google Scholar 

  3. Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Proc SPIE, vol. 5291, pp. 93–104 (2004)

    Google Scholar 

  4. Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds.): 3D-TV System with Depth-Image-Based Rendering. Springer, New York (2013)

    Google Scholar 

  5. Tanimoto, M.: FTV: Free-viewpoint Television. Signal Process. Image Commun. 27, 555–570 (2012)

    Article  Google Scholar 

  6. Guillemot, C., Le Meur, O.: Image Inpainting: Overview and Recent Advances. IEEE Signal Process. Mag. 31, 127–144 (2014)

    Article  Google Scholar 

  7. Tian, D., Lai, P.-L., Lopez, P., Gomila, C.: View synthesis techniques for 3D video. In: Proc SPIE, vol. 7443, pp. 74430T–74430T–11 (2009)

    Google Scholar 

  8. Zhao, Y., Zhu, C., Yu, L.: Virtual View Synthesis and Artifact Reduction Techniques. In: Zhu, C., Zhao, Y., Yu, L., Tanimoto, M. (eds.) 3D-TV System with Depth-Image-Based Rendering, pp. 145–167. Springer, New York (2013)

    Chapter  Google Scholar 

  9. Owens, J.D., Luebke, D., Govindaraju, N., Harris, M., Krüger, J., Lefohn, A.E., Purcell, T.J.: A Survey of general-purpose computation on graphics hardware. Computer Graphics Forum, 80–113 (2007)

    Google Scholar 

  10. Munshi, A.: OpenCL programming guide. Addison-Wesley, Upper Saddle River (2012)

    Google Scholar 

  11. Park, Y.K., Jung, K., Oh, Y., Lee, S., Kim, J.K., Lee, G., Lee, H., Yun, K., Hur, N., Kim, J.: Depth-image-based rendering for 3DTV service over T-DMB. Signal Process: Image Commun. 24, 122–136 (2009)

    Google Scholar 

  12. Fan, Y.-C., Chi, T.-C.: The Novel Non-Hole-Filling Approach of Depth Image Based Rendering. In: 3DTV Conference: The True Vision-Capture. Transmission and Display of 3D Video, pp. 325–328. IEEE (2008)

    Google Scholar 

  13. Vázquez, C., Tam, W.J., Speranza, F.: Stereoscopic imaging: filling disoccluded areas in depth image-based rendering. In: Javidi, B., Okano, F., Son, J.-Y. (eds.) Proc. SPIE, p. 63920D–63920D–12 (2006)

    Google Scholar 

  14. Azzari, L., Battisti, F., Gotchev, A.: Comparative analysis of occlusion-filling techniques in depth image-based rendering for 3D videos. In: Proceedings of the 3rd Workshop on Mobile Video Delivery, pp. 57–62. ACM (2010)

    Google Scholar 

  15. Chen, W.-Y., Chang, Y.-L., Chiu, H.-K., Chien, S.-Y., Chen, L.-G.: Real-time depth image based rendering hardware accelerator for advanced three dimensional television system. In: 2006 IEEE International Conference on Multimedia and Expo., pp. 2069–2072. IEEE (2006)

    Google Scholar 

  16. Bondarev, E., Zinger, S., De With, P.H.N.: Performance-efficient architecture for free-viewpoint 3DTV receiver. In: 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE), pp. 65–66. IEEE (2010)

    Google Scholar 

  17. Lee, M.-H., Park, I.K.: Accelerating depth image-based rendering using GPU. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds.) MRCS 2006. LNCS, vol. 4105, pp. 562–569. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  18. Rogmans, S., Lu, J., Lafruit, G.: A scalable end-to-end optimized real-time image-based rendering framework on graphics hardware. In: 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, pp. 129–132. IEEE (2008)

    Google Scholar 

  19. Shin, H.-C., Kim, Y.-J., Park, H., Park, J.-I.: Fast view synthesis using GPU for 3D display. IEEE Trans. on Consum. Electron. 54, 2068–2076 (2008)

    Article  Google Scholar 

  20. Shin, I., Ho, Y.: GPU Parallel Programming for Real-time Stereoscopic Video Generation. In: International Conference on Electronics, Information, and Communication, pp. 315–318 (2010)

    Google Scholar 

  21. Rogmans, S., Dumont, M., Lafruit, G., Bekaert, P.: Migrating real-time depth image-based rendering from traditional to next-gen GPGPU. In: 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, pp. 1–4. IEEE (2009)

    Google Scholar 

  22. Wang, L.-H., Zhang, J., Yao, S.-J., Li, D.-X., Zhang, M.: GPU Based Implementation of 3DTV System. In: Sixth International Conference on Image and Graphics (ICIG), pp. 847–851. IEEE (2011)

    Google Scholar 

  23. Xu, K., Ji, X., Wang, R., Dai, Q.: Parallel implementation of depth-image-based rendering. In: IC3D, pp. 1–4. IEEE (2011)

    Google Scholar 

  24. Do, L., Bravo, G., Zinger, S., de With, P.H.: GPU-accelerated Real-time Free-viewpoint DIBR for 3DTV. IEEE Trans. on. Consum. Electron 58, 633–640 (2012)

    Article  Google Scholar 

  25. Zheng, Z., An, P., Zhao, B., Zhang, Z.: Real-Time Rendering Based on GPU for Binocular Stereo System. In: Zhang, W., Yang, X., Xu, Z., An, P., Liu, Q., Lu, Y. (eds.) IFTC 2012. CCIS, vol. 331, pp. 492–499. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  26. Günther, C., Kanzok, T., Linsen, L., Rosenthal, P.: A GPGPU-based Pipeline for Accelerated Rendering of Point Clouds. J. WSCG 21, 153–162 (2013)

    Google Scholar 

  27. Domañski, M., Grajek, T., Klimaszewski, K., Kurc, M., Stankiewicz, O., Stankowski, J., Wegner, K.: Poznan multiview video test sequences and camera parameters. ISOIEC JTC1SC29WG11 MPEG. M17050 (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, Pontifical Catholic University of Rio de Janeiro, PUC-Rio, Rio de Janeiro, RJ, Brazil

    Roberto Gerson de Albuquerque Azevedo, Fernando Ismério, Alberto Barbosa Raposo & Luiz Fernando Gomes Soares

Authors
  1. Roberto Gerson de Albuquerque Azevedo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fernando Ismério
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alberto Barbosa Raposo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luiz Fernando Gomes Soares
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada at Reno, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. The University of Texas at Dallas, 75080, Richardson, TX, USA

    Ryan McMahan

  6. NextGen Interactions, 27604, Raleigh, NC, USA

    Jason Jerald

  7. Indiana University, 46202, Indianapolis, IN, USA

    Hui Zhang

  8. Microsoft Research, 1 Microsoft Way, 98052, Redmond, WA, USA

    Steven M. Drucker

  9. University of Delaware, 19716-2712, Newark, DE, USA

    Chandra Kambhamettu

  10. Intel Corp., 95054, Santa Clara, CA, USA

    Maha El Choubassi

  11. Computer Graphics and Interactive Media Lab, Department of Computer Science, University of Houston, 77004, Houston, TX, USA

    Zhigang Deng

  12. NVIDIA, 34788, Leesburg, FL, USA

    Mark Carlson

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

de Albuquerque Azevedo, R.G., Ismério, F., Raposo, A.B., Soares, L.F.G. (2014). Real-Time Depth-Image-Based Rendering for 3DTV Using OpenCL. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2014. Lecture Notes in Computer Science, vol 8887. Springer, Cham. https://doi.org/10.1007/978-3-319-14249-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14249-4_10

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14248-7

  • Online ISBN: 978-3-319-14249-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation