Skip to main content
SpringerLink
Log in

Analysis of maximum tolerant depth distortion in view synthesis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

An Author Correction to this article was published on 01 November 2017

This article has been updated

Abstract

In view synthesis, pixels in an original view are warped into a virtual view with depth-image-based rendering (DIBR). During the procedure of DIBR, distortions in depth map may lead to geometric errors in the synthesized view which will induce quality degradation of synthesized view. Therefore, how to efficiently preserve the fidelity of depth information is extremely important. In this paper, we explore and develop a maximum tolerable depth distortion (MTDD) model to examine the allowable depth distortion which will not introduce any texture distortion for a rendered virtual view and accordingly develop. Experimental results show that a virtual view can be synthesized without introducing any geometric changes if depth distortions follow the MTDD specified thresholds.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Change history

  • 01 November 2017

    The authors regret that the funding number “ZR2016FB20” was incorrectly written in the acknowledgement as “2016ZRB01AIU”.

References

  1. Daribo I, Tillier C, Pesquet-Popescu B (2008) Adaptive wavelet coding of the depth map for stereoscopic view synthesis. In: Proc. IEEE 10th Workshop MSP, pp 413–417

  2. Fang L, Cheung NM, Tian D, Vetro A, Sun HF, Au OC (2014) An analytical model for synthesis distortion estimation in 3D video. J IEEE Trans Image Process 23(1):185–199

    Article  MathSciNet  MATH  Google Scholar 

  3. Fang L, Xiang YJ, Cheung NM, Wu F (2016) Estimation of virtual view synthesis distortion toward virtual view position. J IEEE Trans Image Process 25(5):1961–1976

    Article  MathSciNet  Google Scholar 

  4. Federica B, Emilie B, Marco C, Patrick L, Simone P (2015) Objective image quality assessment of 3D synthesized views. J Signal Proc image Com 30(2015):78–88

    Google Scholar 

  5. Hannuksela M, Rusanovskyy D, Su W, Chen R, Li P, Aflaki P, Lan D, Joachimiak M, Li H, Gabbouj M (2013) Multi-view-video-plus-depth coding based on the advanced video coding standard. J IEEE Trans Image Proc 22(9):3449–3458

    Article  Google Scholar 

  6. Lei J, Li S, Zhu C, Sun M, Hou C (2015) Depth coding based on depth-texture motion and structure similarities. J IEEE Trans Circuits Syst Video Technol 25(2):275–286

    Article  Google Scholar 

  7. Liu YW, Huang QM, Ma SW, Zhao DB, Gao W (2009) Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model. J Sign Process Image Communic 24(8):666–681

    Article  Google Scholar 

  8. Loghman M, Kim J (2015) Segmentation-based view synthesis for multi-view video plus depth. J Multimedia Tools Appl 74(5):1611–1625

    Article  Google Scholar 

  9. Mateusz G, Krzysztof W, Marek D (2008) View synthesis software and assessment of its performance. ISO/IEC JTC1/SC29/WG11 MPEG/M15672

  10. McMillan L Jr (1997) An image-based approach to three-dimensional computer graphics. Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC Natural Science Foundation of Shandong Province

  11. Merkle P, Smolic A, Mller K, Wiegand T (2007) Multi-view video plus depth representation and coding. In: Proc. IEEE Int. Conf. Image Process. (ICIP), I-201CI-204

  12. Merkle P, Jaehwan J, Smolic A, Farin K, Muller P (2009) The effects of multiview depthvideo compression on multiview rendering. J Signal Proc Image Com 24(2009):73–88

    Article  Google Scholar 

  13. Sanchez A, Shen G, Ortega A (2009) Edge-preserving depth-map coding using tree-based wavelets. In: Proc. 43rd Asilomar Conf. Signals, Syst. Proc. IEEE 10th Workshop MSP, pp 578–582

  14. Shao F, Lin WS, Jiang GY, Yu M, Dai QH (2014) Depth map coding for view synthesis based on distortion analyses. J IEEE Journ Emerg Select Top Circuits Syst 4(1):106–117

    Article  Google Scholar 

  15. Xu X, Po L, Ng K, Feng L, Cheung C, Cheung C (2013) Depth map misalignment correction and dilation for DIBR view synthesis. J Signal Proc Image Com 28(9):1023–1045

    Article  Google Scholar 

  16. Yuan H, Kwong S, Liu J, Sun J (2014) A novel distortion model and Lagrangian multiplier for depth maps coding. J IEEE Trans Circuits Syst Video Technol 24(3):443–451

    Article  Google Scholar 

  17. Zhang QW, An P, Zhang Y, Zhang ZY (2011) Efficient rendering distortion estimation for depth map compression. In: Proc. IEEE 18th ICIP, pp 1105–1108

  18. Zhang Y, Kwong S, Hu S, Jay Kuo C-C (2014) Efficient Multiview depth coding optimization based on allowable depth distortion in view synthesis. IEEE Trans Image Process 23(11):4879–4892

    Article  MathSciNet  MATH  Google Scholar 

  19. Zhang Y, Kwong S, Hu SD, Jay Kuo CC (2014) Efficient Multiview depth coding optimization based on allowable depth distortion in view synthesis. J IEEE Trans Image Process 23(11):4879–4892

    Article  MathSciNet  MATH  Google Scholar 

  20. Zhao Y, Zhu C, Chen Z, Yu L (2011) Depth no-synthesis-error model for view synthesis in 3-D video. J IEEE Trans Image Proc 20(8):2221–2228

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Natural Science Foundation of China under Grants 61471262, 61520106002 and 61601261, and by Ph.D. Programs Foundation of Ministry of Education of China under Grants 20110032110029 and 20130032110010, Doctoral Fund of Natural Science Foundation of Shandong Province under Grants 2016ZRB01AIU and a Smart Future Fellowship sponsored by the Queensland Government of Commonwealth Australia.

Author information

Authors and Affiliations

  1. School of software, Qufu Normal University, Jining, Shandong, 273165, China

    Laihua Wang, Sumin Qi & Lanlan Jiang

  2. School of Electronic Information Engineering, Tianjin University, Tianjin, 300072, China

    Chunping Hou

Authors
  1. Laihua Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chunping Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sumin Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lanlan Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Laihua Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, L., Hou, C., Qi, S. et al. Analysis of maximum tolerant depth distortion in view synthesis. Multimed Tools Appl 77, 7909–7927 (2018). https://doi.org/10.1007/s11042-017-4690-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4690-1

Keywords

Search

Navigation