Abstract
Novel view synthesis is a key technique in 3DTV. It usually uses depth maps as input. However, obtaining an accurate depth map from stereo images is hard even for the state-of-art stereo matching algorithms. When rendering based on the erroneous depth map, the resulting novel view will contain artifacts. In this paper, a new view synthesis method to eliminate image artifacts is proposed. Firstly, a bidirectional mapping method is introduced to get the initial virtual image. Secondly, a confidence map is built over the initial image, in which pixels with low value are regarded as artifacts and marked as “hole”. Finally, these “holes” are filled up by the proposed Hierarchical Completion of Hole (HCH) method. Experimental results show that good results can still be acquired even with the input depth maps containing a large number of wrong pixels.
The authors would like to thank to Science Technology Department of Zhejiang Province under Grant 2010C31108, Zhejiang Provincial Natural Science Foundation of China under Grant LY12F01020, and National Science Foundation of China (NSFC) under Grant No. 61271339.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Morvan, Y., Farin, D., De With, P.: System architecture for free-viewpoint video and 3D-TV. IEEE Transactions on Consumer Electronics 542, 925–932 (2008)
Harry, S., Sing, B.K.: Review of image-based rendering techniques. In: Proc. SPIE, vol. 4067, p. 2 (2000)
Christoph, F.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In: Proc. SPIE, vol. 5291, pp. 93–104 (2004)
McMillan Jr., L.: An Image-Based Approach To Three-Dimensional Computer Graphics [PhD Dissertation]. University of North Carolina (1997); Reader: Pizer, S.
Nquyen, Q.H., Do, M.N., Patel, S.J.: Depth image-based rendering from multiple cameras with 3D propagation algorithm. In: Proceedings of the 2nd International Conference on Immersive Telecommunications, Brussels, Belgium, pp. 1–6 (2009)
Wang, L.-H., Li, D.-X., Zhang, M.: Hierarchical Joint Bilateral Filtering for Depth Post-Processing. In: International Conference on Image and Graphics (ICIG), Washington, DC, pp. 129–134 (2011)
Oh, K.-J., Yea, S., Ho, Y.-S.: Hole-Filling Method Using Depth Based In-Painting For View Synthesis in Free Viewpoint Television (FTV) and 3D Video. In: Picture Coding Symposium, Chicago, USA (2009)
Andrew, J., Woods, N.S., Holliman, N.A.: Dodgson.: Adapting stereoscopic movies to the viewing conditions using depth-preserving and artifact-free novel view synthesis. In: Stereoscopic Displays and Applications, San Francisco, California (2011)
Europe’s Seventh Framework Programme for research and technology development (FP7), http://sp.cs.tut.fi/mobile3dtv/
Tian, D., Lai, P.-L., Patrick, L.: View synthesis techniques for 3D video. In: Applications of Digital Image Processing XXXII, vol. 7443, pp. 74430T–74430T-11 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Du, X., Ye, G., Zhu, Y., Shen, H. (2012). Hierarchical Hole Filling for Novel View Synthesis. In: Wang, F.L., Lei, J., Lau, R.W.H., Zhang, J. (eds) Multimedia and Signal Processing. CMSP 2012. Communications in Computer and Information Science, vol 346. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35286-7_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-35286-7_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35285-0
Online ISBN: 978-3-642-35286-7
eBook Packages: Computer ScienceComputer Science (R0)