Abstract
In this paper, a 2D to 3D stereo image conversion scheme is proposed for 3D content creation. The difficulty in this problem lies on depth estimation/assignment from a mono image, which actually does not have sufficient information. To estimate the depth map, we adopt a strategy of performing foreground/background separation first, then classifying a background depth profile by neural network, estimating foreground depth from image cues, and finally combining them. To enhance stereoscopic perception for the synthesized images viewed on 3D display, depth refinement based on bilateral filter and HVS-based contrast modification between the foreground and background are adopted. Subjective experiments show that the stereo images generated by using the proposed scheme can provide good 3D perception.
Chapter PDF
Similar content being viewed by others
Keywords
References
Nayar, S.K., Nakagawa, Y.: Shape from Focus. IEEE Trans. on Pattern Analysis and Machine Intelligence 16(8), 824–831 (1994)
Namboodiri, V.P., Chaudhuri, S.: Recovery of Relative Depth from a Single Observation Using an Uncalibrated (Real-Aperture) Camera. In: Proc. of IEEE International Conference on Computer Vision and Pattern Recognition, Anchorage, AK, pp. 1–6 (2008)
Burazerovic, D., Vandewalle, P., Berretty, R.P.: Automatic Depth Profiling of 2D Cinema - and Photographic Images. In: Proc. of IEEE International Conference on Image Processing, Cairo, pp. 2365–2368 (2009)
Kim, M., Park, S., Kim, H., Artem, I.: Automatic conversion of two-dimensional video into stereoscopic video. In: Proc. of SPIE, vol. 6016, pp. 601610-1–601610-8 (2005)
Manbae, K., Sanghoon, P., Youngran, C.: Object-Based Stereoscopic Conversion of MPEG-4 Encoded Data. In: Proc. of the 5th Pacific-Rim Conference on Multimedia, pp. 491–498 (2004)
Kim, D., Min, D., Sohn, K.: A Stereoscopic Video Generation Method Using Stereoscopic Display Characterization and Motion Analysis. IEEE Trans. on Broadcasting 54(2), 188–197 (2008)
Suzuki, M.T., Yaginuma, Y., Yamada, T., Shimizu, Y.: A Shape Feature Extraction Method Based on 3D Convolution Masks. In: Proc. of Eighth IEEE International Symposium on Multimedia, pp. 837–844 (2006)
Peer, P., Kovace, J., Solina, F.: Human Skin Color Clustering for Face Detection. In: EU1ROCON 2003 International Conf. on Computer as a Tool, vol. 2, pp. 144–148 (2003)
Chen, Y.-J., Lin, Y.-C.: Simple Face-detection Algorithm Based on Minimum Facial Features. In: Proc. of IEEE International Conference on Industrial Electronics Society, pp. 455–460 (2007)
Sudhamani, M.V., Venugopal, C.R.: Segmentation of Color Images using Mean Shift Algorithm for Feature Extraction. In: Proc. of IEEE International Conference on Information Technology (2006)
Tomasi, C., Manduchi, R.: Bilateral Filtering for Gray and Color Images. In: Proc. of IEEE International Conference on Computer Vision, Bombay, pp. 839–846 (1998)
Lin, G.-S., Yeh, C.-Y., Chen, W.-C., Lie, W.-N.: A 2D to 3D conversion scheme based on depth cues analysis for MPEG videos. In: IEEE International Conference on Multimedia and Expo, pp. 1141–1145 (2010)
Han, K., Hong, K.: Geometric and texture cue based depth-map estimation for 2D to 3D image conversion. In: IEEE International Conference on Consumer Electronics, pp. 651–652 (2011)
Chiang, T.-W., Tsai, T., Lin, Y.-H., Hsiao, M.-J.: Fast 2D to 3D conversion based on wavelet analysis. In: IEEE International Conference on Systems Man and Cybernetics, pp. 3444–3448 (2010)
Liu, B., Gould, S., Koller, D.: Single image depth estimation from predicted semantic labels. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1253–1260 (2010)
Choi, J., Kim, W., Kong, H., Kim, C.: Real-time vanishing point detection using the local dominant orientation signature. In: 3DTV Conf., Turkey (May 2011)
Saxena, A., Sun, M., Ng, A.Y.: Learning 3-D Scene Structure from a Single Still Image. In: ICCV 2007 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lin, GS., Liu, HW., Chen, WC., Lie, WN., Huang, SY. (2011). 2D to 3D Image Conversion Based on Classification of Background Depth Profiles. In: Ho, YS. (eds) Advances in Image and Video Technology. PSIVT 2011. Lecture Notes in Computer Science, vol 7088. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25346-1_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-25346-1_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25345-4
Online ISBN: 978-3-642-25346-1
eBook Packages: Computer ScienceComputer Science (R0)