Abstract
In this paper, we propose a stereo view generation algorithm using the Kinect depth camera that utilizes the infrared structured light. After we capture the color image and the corresponding depth map, we first preprocess the depth map and apply joint multilateral filtering to improve depth quality and temporal consistency. The preprocessed depth map is warped to the virtual viewpoint and filtered by median filtering to reduce truncation errors. Then, the color image is back-projected to the virtual viewpoint. In order to fill out remaining holes caused by disocclusion areas, we apply a background-based image in-painting process. Finally, we obtain a synthesized image without any visual distortion. From our experimental results, we realize that we obtain synthesized images without noticeable errors.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Riva, G., Davide, F., Ijsselsteijn, W.A.: Being There: Concepts, Effects and Measurement of User Presence in Synthetic Environments. Amsterdam, The Netherlands: Ios Press, (2003)
Redert, A., Op de Beeck, M., Fehn, C., IJsselsteijn, W., Pollefeys, M., Van Gool, L., Ofek, E., Sexton, I., Surman, P.: ATTEST-Advanced Three-Dimensional Television System Technologies. Proc. of International Symposium on 3D Data Processing, 313–319 (2002)
Fehn, C.: Depth-image-based Rendering (DIBR), Compression and Transmission for a New Approach on 3D TV. Proc. of SPIE Conf. Stereoscopic Displays and Virtual Reality Systems XI, Vol. 5291, 93–104 (2004)
Mark, W.R.: Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping. PhD thesis, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA, (1999)
Zhang, L., Tam, W. J.: Stereoscopic Image Generation Based on Depth Images for 3D TV. IEEE Trans. on Broadcasting, Vol. 51, 191–199 (2005)
Lee, S., Ho, Y.: Discontinuity-adaptive Depth Map Filtering for 3D View Generation. Proc. of Immersive Telecommunications, T8(1–6) (2009)
Stelmach, L., Tam, W., Meegan, D., Vincent, A., Corriveau, P.: Human Perception of Mismatched Stereoscopic 3D Inputs. Proc. of International Conference on Image Processing, Vol. 1, 5–8 (2000)
PrimeSense, http://www.primesense.com/?p=487
Telea, A.: An Image Inpainting Technique based on The Fast Marching Method. Journal Graphics Tools, Vol. 9, 25–36 (2004)
Yang, Q., Wang, L., Ahuja, N.: A Constant-Space Belief Propagation Algorithm for Stereo Matching. Proc. of Computer Vision and Pattern Recognition, 1458–1465 (2010)
Acknowledgements
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MEST) (No. 2011-0030822).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media, LLC
About this paper
Cite this paper
Ho, YS., Lee, SB. (2013). Joint Multilateral Filtering for Stereo Image Generation Using Depth Camera. In: The Era of Interactive Media. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3501-3_31
Download citation
DOI: https://doi.org/10.1007/978-1-4614-3501-3_31
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-3500-6
Online ISBN: 978-1-4614-3501-3
eBook Packages: Computer ScienceComputer Science (R0)