Abstract
Post-production and processing for stereoscopic 3D are attracting a lot attention in recent years. In particular, the acquired disparity in most situations requires further manipulation to adjust different view conditions. This paper proposes a novel method to address the issue of disparity remapping of stereoscopic images. We present a nonlinear disparity mapping model to adjust the depth range of the whole image as well as the special visual important regions. To implement this model, our method compute saliency maps for the stereoscopic images. Then we extend the PatchMatch algorithm to search for the proper patches in both the left and the right images by visual combined constraints, and use them to iteratively refine the images to meet the target depth range. Our method is capable of minimizing the distortion of the images and ensuring the correct stereo consistency after disparity remapping. The experimental results demonstrate that the proposed approach can adjust the depth range to improve the stereoscopic effects while preserving the naturalness of the scene.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Smolic, A., Kauff, P., Knorr, S., Hornung, A., Kunter, M., Muller, M., Lang, M.: Three-dimensional video postproduction and processing. Proceedings of the IEEE 99(4), 607–625 (2011)
Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., Gross, M.: Nonlinear disparity mapping for stereoscopic 3D. ACM Transactions on Graphics 29(4), 75 (2010)
Chang, C.H., Liang, C.K., Chuang, Y.Y.: Content-aware display adaptation and interactive editing for stereoscopic images. IEEE Transactions on Multimedia 13(4), 589–601 (2011)
Yan, T., Lau, R.W., Xu, Y., Huang, L.: Depth mapping for stereoscopic videos. International Journal of Computer Vision 102(1-3), 293–307 (2013)
Kim, D., Choi, S., Sohn, K.: Depth adjustment for stereoscopic images and subjective preference evaluation. Journal of Electronic Imaging 20(3), 033011 (2011)
Sohn, H., Jung, Y.J., Lee, S.I., Speranza, F., Ro, Y.M.: Disparity remapping to ameliorate visual comfort of stereoscopic video. In: Proceedings of SPIE 8648. Stereoscopic Displays and Applications XXIV (2013)
Yan, T., He, S., Lau, R.W., Xu, Y.: Consistent stereo image editing. In: ACM International Conference on Multimedia, pp. 677–680 (2013)
Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: The 12th IEEE International Conference on Computer Vision, pp. 151–158 (2009)
Tasli, E.H., Alatan, A.A.: User assisted disparity remapping for stereo images. Signal Processing: Image Communication 28(10), 1374–1389 (2013)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics 28(3), 24 (2009)
Yang, Q.X.: Hardware-Efficient Bilateral Filtering for Stereo Matching. IEEE Transactions on Pattern Analysis and Machine Intelligence 36(5), 1026–1032 (2014)
Lee, S., Kim, Y., Lee, J., Kim, K., Lee, K., Noh, J.: Depth manipulation using disparity histogram analysis for stereoscopic 3D. The Visual Computer 30(4), 455–465 (2014)
Cheng, M.M., Mitra, N.J., Huang, X., Torr, H.S., Hu, S.M.: Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (to appear, 2014)
Rother, C., Kolmogorov, V., Blake, A.: “Grabcut” - Interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics 23(3), 309–314 (2004)
Simakov, D., Caspi, Y., Shechtman, E., Irani, M.: Summarizing visual data using bidirectional similarity. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Morse, B., Howard, J., Cohen, S., Price, B.: Patchmatch-based content completion of stereo image pairs. In: The Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, pp. 555–562 (2012)
Wang, L., Jin, H., Yang, R., Gong, M.: Stereoscopic inpainting: Joint color and depth completion from stereo images. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(3), 463–476 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Lu, D., Ma, H., Liu, L., Fu, H. (2015). Patch-Based Disparity Remapping for Stereoscopic Images. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8935. Springer, Cham. https://doi.org/10.1007/978-3-319-14445-0_43
Download citation
DOI: https://doi.org/10.1007/978-3-319-14445-0_43
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14444-3
Online ISBN: 978-3-319-14445-0
eBook Packages: Computer ScienceComputer Science (R0)